-- Logs begin at Mon 2022-10-24 12:34:01 UTC, end at Mon 2022-10-24 13:30:23 UTC. -- Oct 24 12:59:24.295358 dv-cinder-862491-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 24 12:59:24.304984 dv-cinder-862491-1-smb devstack@keystone.service[81588]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 24 12:59:24.307622 dv-cinder-862491-1-smb devstack@keystone.service[81588]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 24 12:59:24 2022] *** Oct 24 12:59:24.307759 dv-cinder-862491-1-smb devstack@keystone.service[81588]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 24 12:59:24.307867 dv-cinder-862491-1-smb devstack@keystone.service[81588]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 24 12:59:24.307978 dv-cinder-862491-1-smb devstack@keystone.service[81588]: nodename: dv-cinder-862491-1-smb Oct 24 12:59:24.308072 dv-cinder-862491-1-smb devstack@keystone.service[81588]: machine: x86_64 Oct 24 12:59:24.308172 dv-cinder-862491-1-smb devstack@keystone.service[81588]: clock source: unix Oct 24 12:59:24.308270 dv-cinder-862491-1-smb devstack@keystone.service[81588]: pcre jit disabled Oct 24 12:59:24.308362 dv-cinder-862491-1-smb devstack@keystone.service[81588]: detected number of CPU cores: 4 Oct 24 12:59:24.308452 dv-cinder-862491-1-smb devstack@keystone.service[81588]: current working directory: / Oct 24 12:59:24.308550 dv-cinder-862491-1-smb devstack@keystone.service[81588]: detected binary path: /usr/bin/uwsgi-core Oct 24 12:59:24.308662 dv-cinder-862491-1-smb devstack@keystone.service[81588]: your processes number limit is 47680 Oct 24 12:59:24.308779 dv-cinder-862491-1-smb devstack@keystone.service[81588]: your memory page size is 4096 bytes Oct 24 12:59:24.308779 dv-cinder-862491-1-smb devstack@keystone.service[81588]: detected max file descriptor number: 2048 Oct 24 12:59:24.308779 dv-cinder-862491-1-smb devstack@keystone.service[81588]: lock engine: pthread robust mutexes Oct 24 12:59:24.309007 dv-cinder-862491-1-smb devstack@keystone.service[81588]: thunder lock: enabled Oct 24 12:59:24.309139 dv-cinder-862491-1-smb devstack@keystone.service[81588]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 24 12:59:24.309215 dv-cinder-862491-1-smb devstack@keystone.service[81588]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 24 12:59:24.348521 dv-cinder-862491-1-smb devstack@keystone.service[81588]: Python main interpreter initialized at 0x55f0ad7489c0 Oct 24 12:59:24.348521 dv-cinder-862491-1-smb devstack@keystone.service[81588]: python threads support enabled Oct 24 12:59:24.348521 dv-cinder-862491-1-smb devstack@keystone.service[81588]: your server socket listen backlog is limited to 100 connections Oct 24 12:59:24.348521 dv-cinder-862491-1-smb devstack@keystone.service[81588]: your mercy for graceful operations on workers is 90 seconds Oct 24 12:59:24.348851 dv-cinder-862491-1-smb devstack@keystone.service[81588]: mapped 403077 bytes (393 KB) for 2 cores Oct 24 12:59:24.348942 dv-cinder-862491-1-smb devstack@keystone.service[81588]: *** Operational MODE: preforking *** Oct 24 12:59:24.349181 dv-cinder-862491-1-smb devstack@keystone.service[81588]: *** uWSGI is running in multiple interpreter mode *** Oct 24 12:59:24.349181 dv-cinder-862491-1-smb devstack@keystone.service[81588]: spawned uWSGI master process (pid: 81588) Oct 24 12:59:24.349581 dv-cinder-862491-1-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 24 12:59:24.355455 dv-cinder-862491-1-smb devstack@keystone.service[81588]: spawned uWSGI worker 1 (pid: 81600, cores: 1) Oct 24 12:59:24.355455 dv-cinder-862491-1-smb devstack@keystone.service[81588]: spawned uWSGI worker 2 (pid: 81601, cores: 1) Oct 24 12:59:24.355455 dv-cinder-862491-1-smb devstack@keystone.service[81588]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 24 12:59:28.628724 dv-cinder-862491-1-smb devstack@keystone.service[81600]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 12:59:28.628724 dv-cinder-862491-1-smb devstack@keystone.service[81600]: from cryptography.utils import int_from_bytes Oct 24 12:59:28.629512 dv-cinder-862491-1-smb devstack@keystone.service[81600]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 12:59:28.629512 dv-cinder-862491-1-smb devstack@keystone.service[81600]: from cryptography.utils import int_from_bytes Oct 24 12:59:28.630027 dv-cinder-862491-1-smb devstack@keystone.service[81601]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 12:59:28.630027 dv-cinder-862491-1-smb devstack@keystone.service[81601]: from cryptography.utils import int_from_bytes Oct 24 12:59:28.630467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 12:59:28.630467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: from cryptography.utils import int_from_bytes Oct 24 12:59:28.679181 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 12:59:28.679362 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 12:59:28.679571 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] command line args: [] {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 12:59:28.679833 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 12:59:28.679949 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 12:59:28.680028 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ================================================================================ {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 12:59:28.680144 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 12:59:28.680235 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] admin_token = **** {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.680335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] command line args: [] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 12:59:28.680459 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] config_dir = [] {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.680601 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 12:59:28.680683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.680762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ================================================================================ {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 12:59:28.680833 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] config_source = [] {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.680963 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] debug = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.681045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] admin_token = **** {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.681156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.681465 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] config_dir = [] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.681465 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.681647 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.681739 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] config_source = [] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.681830 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.681921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] debug = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.682020 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.682130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.682248 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.682349 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.682349 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.682537 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] list_limit = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.682537 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] log_config_append = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.682724 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.682864 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.682964 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.683056 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] log_dir = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.683056 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] log_file = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.683236 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] list_limit = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.683236 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] log_config_append = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.683453 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.683582 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.683663 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.683745 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] log_dir = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.683745 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] log_file = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.683923 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.683998 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.684115 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.684115 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.684309 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.684384 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.684461 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.684572 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.684652 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.684731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.684807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.684883 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.685002 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.685102 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.685186 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.685330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.685412 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.685555 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.685677 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.685790 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.685865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.686020 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.686108 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.686248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.686369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.686489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.686731 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.686817 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.686895 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] publish_errors = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.687007 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.687128 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.687353 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.687498 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.687578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.687700 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] publish_errors = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.687785 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.687905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.687986 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.688133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.688296 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] standard_threads = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.688389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.688475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.688551 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.688666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.688746 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.688825 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.688973 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] use_journal = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.689050 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] standard_threads = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.689144 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] use_json = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.689219 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.689338 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] use_stderr = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.689478 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.689553 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] use_syslog = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.689691 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.689770 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.689838 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] use_journal = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.689906 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] use_json = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.689981 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.690051 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] use_stderr = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.690141 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.690223 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] use_syslog = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.690394 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.690472 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:59:28.690627 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.690710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.690871 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.690949 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.691102 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.691183 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.691344 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.691445 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.691597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.691672 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.691839 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.691922 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.692081 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.692158 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.692312 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.692386 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.692538 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.692613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.692777 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.692894 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.693007 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.693089 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.693741 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.694111 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.694244 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.694354 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.694480 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.694592 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.694725 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.694847 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.694971 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.695100 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.695204 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.695344 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.695479 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.695639 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.695735 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.695839 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.695977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.696097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.696213 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.696346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.696464 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.696591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.696724 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.696820 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.696973 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.697061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.697225 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.697308 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.697455 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.697530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.697683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.697770 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.697911 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.697993 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.698144 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.698220 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.698372 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.698458 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.698616 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.698691 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.698841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.698915 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.699069 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.699151 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.699311 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.699393 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.699560 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.699639 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.699792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.699877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.700023 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.700099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.700247 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.700322 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.700475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.700561 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.700701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.700784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.700927 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.701002 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.701155 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.701300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.701379 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.701455 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.701598 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.701680 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.701827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.701910 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.702052 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.702129 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.702281 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.702357 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.702510 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.702597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.702738 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.702813 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.702962 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.703044 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.703192 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.703275 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.703463 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.703544 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.703671 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.703756 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.703902 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.703986 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.704129 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.704203 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.704342 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.704452 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.704582 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.704686 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.704809 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.704911 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.705034 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.705140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.705244 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.705353 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.705496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.705577 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.705726 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.705804 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.705950 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.706066 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.706180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.706268 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.706411 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.706488 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.706639 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.706723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.706878 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.706959 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.707111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.707189 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.707354 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.707451 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.707612 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.707697 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.707844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.707964 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.708075 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.708152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.708316 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.708396 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.708546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.708625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.708777 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.708917 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.709584 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.709689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.709801 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.710037 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.710120 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.710192 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.710321 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.710397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.710511 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.710583 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.710720 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.710804 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.710956 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.711075 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.711183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.711259 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.711438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.711612 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.711703 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.711777 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.711894 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.711973 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.712138 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.712214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.712372 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.712450 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.712612 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.712688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.712846 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.712918 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.713101 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.713188 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.713297 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.713373 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.713524 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.713613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.713751 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.713838 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.713979 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.714058 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.714206 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.714285 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.714431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.714514 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.714659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.714741 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.714888 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.714970 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.715116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.715207 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.715350 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.715471 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.715607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.715683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.715854 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.715947 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.716089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.716178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.716318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] auth.external = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.716395 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.716546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.716633 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.716817 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.716902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.717049 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] auth.external = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.717127 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.717272 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] auth.password = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.717355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.717498 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] auth.token = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.717584 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.717731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.717809 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.717961 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.718037 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] auth.password = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.718208 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] auth.token = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.718292 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.718430 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.718513 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.718665 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.718742 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.718902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.718990 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.719128 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.719205 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.719357 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] credential.caching = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.719452 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.719620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.719709 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.719847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.719924 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.720082 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] credential.caching = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.720159 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.720327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.720412 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.720562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.720638 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.720792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.720875 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.721033 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.721123 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.721271 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.721348 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.721499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.721575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.721739 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.721824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.721991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.722069 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.722226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.722303 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.722475 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.722560 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.722708 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.722791 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.722960 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.723037 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.723191 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] federation.caching = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.723284 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.723453 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.723535 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.723683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.723763 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.723924 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.724010 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] federation.caching = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.724150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.724228 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.724390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.724513 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.724647 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.724797 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.724898 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.725114 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.725192 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.725366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.725452 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.725597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.725674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.725838 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.725915 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.726069 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] identity.caching = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.726154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.726312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.726389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.726552 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.726629 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.726781 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.726927 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.727002 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.727073 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.caching = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.727241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.727319 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.727490 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.727582 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.727724 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.727801 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.727956 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.728036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.728203 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.728289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.728428 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.728505 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.728654 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.728731 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.728879 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.728963 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.729117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.729194 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.729348 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.729430 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.729577 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.729662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.729805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.729883 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.730047 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.730124 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.730292 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.730380 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.730528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.730605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.730761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.730838 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.730985 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.731071 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.731217 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.731294 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.731461 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.731542 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.731696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.731784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.731930 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.732008 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.732163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.732239 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.732392 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.732477 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.732616 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.732693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.732852 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.732929 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.733088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.733174 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.733315 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.733392 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.733548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.733624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.733785 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.733870 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.734010 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.734099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.734239 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.734322 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.734462 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.734542 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.734691 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.734768 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.734920 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.734996 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.735155 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.735259 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.735381 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.735518 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.735638 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.735752 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.735872 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.735999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.736112 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.736245 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.736346 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.736473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.736687 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.736766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.736932 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.737008 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.737173 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.737250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.737402 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.737480 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.737630 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.737706 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.737861 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.737938 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.738094 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.user = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.738226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.738330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.738410 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.738562 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.738638 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.738797 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.738875 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.739024 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.739100 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.739262 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.739339 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.739524 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.739863 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.739945 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.740016 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.740086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.740145 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.740278 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.740352 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.740487 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.740565 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.740722 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.740799 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.740949 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.741028 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.741183 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.741260 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.741416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.741492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.741651 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.741729 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.741879 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.741956 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.742117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.742192 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.742345 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.742424 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.742588 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.742664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.742821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.742898 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.743052 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.743130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.743276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.743358 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.743525 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.743603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.743766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.743844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.744000 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.744076 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.744229 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.744304 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.744459 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.744536 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.744690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.744766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.744929 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.745005 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.745159 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.745238 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.745388 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.745471 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.745618 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.745695 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.745856 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.745933 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.746089 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.746166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.746313 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.746388 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.746542 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.746621 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.746776 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] resource.caching = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.746853 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.747011 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.747087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.747240 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.747319 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.747495 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.747577 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.747734 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] resource.caching = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.747812 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.747974 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.748053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.748212 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.748289 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.748440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.748522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.748670 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.748748 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.748902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.748978 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.749130 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] role.caching = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.749279 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.749354 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] role.driver = sql {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.749425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.749581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.749658 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.749812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.749895 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.750044 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] role.caching = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.750121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.750284 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.750360 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] role.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.750506 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.750590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.750750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.750827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.750986 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.751062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.751224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.751309 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.751487 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.751565 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.751713 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.751789 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.751953 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.752043 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.752192 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.752270 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.752432 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.752510 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.752656 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.752740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.752901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.753040 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.753144 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.753267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.753408 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.753513 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.753616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.753755 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.753994 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.754071 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.754225 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.754310 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.754454 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.754531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.754703 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.754780 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.754946 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.755025 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.755180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.755257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.755405 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.755507 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.755657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.756279 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.756470 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.756547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.756719 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.756822 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.756951 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.757031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.757185 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.757262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.757416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.757492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.757647 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.757726 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.757871 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.757948 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.758101 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] token.caching = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.758177 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.758331 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.758410 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.758578 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.758655 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.758806 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.758883 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.759040 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] token.caching = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.759119 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.759273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.759350 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.759525 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.759605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.759766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.759845 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.760001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.760077 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.760244 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.760321 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.760475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.760554 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.760707 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.760783 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.760935 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.761011 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.761175 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.761253 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.761405 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.761481 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.761640 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.761717 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.761872 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.761962 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.762116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.762194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.762366 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] database.connection = **** {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.762442 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.762602 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.762689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.762840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.762926 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.763072 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.763150 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.763306 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.763383 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.connection = **** {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.763559 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.763651 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.763788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.763867 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.764017 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.764095 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.764246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.764332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.764483 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.764567 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.764713 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.764790 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.764943 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.765028 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.765170 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.765248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.765409 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.765485 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.765634 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.765719 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.765871 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.765949 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.766097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.766175 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.766330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.766415 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.766559 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.766636 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.766706 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 12:59:28.766799 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.767031 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.767268 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.767525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:59:28.767694 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 12:59:28.796338 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:28.796465 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:28.796553 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:28.796628 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:28.796701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:28.796773 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:28.805099 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:28.805311 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:28.835590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:28.835727 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:28.835806 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:28.835879 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:28.887560 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:28.888001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:28.936284 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:28.936409 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:28.936517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:28.936644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.093065 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.093233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.093303 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.093431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.093562 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.093664 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.093746 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.093854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.093940 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.094064 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.094158 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.094296 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.117513 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.117768 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.117904 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.117991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.118136 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.118221 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.118347 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.118427 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.118556 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.118647 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.118764 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.118847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.118975 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.119189 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.129805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.130010 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.143220 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.143491 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.143585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.143674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.143740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.143881 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.143965 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.144092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.144177 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.144300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.144382 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.144509 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.144589 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.144722 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:59:29.161226 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.161433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 24 12:59:29.161643 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.161770 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.161851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 24 12:59:29.161994 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 24 12:59:29.162214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.162340 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.162436 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 24 12:59:29.162527 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.162710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.162940 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.163028 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.163273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.163469 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.163735 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.172623 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.172901 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.173130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.173220 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.173409 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.173499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.173680 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.173963 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.180931 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.181695 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.183833 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.184117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.184399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.184606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.184695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.184893 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.184982 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.185175 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.185265 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.185437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.185525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.185706 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.185803 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.185971 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.186093 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.186239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.186362 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.186513 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.186636 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.186897 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.187172 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.187458 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.210037 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.210837 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.211545 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.211796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.212322 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.212606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.218087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.218372 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.218651 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.218957 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.219244 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.219553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.225267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.225555 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.226028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.226315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.229729 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.230021 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.230302 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.230509 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.230590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.230802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.230891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.231087 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.231168 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.231367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.231467 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.231665 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.231745 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.231961 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.232238 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.232516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.247889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.248164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.248888 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.249167 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.252014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.253043 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.255207 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.255527 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.256970 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.257261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.260334 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.261498 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.263523 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.264706 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.266717 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.267012 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.267301 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.267707 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.267932 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.268217 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.268325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.268503 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.268697 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.269753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.270052 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.270335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.284493 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.284780 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.285046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.285307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.286273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.286563 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.286830 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.287126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.292312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.293824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.294026 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.295352 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.295580 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.295708 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.297113 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.297405 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.298394 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.298694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.299062 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.299346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.299658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.300028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.300323 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.300710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.300996 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.301300 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.311337 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.311645 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.312024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.312315 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.312606 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.312891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.312973 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.313167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.313248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.313601 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.313898 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.314194 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.314475 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.314752 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.329417 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.330963 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.332326 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.333922 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.335215 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.336908 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.337001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.338347 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.338557 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.338845 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.339124 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.339991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.340278 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.340564 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.345483 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.346897 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.346981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.348398 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.350174 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.350461 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.350744 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.351019 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.351480 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.351776 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.352059 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.352336 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.358810 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.359099 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.359377 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.360136 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.360426 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.360707 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.367745 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.368027 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.368307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.368583 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.368857 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.369013 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:59:29.369139 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.369299 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.369416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.369581 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.369701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.369860 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.369971 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.370135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.370229 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.370419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.370504 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.370695 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.370778 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.370983 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.371064 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.371255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.371383 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.371549 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.371830 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.372184 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.372452 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.372716 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:59:29.404631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f0ad7489c0 pid: 81600 (default app) Oct 24 12:59:29.406167 dv-cinder-862491-1-smb devstack@keystone.service[81601]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f0ad7489c0 pid: 81601 (default app) Oct 24 12:59:29.407918 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41615bb1-c571-4dec-a086-98f1dbd20b57 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:29.408201 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41615bb1-c571-4dec-a086-98f1dbd20b57 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:29.408469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41615bb1-c571-4dec-a086-98f1dbd20b57 None None] PATH_INFO: `/v3` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:29.413201 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Mon Oct 24 12:59:29 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:36.410218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50868c8e-0be7-41c2-8178-76c24998f101 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:36.410755 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50868c8e-0be7-41c2-8178-76c24998f101 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:36.410755 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50868c8e-0be7-41c2-8178-76c24998f101 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:36.415703 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 12:59:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 12:59:36.421227 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637399c9-82be-497a-bcba-31e27f710e8d None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:36.421799 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637399c9-82be-497a-bcba-31e27f710e8d None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:36.421799 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637399c9-82be-497a-bcba-31e27f710e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:36.493058 dv-cinder-862491-1-smb devstack@keystone.service[81600]: INFO dbcounter [None req-637399c9-82be-497a-bcba-31e27f710e8d None None] Registered counter for database keystone Oct 24 12:59:36.512190 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG oslo_db.sqlalchemy.engines [None req-637399c9-82be-497a-bcba-31e27f710e8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81600) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 12:59:36.518200 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writer thread running {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 12:59:36.696939 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG passlib.handlers.bcrypt [None req-637399c9-82be-497a-bcba-31e27f710e8d None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81600) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 24 12:59:36.697315 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG passlib.handlers.bcrypt [None req-637399c9-82be-497a-bcba-31e27f710e8d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81600) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 24 12:59:36.755543 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-637399c9-82be-497a-bcba-31e27f710e8d None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:36.757203 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-637399c9-82be-497a-bcba-31e27f710e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:36.883279 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 24 12:59:37.358592 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50868c8e-0be7-41c2-8178-76c24998f101 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:37.428556 dv-cinder-862491-1-smb devstack@keystone.service[81601]: INFO dbcounter [None req-50868c8e-0be7-41c2-8178-76c24998f101 None None] Registered counter for database keystone Oct 24 12:59:37.450355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG oslo_db.sqlalchemy.engines [None req-50868c8e-0be7-41c2-8178-76c24998f101 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81601) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 12:59:37.456588 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writer thread running {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 12:59:37.575506 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50868c8e-0be7-41c2-8178-76c24998f101 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:37.579813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0c0b6-d0ce-49fc-bc44-e708ae285082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:37.580433 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0c0b6-d0ce-49fc-bc44-e708ae285082 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:37.580713 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0c0b6-d0ce-49fc-bc44-e708ae285082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:37.580986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0c0b6-d0ce-49fc-bc44-e708ae285082 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:37.589330 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0c0b6-d0ce-49fc-bc44-e708ae285082 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:37.641380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a2f0c0b6-d0ce-49fc-bc44-e708ae285082 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 24 12:59:37.641668 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0c0b6-d0ce-49fc-bc44-e708ae285082 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:37.651051 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Oct 24 12:59:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 12:59:37.656982 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637399c9-82be-497a-bcba-31e27f710e8d None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:37.674185 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637399c9-82be-497a-bcba-31e27f710e8d None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:37.679156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d7166-7ddb-4aca-bfc9-30ce2e4e0549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:37.680276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d7166-7ddb-4aca-bfc9-30ce2e4e0549 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:37.680555 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d7166-7ddb-4aca-bfc9-30ce2e4e0549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:37.680824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d7166-7ddb-4aca-bfc9-30ce2e4e0549 admin admin] PATH_INFO: `/v3/projects/7194e8c8c8e64421a9a7846d67cb33c7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:37.684573 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d7166-7ddb-4aca-bfc9-30ce2e4e0549 admin admin] RBAC: Authorizing `identity:get_project(project_id=7194e8c8c8e64421a9a7846d67cb33c7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:37.736735 dv-cinder-862491-1-smb devstack@keystone.service[81600]: WARNING keystone.common.rbac_enforcer.enforcer [None req-973d7166-7ddb-4aca-bfc9-30ce2e4e0549 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 24 12:59:37.737073 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d7166-7ddb-4aca-bfc9-30ce2e4e0549 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:37.742188 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Oct 24 12:59:37 2022] GET /identity/v3/projects/7194e8c8c8e64421a9a7846d67cb33c7 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:39.866834 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723c020-e021-4961-aae3-61adfd3c9e77 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:39.867319 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723c020-e021-4961-aae3-61adfd3c9e77 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:39.867319 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723c020-e021-4961-aae3-61adfd3c9e77 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:39.871324 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 12:59:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:39.876659 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c3fcc-9aa5-4d45-944e-c6483f05962e None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:39.877054 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c3fcc-9aa5-4d45-944e-c6483f05962e None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:39.877206 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c3fcc-9aa5-4d45-944e-c6483f05962e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:39.897907 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-839c3fcc-9aa5-4d45-944e-c6483f05962e None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:39.899395 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-839c3fcc-9aa5-4d45-944e-c6483f05962e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:39.907021 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 12:59:40.176654 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723c020-e021-4961-aae3-61adfd3c9e77 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:40.188578 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723c020-e021-4961-aae3-61adfd3c9e77 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:40.192730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442df25-b7b5-4ee2-a150-d9951157706e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:40.193319 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442df25-b7b5-4ee2-a150-d9951157706e admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:40.194201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442df25-b7b5-4ee2-a150-d9951157706e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:40.194734 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442df25-b7b5-4ee2-a150-d9951157706e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:40.202361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442df25-b7b5-4ee2-a150-d9951157706e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:40.204178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442df25-b7b5-4ee2-a150-d9951157706e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:40.213453 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Oct 24 12:59:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 12:59:40.218681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c3fcc-9aa5-4d45-944e-c6483f05962e None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:40.227545 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c3fcc-9aa5-4d45-944e-c6483f05962e None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:40.231776 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74badc-2858-4178-8272-50ccfc641aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:40.232389 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74badc-2858-4178-8272-50ccfc641aeb admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:40.232663 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74badc-2858-4178-8272-50ccfc641aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:40.232928 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74badc-2858-4178-8272-50ccfc641aeb admin admin] PATH_INFO: `/v3/users/ee790ff9ce0f4b8a9ca3c54f019a2783` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:40.234203 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74badc-2858-4178-8272-50ccfc641aeb admin admin] RBAC: Authorizing `identity:get_user(user_id=ee790ff9ce0f4b8a9ca3c54f019a2783)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:40.236054 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74badc-2858-4178-8272-50ccfc641aeb admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:40.237542 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Oct 24 12:59:40 2022] GET /identity/v3/users/ee790ff9ce0f4b8a9ca3c54f019a2783 => generated 247 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:42.447984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b421281-7b68-432e-9bcc-8e3eb536e352 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:42.448503 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b421281-7b68-432e-9bcc-8e3eb536e352 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:42.448615 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b421281-7b68-432e-9bcc-8e3eb536e352 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:42.449866 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 12:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:42.455071 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2339c-44ac-4f24-9dd6-c061b0a71cc2 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:42.455516 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2339c-44ac-4f24-9dd6-c061b0a71cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:42.455660 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2339c-44ac-4f24-9dd6-c061b0a71cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:42.476852 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-40d2339c-44ac-4f24-9dd6-c061b0a71cc2 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:42.478034 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-40d2339c-44ac-4f24-9dd6-c061b0a71cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:42.502462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b51dd-6e76-4a6b-9a8d-7854ee72b011 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:42.502743 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b51dd-6e76-4a6b-9a8d-7854ee72b011 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:42.503016 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b51dd-6e76-4a6b-9a8d-7854ee72b011 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:42.504351 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 12:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 12:59:42.509446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74b7f1-718e-441f-b57f-4df5e3cb9960 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:42.509728 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74b7f1-718e-441f-b57f-4df5e3cb9960 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:42.510003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74b7f1-718e-441f-b57f-4df5e3cb9960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:42.552888 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG passlib.handlers.bcrypt [None req-4f74b7f1-718e-441f-b57f-4df5e3cb9960 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81601) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 24 12:59:42.553990 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG passlib.handlers.bcrypt [None req-4f74b7f1-718e-441f-b57f-4df5e3cb9960 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81601) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 24 12:59:42.564205 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 12:59:42.603327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-4f74b7f1-718e-441f-b57f-4df5e3cb9960 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:42.604918 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4f74b7f1-718e-441f-b57f-4df5e3cb9960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:42.703593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 12:59:42.836596 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2339c-44ac-4f24-9dd6-c061b0a71cc2 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:42.859904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:42.941371 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2339c-44ac-4f24-9dd6-c061b0a71cc2 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:42.974111 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35f0df-9da4-43ad-b050-de59a3a9fd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:42.974687 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35f0df-9da4-43ad-b050-de59a3a9fd3b None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:42.975593 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35f0df-9da4-43ad-b050-de59a3a9fd3b None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:42.975874 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35f0df-9da4-43ad-b050-de59a3a9fd3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:42.987120 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74b7f1-718e-441f-b57f-4df5e3cb9960 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:42.987281 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35f0df-9da4-43ad-b050-de59a3a9fd3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:42.996937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-7d35f0df-9da4-43ad-b050-de59a3a9fd3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 12:59:42.996937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:42.996937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:42.996937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:42.996937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:42.996937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:42.996937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:42.996937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:42.996937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:42.996937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:42.996937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:42.996937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:42.996937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:42.996937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:42.996937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:42.996937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:42.998058 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:42.998058 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:42.998058 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:42.998058 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:42.998058 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:42.998058 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:42.998058 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:42.998058 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:42.998058 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:42.998058 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:42.998058 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:42.998058 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:42.998058 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:42.998058 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:42.998058 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:42.998058 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:42.998930 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:42.998930 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:42.998930 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:42.998930 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:42.998930 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:42.998930 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:42.998930 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:42.998930 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:42.998930 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:42.998930 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:42.998930 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 12:59:42.998930 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 12:59:42.998930 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 24 12:59:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:43.003668 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35f0df-9da4-43ad-b050-de59a3a9fd3b None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:43.086048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:43.090455 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74b7f1-718e-441f-b57f-4df5e3cb9960 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:43.092770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:43.105787 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35f0df-9da4-43ad-b050-de59a3a9fd3b None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:43.129734 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ecb67-51d6-4fe1-8f66-eeefbb3e49ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:43.130616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ecb67-51d6-4fe1-8f66-eeefbb3e49ea None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:43.130898 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ecb67-51d6-4fe1-8f66-eeefbb3e49ea None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:43.131187 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ecb67-51d6-4fe1-8f66-eeefbb3e49ea None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:43.132173 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ecb67-51d6-4fe1-8f66-eeefbb3e49ea None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:43.133605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ecb67-51d6-4fe1-8f66-eeefbb3e49ea None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:43.141604 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d034d3-7e55-41dc-a0b6-203fbee9ef14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:43.142289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d034d3-7e55-41dc-a0b6-203fbee9ef14 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:43.142495 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d034d3-7e55-41dc-a0b6-203fbee9ef14 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:43.142818 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d034d3-7e55-41dc-a0b6-203fbee9ef14 None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:43.143642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d034d3-7e55-41dc-a0b6-203fbee9ef14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:43.144008 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d034d3-7e55-41dc-a0b6-203fbee9ef14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:43.145538 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d034d3-7e55-41dc-a0b6-203fbee9ef14 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:43.145753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.sql.core [None req-1d5ecb67-51d6-4fe1-8f66-eeefbb3e49ea None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 12:59:43.145753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 12:59:43.145753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [parameters: {'id': '90866fba0f5d439186cfee8598a56071', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 24 12:59:43.145753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81601) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 12:59:43.161047 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:43.164886 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-1d5ecb67-51d6-4fe1-8f66-eeefbb3e49ea None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 24 12:59:43.164886 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:43.164886 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 12:59:43.164886 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 12:59:43.164886 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 12:59:43.164886 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 12:59:43.164886 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 12:59:43.164886 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 12:59:43.164886 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 12:59:43.164886 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application conn.query(q) Oct 24 12:59:43.164886 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 12:59:43.164886 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 12:59:43.164886 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 12:59:43.164886 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application result.read() Oct 24 12:59:43.165807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 12:59:43.165807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 12:59:43.165807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 12:59:43.165807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 12:59:43.165807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 12:59:43.165807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 12:59:43.165807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 12:59:43.165807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 12:59:43.165807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 12:59:43.165807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 12:59:43.165807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 12:59:43.165807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 12:59:43.165807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:43.165807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 12:59:43.165807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 12:59:43.165807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 24 12:59:43.165807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 24 12:59:43.165807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 12:59:43.168178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application next(self.gen) Oct 24 12:59:43.168178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 12:59:43.168178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application yield resource Oct 24 12:59:43.168178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 12:59:43.168178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application next(self.gen) Oct 24 12:59:43.168178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 12:59:43.168178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 12:59:43.168178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 12:59:43.168178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 12:59:43.168178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 12:59:43.168178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise self.value Oct 24 12:59:43.168178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 12:59:43.168178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 12:59:43.168178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 12:59:43.168178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application session.commit() Oct 24 12:59:43.168178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 12:59:43.168178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 12:59:43.169006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 12:59:43.169006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 12:59:43.169006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 12:59:43.169006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self.session.flush() Oct 24 12:59:43.169006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 12:59:43.169006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 12:59:43.169006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 12:59:43.169006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 12:59:43.169006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 12:59:43.169006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application compat.raise_( Oct 24 12:59:43.169006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 12:59:43.169006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception Oct 24 12:59:43.169006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 12:59:43.169006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 12:59:43.169006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 12:59:43.169006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 12:59:43.169006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 12:59:43.169882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 12:59:43.169882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 12:59:43.169882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 12:59:43.169882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 24 12:59:43.169882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 24 12:59:43.169882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 12:59:43.169882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 12:59:43.169882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 12:59:43.169882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 12:59:43.169882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 12:59:43.169882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 12:59:43.169882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 12:59:43.169882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 12:59:43.169882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 12:59:43.169882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 12:59:43.170840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 12:59:43.170840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception Oct 24 12:59:43.170840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 12:59:43.170840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 12:59:43.170840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 12:59:43.170840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 12:59:43.170840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 12:59:43.170840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 12:59:43.170840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 12:59:43.170840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application conn.query(q) Oct 24 12:59:43.170840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 12:59:43.170840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 12:59:43.170840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 12:59:43.170840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application result.read() Oct 24 12:59:43.170840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 12:59:43.170840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 12:59:43.170840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 12:59:43.171710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 12:59:43.171710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 12:59:43.171710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 12:59:43.171710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 12:59:43.171710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 12:59:43.171710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 12:59:43.171710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 12:59:43.171710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [parameters: {'id': '90866fba0f5d439186cfee8598a56071', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 24 12:59:43.171710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 12:59:43.171710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 12:59:43.171710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 12:59:43.171710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 12:59:43.171710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:43.171710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 24 12:59:43.171710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 24 12:59:43.172443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 12:59:43.172443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 12:59:43.172443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 24 12:59:43.172443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 12:59:43.172443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 12:59:43.172443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 12:59:43.172443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:43.172443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:43.172443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:43.172443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:43.172443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:43.172443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:43.172443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:43.172443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:43.172443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:43.172443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:43.172443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:43.173308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 24 12:59:43.173308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 24 12:59:43.173308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:43.173308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:43.173308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 24 12:59:43.173308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 24 12:59:43.173308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:43.173308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:43.173308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 24 12:59:43.173308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 24 12:59:43.173308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 24 12:59:43.173308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 12:59:43.173308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 8/16] 10.222.0.18 () {60 vars in 1137 bytes} [Mon Oct 24 12:59:42 2022] POST /identity/v3/domains => generated 190 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 24 12:59:43.173940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d034d3-7e55-41dc-a0b6-203fbee9ef14 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:43.174014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ecb67-51d6-4fe1-8f66-eeefbb3e49ea None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:43.267926 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d034d3-7e55-41dc-a0b6-203fbee9ef14 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:43.274217 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ecb67-51d6-4fe1-8f66-eeefbb3e49ea None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:43.301916 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084c68d-a0c7-42f4-8b34-c5b73ffe8c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:43.302582 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084c68d-a0c7-42f4-8b34-c5b73ffe8c07 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:43.302829 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084c68d-a0c7-42f4-8b34-c5b73ffe8c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:43.303723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084c68d-a0c7-42f4-8b34-c5b73ffe8c07 None admin] PATH_INFO: `/v3/users/ee790ff9ce0f4b8a9ca3c54f019a2783` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:43.304974 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084c68d-a0c7-42f4-8b34-c5b73ffe8c07 None admin] RBAC: Authorizing `identity:get_user(user_id=ee790ff9ce0f4b8a9ca3c54f019a2783)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:43.306447 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084c68d-a0c7-42f4-8b34-c5b73ffe8c07 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:43.308048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:43 2022] GET /identity/v3/users/ee790ff9ce0f4b8a9ca3c54f019a2783 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:43.308240 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d59ce0-9c93-42d0-89e0-0fed73a83c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:43.309048 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d59ce0-9c93-42d0-89e0-0fed73a83c76 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:43.309308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d59ce0-9c93-42d0-89e0-0fed73a83c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:43.309580 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d59ce0-9c93-42d0-89e0-0fed73a83c76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:43.313441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084c68d-a0c7-42f4-8b34-c5b73ffe8c07 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:43.328690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:43.328834 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d59ce0-9c93-42d0-89e0-0fed73a83c76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:43.330198 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d59ce0-9c93-42d0-89e0-0fed73a83c76 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:43.346416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-f5d59ce0-9c93-42d0-89e0-0fed73a83c76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 12:59:43.346416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:43.346416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:43.346416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:43.346416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:43.346416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:43.346416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:43.346416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:43.346416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:43.346416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:43.346416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:43.346416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:43.346416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 12:59:43.346416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 12:59:43.346416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 12:59:43.346416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 12:59:43.347300 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:43.347300 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:43.347300 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:43.347300 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:43.347300 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:43.347300 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:43.347300 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:43.347300 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:43.347300 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:43.347300 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:43.347300 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:43.347300 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:43.347300 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:43.347300 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:43.347300 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:43.347300 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:43.347300 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 12:59:43.348275 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 12:59:43.348275 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 12:59:43.348275 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 12:59:43.348275 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:43.353638 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d59ce0-9c93-42d0-89e0-0fed73a83c76 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:43.378715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:43.417804 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084c68d-a0c7-42f4-8b34-c5b73ffe8c07 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:43.452035 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338292f9-9c39-4495-bb0d-203ca7c7690d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:43.452665 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338292f9-9c39-4495-bb0d-203ca7c7690d None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:43.452950 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338292f9-9c39-4495-bb0d-203ca7c7690d None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:43.453226 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338292f9-9c39-4495-bb0d-203ca7c7690d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:43.454346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338292f9-9c39-4495-bb0d-203ca7c7690d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:43.455826 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338292f9-9c39-4495-bb0d-203ca7c7690d None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:43.456863 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d59ce0-9c93-42d0-89e0-0fed73a83c76 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:43.457367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:43.463200 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338292f9-9c39-4495-bb0d-203ca7c7690d None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:43.495574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bec058-5b99-472b-91a8-0cf0b1974d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:43.496179 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bec058-5b99-472b-91a8-0cf0b1974d4e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:43.496473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bec058-5b99-472b-91a8-0cf0b1974d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:43.496739 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bec058-5b99-472b-91a8-0cf0b1974d4e None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:43.497379 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bec058-5b99-472b-91a8-0cf0b1974d4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:43.497675 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bec058-5b99-472b-91a8-0cf0b1974d4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:43.499059 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bec058-5b99-472b-91a8-0cf0b1974d4e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:43.516510 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 10/20] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 12:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:43.545000 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:43.566591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338292f9-9c39-4495-bb0d-203ca7c7690d None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:43.603865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a4048-48c7-4d8d-a45d-59199fbe13aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:43.604539 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a4048-48c7-4d8d-a45d-59199fbe13aa None admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:43.604815 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a4048-48c7-4d8d-a45d-59199fbe13aa None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:43.605088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a4048-48c7-4d8d-a45d-59199fbe13aa None admin] PATH_INFO: `/v3/domains/default/users/ee790ff9ce0f4b8a9ca3c54f019a2783/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:43.607106 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a4048-48c7-4d8d-a45d-59199fbe13aa None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ee790ff9ce0f4b8a9ca3c54f019a2783, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:43.608621 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a4048-48c7-4d8d-a45d-59199fbe13aa None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:43.726445 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 11/21] 10.222.0.18 () {58 vars in 1361 bytes} [Mon Oct 24 12:59:43 2022] PUT /identity/v3/domains/default/users/ee790ff9ce0f4b8a9ca3c54f019a2783/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 12:59:46.013089 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882b225-98e7-4f7e-a599-0326aff77d6b None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:46.014124 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882b225-98e7-4f7e-a599-0326aff77d6b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:46.014622 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882b225-98e7-4f7e-a599-0326aff77d6b None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:46.016374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 11/22] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 12:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:46.023863 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09133c2a-8bab-4818-b214-1639b766472f None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:46.024820 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09133c2a-8bab-4818-b214-1639b766472f None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:46.025340 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09133c2a-8bab-4818-b214-1639b766472f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:46.052527 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-09133c2a-8bab-4818-b214-1639b766472f None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:46.054976 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-09133c2a-8bab-4818-b214-1639b766472f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:46.145898 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 12/23] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:46.170225 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a011832-eb5a-4745-ac4c-62433f226b40 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:46.170830 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a011832-eb5a-4745-ac4c-62433f226b40 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:46.171298 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a011832-eb5a-4745-ac4c-62433f226b40 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:46.172858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 12:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:46.178578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4967af-6cb5-4c27-a25a-f1bff12e5286 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:46.179183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4967af-6cb5-4c27-a25a-f1bff12e5286 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:46.179691 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4967af-6cb5-4c27-a25a-f1bff12e5286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:46.208106 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-7d4967af-6cb5-4c27-a25a-f1bff12e5286 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:46.210179 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-7d4967af-6cb5-4c27-a25a-f1bff12e5286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:46.283889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:46.289193 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 13/25] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:46.531020 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a011832-eb5a-4745-ac4c-62433f226b40 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:46.661476 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:46.673407 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac5351-e6b0-489a-90be-a5645a54e70d None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:46.673709 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac5351-e6b0-489a-90be-a5645a54e70d None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:46.673957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac5351-e6b0-489a-90be-a5645a54e70d None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:46.678293 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 14/26] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 12:59:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 12:59:46.683540 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e83ff-a51b-48b9-9347-83e298f35d9e None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:46.683829 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e83ff-a51b-48b9-9347-83e298f35d9e None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:46.684104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e83ff-a51b-48b9-9347-83e298f35d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:46.715061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a011832-eb5a-4745-ac4c-62433f226b40 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:46.729771 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-3b7e83ff-a51b-48b9-9347-83e298f35d9e None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:46.730995 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-3b7e83ff-a51b-48b9-9347-83e298f35d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:46.785562 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed8bdd-bdfb-4284-b23b-df6c278f7c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:46.786179 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed8bdd-bdfb-4284-b23b-df6c278f7c23 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:46.786456 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed8bdd-bdfb-4284-b23b-df6c278f7c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:46.786727 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed8bdd-bdfb-4284-b23b-df6c278f7c23 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:46.787468 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed8bdd-bdfb-4284-b23b-df6c278f7c23 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:46.789071 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed8bdd-bdfb-4284-b23b-df6c278f7c23 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:46.874185 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 15/27] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 12:59:46.874992 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e83ff-a51b-48b9-9347-83e298f35d9e None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:46.931635 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 13/28] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Oct 24 12:59:46 2022] POST /identity/v3/roles => generated 219 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 12:59:46.943100 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f614044-b9f4-4bfd-8c93-d4ba01b505c1 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:46.943441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f614044-b9f4-4bfd-8c93-d4ba01b505c1 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:46.944248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f614044-b9f4-4bfd-8c93-d4ba01b505c1 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:46.946205 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 14/29] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 12:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 12:59:46.960164 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87d8aa-e994-43ec-96ba-ed71def655eb None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:46.960613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87d8aa-e994-43ec-96ba-ed71def655eb None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:46.960938 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87d8aa-e994-43ec-96ba-ed71def655eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:46.992625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-5e87d8aa-e994-43ec-96ba-ed71def655eb None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:46.994253 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5e87d8aa-e994-43ec-96ba-ed71def655eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:47.101675 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 15/30] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:47.103702 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e83ff-a51b-48b9-9347-83e298f35d9e None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:47.144303 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:47.151173 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f7cb3-6b0d-4bd0-a614-ada104643362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:47.152334 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f7cb3-6b0d-4bd0-a614-ada104643362 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:47.152997 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f7cb3-6b0d-4bd0-a614-ada104643362 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:47.153272 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f7cb3-6b0d-4bd0-a614-ada104643362 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:47.168068 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f7cb3-6b0d-4bd0-a614-ada104643362 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:47.173105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-523f7cb3-6b0d-4bd0-a614-ada104643362 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 12:59:47.173105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:47.173105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:47.173105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:47.173105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:47.173105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:47.173105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:47.173105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:47.173105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:47.173105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:47.173105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:47.173105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:47.173105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:47.173105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:47.173105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:47.173105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:47.173952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:47.173952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:47.173952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:47.173952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:47.173952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:47.173952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:47.173952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:47.173952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:47.173952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:47.173952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:47.173952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:47.173952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:47.173952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:47.173952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:47.173952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:47.173952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:47.175397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:47.175397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:47.175397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:47.175397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:47.175397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:47.175397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:47.175397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:47.175397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:47.175397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:47.175397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:47.175397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 12:59:47.175397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 12:59:47.175397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 16/31] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 24 12:59:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:47.180898 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87d8aa-e994-43ec-96ba-ed71def655eb None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:47.268488 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:47.302088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87d8aa-e994-43ec-96ba-ed71def655eb None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:47.340874 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2142f0a-df9d-47b7-9b7b-9c8a086b432b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:47.341499 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2142f0a-df9d-47b7-9b7b-9c8a086b432b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:47.341780 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2142f0a-df9d-47b7-9b7b-9c8a086b432b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:47.342060 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2142f0a-df9d-47b7-9b7b-9c8a086b432b None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:47.342730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2142f0a-df9d-47b7-9b7b-9c8a086b432b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:47.343033 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2142f0a-df9d-47b7-9b7b-9c8a086b432b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:47.344568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2142f0a-df9d-47b7-9b7b-9c8a086b432b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:47.357440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 16/32] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:47.363764 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f7cb3-6b0d-4bd0-a614-ada104643362 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:47.433646 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2142f0a-df9d-47b7-9b7b-9c8a086b432b None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:47.499243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f7cb3-6b0d-4bd0-a614-ada104643362 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:47.557726 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2fea9-e1f2-49f3-940c-c769169bcb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:47.558379 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2fea9-e1f2-49f3-940c-c769169bcb23 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:47.558660 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2fea9-e1f2-49f3-940c-c769169bcb23 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:47.558932 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2fea9-e1f2-49f3-940c-c769169bcb23 None admin] PATH_INFO: `/v3/users/ee790ff9ce0f4b8a9ca3c54f019a2783` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:47.562919 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2fea9-e1f2-49f3-940c-c769169bcb23 None admin] RBAC: Authorizing `identity:get_user(user_id=ee790ff9ce0f4b8a9ca3c54f019a2783)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:47.564557 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2fea9-e1f2-49f3-940c-c769169bcb23 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:47.566164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 17/33] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:47 2022] GET /identity/v3/users/ee790ff9ce0f4b8a9ca3c54f019a2783 => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:47.572360 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2fea9-e1f2-49f3-940c-c769169bcb23 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:47.641249 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2142f0a-df9d-47b7-9b7b-9c8a086b432b None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:47.646728 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:47.677008 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:47.688794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f739149-483c-43f6-bf50-467c4de8d679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:47.689369 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f739149-483c-43f6-bf50-467c4de8d679 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:47.689648 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f739149-483c-43f6-bf50-467c4de8d679 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:47.689919 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f739149-483c-43f6-bf50-467c4de8d679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:47.705186 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f739149-483c-43f6-bf50-467c4de8d679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:47.707047 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f739149-483c-43f6-bf50-467c4de8d679 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:47.712449 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2fea9-e1f2-49f3-940c-c769169bcb23 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:47.725575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-6f739149-483c-43f6-bf50-467c4de8d679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 12:59:47.725575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:47.725575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:47.725575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:47.725575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:47.725575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:47.725575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:47.725575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:47.725575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:47.725575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:47.725575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:47.725575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:47.725575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 12:59:47.725575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 12:59:47.725575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 12:59:47.725575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 12:59:47.726492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:47.726492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:47.726492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:47.726492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:47.726492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:47.726492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:47.726492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:47.726492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:47.726492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:47.726492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:47.726492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:47.726492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:47.726492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:47.726492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:47.726492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:47.726492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:47.726492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 12:59:47.727295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 12:59:47.727295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 12:59:47.727295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 12:59:47.729167 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 17/34] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 12:59:47.730141 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f739149-483c-43f6-bf50-467c4de8d679 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:47.755000 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc3960-95e5-49e8-8fc4-b829278b9454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:47.755653 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc3960-95e5-49e8-8fc4-b829278b9454 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:47.756129 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc3960-95e5-49e8-8fc4-b829278b9454 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:47.757334 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc3960-95e5-49e8-8fc4-b829278b9454 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:47.758843 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc3960-95e5-49e8-8fc4-b829278b9454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:47.760521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc3960-95e5-49e8-8fc4-b829278b9454 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:47.762455 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 18/35] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:47.763380 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc3960-95e5-49e8-8fc4-b829278b9454 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:47.842200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f739149-483c-43f6-bf50-467c4de8d679 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:47.874446 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc3960-95e5-49e8-8fc4-b829278b9454 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:47.879562 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740d79b-3619-4985-ba75-17568f8a5a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:47.880186 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740d79b-3619-4985-ba75-17568f8a5a71 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:47.880489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740d79b-3619-4985-ba75-17568f8a5a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:47.880748 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740d79b-3619-4985-ba75-17568f8a5a71 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:47.881449 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740d79b-3619-4985-ba75-17568f8a5a71 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:47.883411 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740d79b-3619-4985-ba75-17568f8a5a71 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:47.900204 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 18/36] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Oct 24 12:59:47 2022] POST /identity/v3/roles => generated 225 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 12:59:47.903012 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:47.905594 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740d79b-3619-4985-ba75-17568f8a5a71 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:47.914172 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bde55-5205-403a-a34a-c78cb76117cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:47.915438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bde55-5205-403a-a34a-c78cb76117cf None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:47.916101 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bde55-5205-403a-a34a-c78cb76117cf None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:47.916595 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bde55-5205-403a-a34a-c78cb76117cf None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:47.917667 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725bde55-5205-403a-a34a-c78cb76117cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:47.918136 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725bde55-5205-403a-a34a-c78cb76117cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:47.919840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725bde55-5205-403a-a34a-c78cb76117cf None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:47.941000 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 19/37] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 12:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:47.942500 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e7fc5-7367-487e-a64f-7bbc176bd700 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:47.942883 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e7fc5-7367-487e-a64f-7bbc176bd700 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:47.943286 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e7fc5-7367-487e-a64f-7bbc176bd700 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:47.945773 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 20/38] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 12:59:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:47.946871 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14546d42-1eea-4538-bcc7-9f23d2b99ec5 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:47.947231 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14546d42-1eea-4538-bcc7-9f23d2b99ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:47.947530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14546d42-1eea-4538-bcc7-9f23d2b99ec5 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:47.948947 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 21/39] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 12:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:47.949507 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14546d42-1eea-4538-bcc7-9f23d2b99ec5 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:47.971495 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:48.036829 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740d79b-3619-4985-ba75-17568f8a5a71 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:48.078775 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc6238-0db8-4bcb-ad82-1805abe09fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:48.079451 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc6238-0db8-4bcb-ad82-1805abe09fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:48.079736 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc6238-0db8-4bcb-ad82-1805abe09fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:48.080009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc6238-0db8-4bcb-ad82-1805abe09fb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:48.080758 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc6238-0db8-4bcb-ad82-1805abe09fb4 None admin] RBAC: Adding query filter params (role.id=23ca6ecd60b2470cba913daeaf54f0f7, scope.domain.id=default, user.id=ee790ff9ce0f4b8a9ca3c54f019a2783) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:48.081066 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc6238-0db8-4bcb-ad82-1805abe09fb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:48.082590 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc6238-0db8-4bcb-ad82-1805abe09fb4 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:48.094439 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 19/40] 10.222.0.18 () {56 vars in 1322 bytes} [Mon Oct 24 12:59:47 2022] GET /identity/v3/role_assignments?user.id=ee790ff9ce0f4b8a9ca3c54f019a2783&scope.domain.id=default&role.id=23ca6ecd60b2470cba913daeaf54f0f7 => generated 530 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:48.096867 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2537b84-d1ea-4344-9ad4-b7f35a96f5fb None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:48.097163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2537b84-d1ea-4344-9ad4-b7f35a96f5fb None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:48.097440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2537b84-d1ea-4344-9ad4-b7f35a96f5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:48.120106 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b2537b84-d1ea-4344-9ad4-b7f35a96f5fb None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:48.121387 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b2537b84-d1ea-4344-9ad4-b7f35a96f5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:48.182873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14546d42-1eea-4538-bcc7-9f23d2b99ec5 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:48.208687 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 20/41] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:48.210462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482aebf-6d5d-480f-9f03-76a4a65aaa15 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:48.210746 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482aebf-6d5d-480f-9f03-76a4a65aaa15 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:48.211113 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482aebf-6d5d-480f-9f03-76a4a65aaa15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:48.228808 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ef155-768b-4190-b079-90a46cf6d832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:48.229841 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ef155-768b-4190-b079-90a46cf6d832 None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:48.230345 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ef155-768b-4190-b079-90a46cf6d832 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:48.230818 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ef155-768b-4190-b079-90a46cf6d832 None admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:48.231875 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ef155-768b-4190-b079-90a46cf6d832 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:48.232179 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d482aebf-6d5d-480f-9f03-76a4a65aaa15 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:48.233862 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ef155-768b-4190-b079-90a46cf6d832 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:48.233981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d482aebf-6d5d-480f-9f03-76a4a65aaa15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:48.275566 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:48.279074 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 24 12:59:47 2022] POST /identity/v3/projects => generated 301 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 12:59:48.335740 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 21/43] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:48.483348 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ef155-768b-4190-b079-90a46cf6d832 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:48.526513 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:48.588260 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ef155-768b-4190-b079-90a46cf6d832 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:48.615309 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482aebf-6d5d-480f-9f03-76a4a65aaa15 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:48.622285 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cce4c-4c29-49fb-ba66-de8e057e14eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:48.622895 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cce4c-4c29-49fb-ba66-de8e057e14eb None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:48.623173 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cce4c-4c29-49fb-ba66-de8e057e14eb None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:48.623467 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cce4c-4c29-49fb-ba66-de8e057e14eb None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:48.624164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cce4c-4c29-49fb-ba66-de8e057e14eb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:48.625527 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cce4c-4c29-49fb-ba66-de8e057e14eb None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:48.642364 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Oct 24 12:59:48 2022] POST /identity/v3/roles => generated 223 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 12:59:48.720168 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482aebf-6d5d-480f-9f03-76a4a65aaa15 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:48.755687 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8b0cb-ee14-4de9-9b66-c94d4ce0a4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:48.756948 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8b0cb-ee14-4de9-9b66-c94d4ce0a4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:48.757297 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8b0cb-ee14-4de9-9b66-c94d4ce0a4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:48.757604 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8b0cb-ee14-4de9-9b66-c94d4ce0a4c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:48.758875 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8b0cb-ee14-4de9-9b66-c94d4ce0a4c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:48.760381 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8b0cb-ee14-4de9-9b66-c94d4ce0a4c2 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:48.762012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 22/45] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:48.768038 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cce4c-4c29-49fb-ba66-de8e057e14eb None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:48.869123 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:48.873194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cce4c-4c29-49fb-ba66-de8e057e14eb None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:48.909534 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce25c7-06da-4b33-bac0-8774042ba8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:48.910134 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce25c7-06da-4b33-bac0-8774042ba8f7 None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:48.910407 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce25c7-06da-4b33-bac0-8774042ba8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:48.910673 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce25c7-06da-4b33-bac0-8774042ba8f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:48.911313 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce25c7-06da-4b33-bac0-8774042ba8f7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:48.913343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce25c7-06da-4b33-bac0-8774042ba8f7 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:48.938839 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 24 12:59:48 2022] POST /identity/v3/projects => generated 312 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 12:59:51.079618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76d3d7-6d35-4793-a920-08a6c6d8195d None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:51.080135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76d3d7-6d35-4793-a920-08a6c6d8195d None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:51.080135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76d3d7-6d35-4793-a920-08a6c6d8195d None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:51.081498 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 23/47] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 12:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:51.087252 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8bf09-96a4-4227-a328-7f7eb4819340 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:51.087683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8bf09-96a4-4227-a328-7f7eb4819340 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:51.087825 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8bf09-96a4-4227-a328-7f7eb4819340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:51.106112 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-16d8bf09-96a4-4227-a328-7f7eb4819340 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:51.107268 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-16d8bf09-96a4-4227-a328-7f7eb4819340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:51.172603 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 25/48] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:51.446831 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76d3d7-6d35-4793-a920-08a6c6d8195d None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:51.481989 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:51.546208 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76d3d7-6d35-4793-a920-08a6c6d8195d None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:51.580057 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44143da0-6aba-495a-a099-720a2f442483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:51.580679 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44143da0-6aba-495a-a099-720a2f442483 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:51.580959 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44143da0-6aba-495a-a099-720a2f442483 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:51.581233 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44143da0-6aba-495a-a099-720a2f442483 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:51.582307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44143da0-6aba-495a-a099-720a2f442483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:51.583790 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44143da0-6aba-495a-a099-720a2f442483 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:51.585332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 24/49] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:51.591072 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8bf09-96a4-4227-a328-7f7eb4819340 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:51.667287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:51.686802 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8bf09-96a4-4227-a328-7f7eb4819340 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:51.720834 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8deb100-a9f5-4231-bcab-24be7dd58b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:51.721365 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8deb100-a9f5-4231-bcab-24be7dd58b58 None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:51.721640 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8deb100-a9f5-4231-bcab-24be7dd58b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:51.721906 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8deb100-a9f5-4231-bcab-24be7dd58b58 None admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:51.722535 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8deb100-a9f5-4231-bcab-24be7dd58b58 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:51.724007 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8deb100-a9f5-4231-bcab-24be7dd58b58 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:51.749469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1140 bytes} [Mon Oct 24 12:59:51 2022] POST /identity/v3/projects => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 12:59:53.904636 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed68f1-29a5-41cb-bbb8-227eb8d4695b None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:53.905122 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed68f1-29a5-41cb-bbb8-227eb8d4695b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:53.905122 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed68f1-29a5-41cb-bbb8-227eb8d4695b None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:53.906422 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 25/51] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 12:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:53.911678 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dbfc2-cde5-4e4f-acef-4c42f16f3fc7 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:53.912084 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dbfc2-cde5-4e4f-acef-4c42f16f3fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:53.912226 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dbfc2-cde5-4e4f-acef-4c42f16f3fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:53.930620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-414dbfc2-cde5-4e4f-acef-4c42f16f3fc7 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:53.931852 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-414dbfc2-cde5-4e4f-acef-4c42f16f3fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:53.995918 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 27/52] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:54.265342 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed68f1-29a5-41cb-bbb8-227eb8d4695b None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:54.364287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed68f1-29a5-41cb-bbb8-227eb8d4695b None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:54.367394 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:54.397749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745d18a-3c8e-41cd-b6d7-4d565a8691a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:54.398439 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745d18a-3c8e-41cd-b6d7-4d565a8691a5 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:54.398749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745d18a-3c8e-41cd-b6d7-4d565a8691a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:54.399028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745d18a-3c8e-41cd-b6d7-4d565a8691a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:54.400158 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745d18a-3c8e-41cd-b6d7-4d565a8691a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:54.401608 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745d18a-3c8e-41cd-b6d7-4d565a8691a5 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:54.403135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:54.408577 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414dbfc2-cde5-4e4f-acef-4c42f16f3fc7 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:54.468678 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:54.508036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414dbfc2-cde5-4e4f-acef-4c42f16f3fc7 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:54.541932 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48883a1e-08f2-4485-8e69-ff27f700db92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:54.542846 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48883a1e-08f2-4485-8e69-ff27f700db92 None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:54.543186 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48883a1e-08f2-4485-8e69-ff27f700db92 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:54.543708 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48883a1e-08f2-4485-8e69-ff27f700db92 None admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:54.544864 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48883a1e-08f2-4485-8e69-ff27f700db92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:54.546853 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48883a1e-08f2-4485-8e69-ff27f700db92 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:54.574184 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 28/54] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 24 12:59:54 2022] POST /identity/v3/users => generated 275 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 12:59:57.845002 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ffe88-95bf-4f4f-8bd9-6aea37b96202 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:57.845974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ffe88-95bf-4f4f-8bd9-6aea37b96202 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:57.846483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ffe88-95bf-4f4f-8bd9-6aea37b96202 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:57.848462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 27/55] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 12:59:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:57.854916 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028c8ab-ac52-48e0-b823-712841d96971 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:57.855971 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028c8ab-ac52-48e0-b823-712841d96971 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:57.856460 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028c8ab-ac52-48e0-b823-712841d96971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:57.884636 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-0028c8ab-ac52-48e0-b823-712841d96971 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:57.885895 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-0028c8ab-ac52-48e0-b823-712841d96971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:57.977563 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 29/56] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:57.982797 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4f107-61b0-41a7-95a1-5ccf8299c3d8 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:57.983345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4f107-61b0-41a7-95a1-5ccf8299c3d8 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:57.983876 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4f107-61b0-41a7-95a1-5ccf8299c3d8 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:57.985380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 28/57] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 12:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:57.990492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c742180-7fd3-4828-b294-bdd092a28f45 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:57.990786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c742180-7fd3-4828-b294-bdd092a28f45 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:57.991300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c742180-7fd3-4828-b294-bdd092a28f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:58.010319 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-4c742180-7fd3-4828-b294-bdd092a28f45 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:58.011557 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-4c742180-7fd3-4828-b294-bdd092a28f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:58.081513 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:58.112185 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 30/58] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:58.164481 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e1479-212a-4808-bccf-848a7422264b None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:58.165122 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e1479-212a-4808-bccf-848a7422264b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:58.165595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e1479-212a-4808-bccf-848a7422264b None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:58.167388 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 29/59] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 12:59:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:58.172837 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012679a1-d54f-4f7b-894f-90aa1dffad32 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:58.173130 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012679a1-d54f-4f7b-894f-90aa1dffad32 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:58.173659 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012679a1-d54f-4f7b-894f-90aa1dffad32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:58.196705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-012679a1-d54f-4f7b-894f-90aa1dffad32 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:58.198224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-012679a1-d54f-4f7b-894f-90aa1dffad32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:58.294243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 31/60] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:58.348091 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e1479-212a-4808-bccf-848a7422264b None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:58.364969 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c855e-b2ae-48d5-8465-a9566b659aeb None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:58.365262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c855e-b2ae-48d5-8465-a9566b659aeb None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:58.365461 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c855e-b2ae-48d5-8465-a9566b659aeb None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:58.367649 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 32/61] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 12:59:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:58.376142 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e2d7b-5df4-422b-b493-9432a1fcee66 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:58.376660 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e2d7b-5df4-422b-b493-9432a1fcee66 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:58.377111 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e2d7b-5df4-422b-b493-9432a1fcee66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:58.397616 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-e55e2d7b-5df4-422b-b493-9432a1fcee66 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:58.399123 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-e55e2d7b-5df4-422b-b493-9432a1fcee66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:58.496344 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 33/62] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 12:59:58.497752 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e2d7b-5df4-422b-b493-9432a1fcee66 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:58.512210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e1479-212a-4808-bccf-848a7422264b None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:58.555955 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:58.562935 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f9bb5-5021-455e-8510-2c0e0adb3bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:58.563678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f9bb5-5021-455e-8510-2c0e0adb3bff None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:58.563889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f9bb5-5021-455e-8510-2c0e0adb3bff None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:58.564167 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f9bb5-5021-455e-8510-2c0e0adb3bff None admin] PATH_INFO: `/v3/roles/member` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:58.577573 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f9bb5-5021-455e-8510-2c0e0adb3bff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:58.583924 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-067f9bb5-5021-455e-8510-2c0e0adb3bff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:58.583924 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:58.583924 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:58.583924 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:58.583924 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:58.583924 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:58.583924 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:58.583924 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:58.583924 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:58.583924 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:58.583924 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:58.583924 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:58.583924 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:58.583924 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:58.583924 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:58.583924 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:58.584986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:58.584986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:58.584986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:58.584986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:58.584986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:58.584986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:58.584986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:58.584986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:58.584986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:58.584986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:58.584986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:58.584986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:58.584986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:58.584986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:58.584986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:58.584986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:58.585867 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:58.585867 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:58.585867 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:58.585867 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:58.585867 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:58.585867 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:58.585867 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:58.585867 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:58.585867 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:58.585867 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:58.585867 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:58.585867 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 12:59:58.585867 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 30/63] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:58.591082 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f9bb5-5021-455e-8510-2c0e0adb3bff None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:58.632471 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:58.654653 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e2d7b-5df4-422b-b493-9432a1fcee66 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:58.720337 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b8d57-90d0-49fa-a9af-761bc82cfce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:58.721000 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b8d57-90d0-49fa-a9af-761bc82cfce4 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:58.721280 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b8d57-90d0-49fa-a9af-761bc82cfce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:58.721556 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b8d57-90d0-49fa-a9af-761bc82cfce4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:58.735333 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b8d57-90d0-49fa-a9af-761bc82cfce4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:58.740614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-267b8d57-90d0-49fa-a9af-761bc82cfce4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 12:59:58.740614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:58.740614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:58.740614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:58.740614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:58.740614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:58.740614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:58.740614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:58.740614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:58.740614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:58.740614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:58.740614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:58.740614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:58.740614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:58.740614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:58.740614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:58.742312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:58.742312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:58.742312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:58.742312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:58.742312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:58.742312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:58.742312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:58.742312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:58.742312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:58.742312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:58.742312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:58.742312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:58.742312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:58.742312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:58.742312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:58.742312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:58.743865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:58.743865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:58.743865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:58.743865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:58.743865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:58.743865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:58.743865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:58.743865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:58.743865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:58.743865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:58.743865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 12:59:58.743865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 12:59:58.743865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 34/64] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 24 12:59:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:58.743865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b8d57-90d0-49fa-a9af-761bc82cfce4 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:58.848545 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f9bb5-5021-455e-8510-2c0e0adb3bff None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:58.859666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:58.863703 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b8d57-90d0-49fa-a9af-761bc82cfce4 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:58.884896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9834f-2f90-4cfe-bbf7-bcf9da85b39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:58.885440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9834f-2f90-4cfe-bbf7-bcf9da85b39b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:58.885724 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9834f-2f90-4cfe-bbf7-bcf9da85b39b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:58.885998 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9834f-2f90-4cfe-bbf7-bcf9da85b39b None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:58.886657 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9834f-2f90-4cfe-bbf7-bcf9da85b39b None admin] RBAC: Adding query filter params (name=member) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:58.886960 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9834f-2f90-4cfe-bbf7-bcf9da85b39b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:58.888387 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9834f-2f90-4cfe-bbf7-bcf9da85b39b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:58.896763 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 31/65] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 24 12:59:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:58.897763 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9834f-2f90-4cfe-bbf7-bcf9da85b39b None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:58.902910 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77c8a1-add1-4b05-a340-201aa1f45d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:58.903577 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77c8a1-add1-4b05-a340-201aa1f45d55 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:58.903863 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77c8a1-add1-4b05-a340-201aa1f45d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:58.904137 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77c8a1-add1-4b05-a340-201aa1f45d55 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:58.915114 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77c8a1-add1-4b05-a340-201aa1f45d55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:58.920043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-ae77c8a1-add1-4b05-a340-201aa1f45d55 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 12:59:58.920043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:58.920043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:58.920043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:58.920043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:58.920043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:58.920043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:58.920043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:58.920043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:58.920043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:58.920043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:58.920043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:58.920043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:58.920043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:58.920043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:58.920043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:58.920887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:58.920887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:58.920887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:58.920887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:58.920887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:58.920887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:58.920887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:58.920887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:58.920887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:58.920887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:58.920887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:58.920887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:58.920887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:58.920887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:58.920887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:58.920887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:58.924390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:58.924390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:58.924390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:58.924390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:58.924390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:58.924390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:58.924390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:58.924390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:58.924390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:58.924390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:58.924390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 12:59:58.924390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 12:59:58.924390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 35/66] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 24 12:59:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:58.924390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2c0c0-32dd-4afc-ac7e-15568e8d9406 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:58.925151 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2c0c0-32dd-4afc-ac7e-15568e8d9406 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:58.925151 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2c0c0-32dd-4afc-ac7e-15568e8d9406 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:58.925151 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 36/67] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 12:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:58.925804 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2c0c0-32dd-4afc-ac7e-15568e8d9406 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:58.994317 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:59.001207 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9834f-2f90-4cfe-bbf7-bcf9da85b39b None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:59.028816 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2c0c0-32dd-4afc-ac7e-15568e8d9406 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:59.035065 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f2b1a-1841-43ca-8328-62805ce34623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:59.035704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f2b1a-1841-43ca-8328-62805ce34623 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:59.035995 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f2b1a-1841-43ca-8328-62805ce34623 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:59.036272 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f2b1a-1841-43ca-8328-62805ce34623 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:59.036930 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f2b1a-1841-43ca-8328-62805ce34623 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:59.037236 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f2b1a-1841-43ca-8328-62805ce34623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:59.038827 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f2b1a-1841-43ca-8328-62805ce34623 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:59.046945 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 32/68] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:59.047542 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f2b1a-1841-43ca-8328-62805ce34623 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:59.066556 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35078e59-fe63-4e80-a66c-7226f9a87061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:59.067413 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35078e59-fe63-4e80-a66c-7226f9a87061 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:59.067753 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35078e59-fe63-4e80-a66c-7226f9a87061 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:59.068031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35078e59-fe63-4e80-a66c-7226f9a87061 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:59.079360 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35078e59-fe63-4e80-a66c-7226f9a87061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:59.084276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-35078e59-fe63-4e80-a66c-7226f9a87061 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:59.084276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:59.084276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:59.084276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:59.084276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:59.084276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:59.084276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:59.084276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:59.084276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:59.084276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:59.084276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:59.084276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:59.084276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:59.084276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:59.084276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:59.084276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:59.085546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:59.085546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:59.085546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:59.085546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:59.085546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:59.085546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:59.085546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:59.085546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:59.085546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:59.085546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:59.085546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:59.085546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:59.085546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:59.085546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:59.085546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:59.085546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:59.086300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:59.086300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:59.086300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:59.086300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:59.086300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:59.086300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:59.086300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:59.086300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:59.086300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:59.086300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:59.086300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:59.086300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 12:59:59.086300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 37/69] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:59.088303 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35078e59-fe63-4e80-a66c-7226f9a87061 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:59.106558 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:59.150561 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f2b1a-1841-43ca-8328-62805ce34623 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:59.183946 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31b3b9-60ec-4984-b314-f98fd4abc92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:59.184624 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31b3b9-60ec-4984-b314-f98fd4abc92c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:59.184906 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31b3b9-60ec-4984-b314-f98fd4abc92c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:59.185196 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31b3b9-60ec-4984-b314-f98fd4abc92c None admin] PATH_INFO: `/v3/users/085a4df4c8f84be3b428ea5d8d6cc167` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:59.187677 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35078e59-fe63-4e80-a66c-7226f9a87061 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:59.200714 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31b3b9-60ec-4984-b314-f98fd4abc92c None admin] RBAC: Authorizing `identity:get_user(user_id=085a4df4c8f84be3b428ea5d8d6cc167)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:59.202172 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31b3b9-60ec-4984-b314-f98fd4abc92c None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:59.203858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 33/70] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:59 2022] GET /identity/v3/users/085a4df4c8f84be3b428ea5d8d6cc167 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:59.208648 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520e003-7c06-43af-9f4e-5ef403d17457 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:59.208648 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520e003-7c06-43af-9f4e-5ef403d17457 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:59.208648 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520e003-7c06-43af-9f4e-5ef403d17457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:59.223870 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2decd-1b3e-4853-ba87-d0c607d1e19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:59.224476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2decd-1b3e-4853-ba87-d0c607d1e19e None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:59.224750 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2decd-1b3e-4853-ba87-d0c607d1e19e None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:59.225020 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2decd-1b3e-4853-ba87-d0c607d1e19e None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:59.225741 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2decd-1b3e-4853-ba87-d0c607d1e19e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:59.225868 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-1520e003-7c06-43af-9f4e-5ef403d17457 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:59.226043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2decd-1b3e-4853-ba87-d0c607d1e19e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:59.227069 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1520e003-7c06-43af-9f4e-5ef403d17457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:59.227536 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2decd-1b3e-4853-ba87-d0c607d1e19e None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:59.236070 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 38/71] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 12:59:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:59.236877 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2decd-1b3e-4853-ba87-d0c607d1e19e None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:59.237084 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:59.296751 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 34/72] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:59.297595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520e003-7c06-43af-9f4e-5ef403d17457 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:59.332514 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:59.354865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2decd-1b3e-4853-ba87-d0c607d1e19e None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:59.390975 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0d60a-897b-41af-8993-05a6d8e00924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:59.391637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0d60a-897b-41af-8993-05a6d8e00924 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:59.391918 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0d60a-897b-41af-8993-05a6d8e00924 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:59.392197 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0d60a-897b-41af-8993-05a6d8e00924 None admin] PATH_INFO: `/v3/users/ee790ff9ce0f4b8a9ca3c54f019a2783` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:59.393317 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0d60a-897b-41af-8993-05a6d8e00924 None admin] RBAC: Authorizing `identity:get_user(user_id=ee790ff9ce0f4b8a9ca3c54f019a2783)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:59.394801 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0d60a-897b-41af-8993-05a6d8e00924 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:59.401065 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 39/73] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:59 2022] GET /identity/v3/users/ee790ff9ce0f4b8a9ca3c54f019a2783 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:59.401065 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0d60a-897b-41af-8993-05a6d8e00924 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:59.409373 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520e003-7c06-43af-9f4e-5ef403d17457 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:59.447250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349692fc-4c28-45ea-8440-fa52dbdcfe90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:59.447974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349692fc-4c28-45ea-8440-fa52dbdcfe90 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:59.448253 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349692fc-4c28-45ea-8440-fa52dbdcfe90 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:59.448518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349692fc-4c28-45ea-8440-fa52dbdcfe90 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:59.449177 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349692fc-4c28-45ea-8440-fa52dbdcfe90 None admin] RBAC: Adding query filter params (name=member) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:59.449477 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349692fc-4c28-45ea-8440-fa52dbdcfe90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:59.450862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349692fc-4c28-45ea-8440-fa52dbdcfe90 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:59.459195 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 35/74] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 24 12:59:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:59.460181 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349692fc-4c28-45ea-8440-fa52dbdcfe90 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:59.470050 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:59.511877 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0d60a-897b-41af-8993-05a6d8e00924 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:59.547242 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f973a2-ff63-4dca-9056-aa1281479926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:59.550316 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f973a2-ff63-4dca-9056-aa1281479926 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:59.550316 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f973a2-ff63-4dca-9056-aa1281479926 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:59.550316 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f973a2-ff63-4dca-9056-aa1281479926 None admin] PATH_INFO: `/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:59.551357 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f973a2-ff63-4dca-9056-aa1281479926 None admin] RBAC: Authorizing `identity:get_project(project_id=1f8d2f2bddb7409bb80d51b644ee1f01)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:59.552858 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f973a2-ff63-4dca-9056-aa1281479926 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:59.559928 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 40/75] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:59 2022] GET /identity/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:59.559928 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f973a2-ff63-4dca-9056-aa1281479926 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:59.575176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349692fc-4c28-45ea-8440-fa52dbdcfe90 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:59.578970 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:59.609109 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214999d-eb32-4e58-8fb1-10ec0b5c512e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:59.609744 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214999d-eb32-4e58-8fb1-10ec0b5c512e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:59.610023 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214999d-eb32-4e58-8fb1-10ec0b5c512e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:59.610305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214999d-eb32-4e58-8fb1-10ec0b5c512e None admin] PATH_INFO: `/v3/users/085a4df4c8f84be3b428ea5d8d6cc167` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:59.611455 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214999d-eb32-4e58-8fb1-10ec0b5c512e None admin] RBAC: Authorizing `identity:get_user(user_id=085a4df4c8f84be3b428ea5d8d6cc167)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:59.612904 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214999d-eb32-4e58-8fb1-10ec0b5c512e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:59.614472 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 36/76] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:59 2022] GET /identity/v3/users/085a4df4c8f84be3b428ea5d8d6cc167 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:59.615227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214999d-eb32-4e58-8fb1-10ec0b5c512e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:59.661187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f973a2-ff63-4dca-9056-aa1281479926 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:59.689950 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:59.695952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15019d-bb6d-4abe-8dd9-63f1888662fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:59.696582 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15019d-bb6d-4abe-8dd9-63f1888662fa None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:59.696867 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15019d-bb6d-4abe-8dd9-63f1888662fa None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:59.697145 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15019d-bb6d-4abe-8dd9-63f1888662fa None admin] PATH_INFO: `/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:59.698252 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15019d-bb6d-4abe-8dd9-63f1888662fa None admin] RBAC: Authorizing `identity:get_project(project_id=1f8d2f2bddb7409bb80d51b644ee1f01)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:59.699740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15019d-bb6d-4abe-8dd9-63f1888662fa None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:59.701373 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 41/77] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:59 2022] GET /identity/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:59.706726 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15019d-bb6d-4abe-8dd9-63f1888662fa None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:59.715128 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214999d-eb32-4e58-8fb1-10ec0b5c512e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:59.749124 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac206c-ce56-429e-a098-07cbafeb3291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:59.749754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac206c-ce56-429e-a098-07cbafeb3291 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:59.750037 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac206c-ce56-429e-a098-07cbafeb3291 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:59.750313 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac206c-ce56-429e-a098-07cbafeb3291 None admin] PATH_INFO: `/v3/users/085a4df4c8f84be3b428ea5d8d6cc167` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:59.751513 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac206c-ce56-429e-a098-07cbafeb3291 None admin] RBAC: Authorizing `identity:get_user(user_id=085a4df4c8f84be3b428ea5d8d6cc167)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:59.752954 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac206c-ce56-429e-a098-07cbafeb3291 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:59.754566 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 37/78] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:59 2022] GET /identity/v3/users/085a4df4c8f84be3b428ea5d8d6cc167 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:59.755317 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac206c-ce56-429e-a098-07cbafeb3291 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:59.790538 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:59.806279 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15019d-bb6d-4abe-8dd9-63f1888662fa None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:59.839996 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6928b6-e2cf-455e-be2a-5daec81c02bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:59.840652 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6928b6-e2cf-455e-be2a-5daec81c02bb None admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:59.840939 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6928b6-e2cf-455e-be2a-5daec81c02bb None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:59.841218 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6928b6-e2cf-455e-be2a-5daec81c02bb None admin] PATH_INFO: `/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01/users/085a4df4c8f84be3b428ea5d8d6cc167/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:59.843250 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6928b6-e2cf-455e-be2a-5daec81c02bb None admin] RBAC: Authorizing `identity:create_grant(project_id=1f8d2f2bddb7409bb80d51b644ee1f01, user_id=085a4df4c8f84be3b428ea5d8d6cc167, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:59.844780 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6928b6-e2cf-455e-be2a-5daec81c02bb None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:59.857937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 42/79] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 12:59:59 2022] PUT /identity/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01/users/085a4df4c8f84be3b428ea5d8d6cc167/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 12:59:59.858074 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac206c-ce56-429e-a098-07cbafeb3291 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:59.858730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6928b6-e2cf-455e-be2a-5daec81c02bb None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:59.902200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f63d5-809f-4ded-899e-bb2be493277c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:59.902857 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f63d5-809f-4ded-899e-bb2be493277c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:59.903141 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f63d5-809f-4ded-899e-bb2be493277c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:59.903476 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f63d5-809f-4ded-899e-bb2be493277c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:59.905916 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f63d5-809f-4ded-899e-bb2be493277c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:59.907448 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f63d5-809f-4ded-899e-bb2be493277c None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:59.909334 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 38/80] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:59.910462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f63d5-809f-4ded-899e-bb2be493277c None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:59.926784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:59.980255 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6928b6-e2cf-455e-be2a-5daec81c02bb None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:00.016207 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82923a5-0f5d-4f90-91da-c64bcc1d207f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:00.016856 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82923a5-0f5d-4f90-91da-c64bcc1d207f None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:00.017137 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82923a5-0f5d-4f90-91da-c64bcc1d207f None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:00.017412 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82923a5-0f5d-4f90-91da-c64bcc1d207f None admin] PATH_INFO: `/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:00.018580 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82923a5-0f5d-4f90-91da-c64bcc1d207f None admin] RBAC: Authorizing `identity:get_project(project_id=1f8d2f2bddb7409bb80d51b644ee1f01)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:00.020118 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82923a5-0f5d-4f90-91da-c64bcc1d207f None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:00.021823 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 43/81] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:59 2022] GET /identity/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:00.028053 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82923a5-0f5d-4f90-91da-c64bcc1d207f None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:00.029434 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f63d5-809f-4ded-899e-bb2be493277c None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:00.045369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:00.071658 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5f164-34a5-4a05-8302-e6593c878bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:00.072343 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5f164-34a5-4a05-8302-e6593c878bd4 None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:00.072624 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5f164-34a5-4a05-8302-e6593c878bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:00.072899 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5f164-34a5-4a05-8302-e6593c878bd4 None admin] PATH_INFO: `/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01/users/ee790ff9ce0f4b8a9ca3c54f019a2783/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:00.074933 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5f164-34a5-4a05-8302-e6593c878bd4 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f8d2f2bddb7409bb80d51b644ee1f01, user_id=ee790ff9ce0f4b8a9ca3c54f019a2783, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:00.076435 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5f164-34a5-4a05-8302-e6593c878bd4 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:00.092070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 39/82] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 12:59:59 2022] PUT /identity/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01/users/ee790ff9ce0f4b8a9ca3c54f019a2783/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:00.092878 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5f164-34a5-4a05-8302-e6593c878bd4 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:00.164464 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82923a5-0f5d-4f90-91da-c64bcc1d207f None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:00.183908 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:00.219027 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ce581-b762-4aa7-a4d5-19585d19f8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:00.220115 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ce581-b762-4aa7-a4d5-19585d19f8c6 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:00.220403 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ce581-b762-4aa7-a4d5-19585d19f8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:00.220743 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ce581-b762-4aa7-a4d5-19585d19f8c6 None admin] PATH_INFO: `/v3/projects/843cd7672acd4d739ea51d899c845e37` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:00.222239 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ce581-b762-4aa7-a4d5-19585d19f8c6 None admin] RBAC: Authorizing `identity:get_project(project_id=843cd7672acd4d739ea51d899c845e37)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:00.224539 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ce581-b762-4aa7-a4d5-19585d19f8c6 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:00.226136 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5f164-34a5-4a05-8302-e6593c878bd4 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:00.226967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 44/83] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:00:00 2022] GET /identity/v3/projects/843cd7672acd4d739ea51d899c845e37 => generated 312 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:00.233547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ce581-b762-4aa7-a4d5-19585d19f8c6 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:00.276182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfaa25-a53e-4d11-b064-2c18b66eebb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:00.276971 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfaa25-a53e-4d11-b064-2c18b66eebb8 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:00.277757 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfaa25-a53e-4d11-b064-2c18b66eebb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:00.278115 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfaa25-a53e-4d11-b064-2c18b66eebb8 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:00.279774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebfaa25-a53e-4d11-b064-2c18b66eebb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:00.282101 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebfaa25-a53e-4d11-b064-2c18b66eebb8 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:00.317325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 40/84] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 24 13:00:00 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:00:00.318562 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfaa25-a53e-4d11-b064-2c18b66eebb8 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:00.347357 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:00.365817 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ce581-b762-4aa7-a4d5-19585d19f8c6 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:00.405932 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3027c0-350a-4bdc-9b9a-157239748d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:00.406704 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3027c0-350a-4bdc-9b9a-157239748d0b None admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:00.406990 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3027c0-350a-4bdc-9b9a-157239748d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:00.407264 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3027c0-350a-4bdc-9b9a-157239748d0b None admin] PATH_INFO: `/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01/users/085a4df4c8f84be3b428ea5d8d6cc167/roles/4bcba8c3ff16483b9115020b5b886522` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:00.409535 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3027c0-350a-4bdc-9b9a-157239748d0b None admin] RBAC: Authorizing `identity:create_grant(project_id=1f8d2f2bddb7409bb80d51b644ee1f01, user_id=085a4df4c8f84be3b428ea5d8d6cc167, role_id=4bcba8c3ff16483b9115020b5b886522)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:00.410990 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3027c0-350a-4bdc-9b9a-157239748d0b None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:00.438138 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 45/85] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 13:00:00 2022] PUT /identity/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01/users/085a4df4c8f84be3b428ea5d8d6cc167/roles/4bcba8c3ff16483b9115020b5b886522 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:00.446988 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfaa25-a53e-4d11-b064-2c18b66eebb8 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:00.479977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:00.489317 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78da77-2924-4040-af7c-2e5d450e4be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:00.490264 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78da77-2924-4040-af7c-2e5d450e4be7 None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:00.490973 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78da77-2924-4040-af7c-2e5d450e4be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:00.491655 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78da77-2924-4040-af7c-2e5d450e4be7 None admin] PATH_INFO: `/v3/projects/843cd7672acd4d739ea51d899c845e37/users/085a4df4c8f84be3b428ea5d8d6cc167/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:00.494606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78da77-2924-4040-af7c-2e5d450e4be7 None admin] RBAC: Authorizing `identity:create_grant(project_id=843cd7672acd4d739ea51d899c845e37, user_id=085a4df4c8f84be3b428ea5d8d6cc167, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:00.496712 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78da77-2924-4040-af7c-2e5d450e4be7 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:00.517534 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 41/86] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 13:00:00 2022] PUT /identity/v3/projects/843cd7672acd4d739ea51d899c845e37/users/085a4df4c8f84be3b428ea5d8d6cc167/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:03.017894 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993533ed-6cc2-4571-9797-970605fdc641 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:03.018437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993533ed-6cc2-4571-9797-970605fdc641 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:03.018437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993533ed-6cc2-4571-9797-970605fdc641 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:03.019948 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 46/87] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:03.037712 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a6000-2133-4ab8-a9fa-3afec564c407 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:03.038908 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a6000-2133-4ab8-a9fa-3afec564c407 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:03.038908 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a6000-2133-4ab8-a9fa-3afec564c407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:03.068589 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-2e0a6000-2133-4ab8-a9fa-3afec564c407 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:03.069853 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2e0a6000-2133-4ab8-a9fa-3afec564c407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:03.162019 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 42/88] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:00:03.188536 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be52018-aa81-4970-8aef-de148e7572e6 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:03.188949 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be52018-aa81-4970-8aef-de148e7572e6 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:03.189230 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be52018-aa81-4970-8aef-de148e7572e6 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:03.190617 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 47/89] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:03.197517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f9857-6096-40e9-8354-7d26e5aa21d3 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:03.198124 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f9857-6096-40e9-8354-7d26e5aa21d3 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:03.198601 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f9857-6096-40e9-8354-7d26e5aa21d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:03.224248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-997f9857-6096-40e9-8354-7d26e5aa21d3 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:03.225862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-997f9857-6096-40e9-8354-7d26e5aa21d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:03.284505 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd00b77-601a-40bb-bffd-147377fb05f8 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:03.284783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd00b77-601a-40bb-bffd-147377fb05f8 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:03.284975 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd00b77-601a-40bb-bffd-147377fb05f8 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:03.286317 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 48/90] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:00:03.291552 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be261972-f389-4d28-8b78-93e82b790af8 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:03.291835 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be261972-f389-4d28-8b78-93e82b790af8 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:03.292112 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be261972-f389-4d28-8b78-93e82b790af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:03.309670 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 43/91] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:00:03.332826 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-be261972-f389-4d28-8b78-93e82b790af8 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:03.334008 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-be261972-f389-4d28-8b78-93e82b790af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:03.358752 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a482b3-e924-46f2-9386-2316936faad8 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:03.359696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a482b3-e924-46f2-9386-2316936faad8 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:03.360488 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a482b3-e924-46f2-9386-2316936faad8 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:03.362035 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 44/92] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:00:03.368490 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163b941-b649-4385-9939-c1284a090184 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:03.369018 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163b941-b649-4385-9939-c1284a090184 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:03.369510 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163b941-b649-4385-9939-c1284a090184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:03.396192 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-a163b941-b649-4385-9939-c1284a090184 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:03.404333 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a163b941-b649-4385-9939-c1284a090184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:03.475593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:03.505727 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 49/93] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:03.508970 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 45/94] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:00:03.665140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be261972-f389-4d28-8b78-93e82b790af8 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:03.753983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:03.769775 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163b941-b649-4385-9939-c1284a090184 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:03.799555 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be261972-f389-4d28-8b78-93e82b790af8 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:03.868161 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd21f4-b98b-407a-8fc1-cfa88fb20a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:03.869465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd21f4-b98b-407a-8fc1-cfa88fb20a6a None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:03.870084 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd21f4-b98b-407a-8fc1-cfa88fb20a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:03.870623 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd21f4-b98b-407a-8fc1-cfa88fb20a6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:03.887504 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd21f4-b98b-407a-8fc1-cfa88fb20a6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:03.893562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-36bd21f4-b98b-407a-8fc1-cfa88fb20a6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:00:03.893562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:03.893562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:03.893562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:03.893562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:03.893562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:03.893562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:03.893562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:03.893562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:03.893562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:03.893562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:03.893562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:03.893562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:03.893562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:03.893562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:03.893562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:03.894421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:03.894421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:03.894421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:03.894421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:03.894421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:03.894421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:03.894421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:03.894421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:03.894421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:03.894421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:03.894421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:03.894421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:03.894421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:03.894421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:03.894421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:03.894421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:03.895187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:03.895187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:03.895187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:03.895187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:03.895187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:03.895187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:03.895187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:03.895187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:03.895187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:03.895187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:03.895187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:00:03.895187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:03.897869 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 50/95] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:03.899598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd21f4-b98b-407a-8fc1-cfa88fb20a6a None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:03.942056 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163b941-b649-4385-9939-c1284a090184 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:03.980000 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8e35b-64ae-4e08-8795-fbc844b2ae01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:03.980638 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8e35b-64ae-4e08-8795-fbc844b2ae01 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:03.980922 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8e35b-64ae-4e08-8795-fbc844b2ae01 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:03.981217 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8e35b-64ae-4e08-8795-fbc844b2ae01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:03.993725 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8e35b-64ae-4e08-8795-fbc844b2ae01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:03.998688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-34d8e35b-64ae-4e08-8795-fbc844b2ae01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:00:03.998688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:03.998688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:03.998688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:03.998688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:03.998688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:03.998688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:03.998688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:03.998688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:03.998688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:03.998688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:03.998688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:03.998688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:03.998688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:03.998688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:03.998688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:03.999605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:03.999605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:03.999605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:03.999605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:03.999605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:03.999605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:03.999605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:03.999605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:03.999605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:03.999605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:03.999605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:03.999605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:03.999605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:03.999605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:03.999605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:03.999605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:04.000358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:04.000358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:04.000358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:04.000358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:04.000358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:04.000358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:04.000358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:04.000358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:04.000358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:04.000358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:04.000358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:00:04.000358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:04.000358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 46/96] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 24 13:00:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:04.000990 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8e35b-64ae-4e08-8795-fbc844b2ae01 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:04.030154 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd21f4-b98b-407a-8fc1-cfa88fb20a6a None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:04.037435 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:04.061499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:04.068392 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075aa48-524a-4c57-8570-ecf563c944f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:04.069311 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075aa48-524a-4c57-8570-ecf563c944f1 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.070150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075aa48-524a-4c57-8570-ecf563c944f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.071227 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075aa48-524a-4c57-8570-ecf563c944f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.082515 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075aa48-524a-4c57-8570-ecf563c944f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:04.089061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-3075aa48-524a-4c57-8570-ecf563c944f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:00:04.089061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:04.089061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:04.089061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:04.089061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:04.089061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:04.089061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:04.089061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:04.089061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:04.089061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:04.089061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:04.089061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:04.089061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:04.089061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:04.089061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:04.089061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:04.090854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:04.090854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:04.090854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:04.090854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:04.090854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:04.090854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:04.090854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:04.090854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:04.090854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:04.090854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:04.090854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:04.090854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:04.090854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:04.090854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:04.090854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:04.090854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:04.092476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:04.092476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:04.092476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:04.092476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:04.092476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:04.092476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:04.092476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:04.092476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:04.092476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:04.092476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:04.092476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:00:04.092476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:04.095974 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 51/97] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:04.097464 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cdf76-8502-4817-9b61-3cbf01d4a6e4 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.097744 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cdf76-8502-4817-9b61-3cbf01d4a6e4 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.098019 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cdf76-8502-4817-9b61-3cbf01d4a6e4 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.100917 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 52/98] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:04.104277 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cdf76-8502-4817-9b61-3cbf01d4a6e4 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:04.117542 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8e35b-64ae-4e08-8795-fbc844b2ae01 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:04.156796 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4cc71-5566-4bab-924c-81ccee707614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:04.157403 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4cc71-5566-4bab-924c-81ccee707614 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.157680 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4cc71-5566-4bab-924c-81ccee707614 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.157949 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4cc71-5566-4bab-924c-81ccee707614 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.158604 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4cc71-5566-4bab-924c-81ccee707614 None admin] RBAC: Adding query filter params (name=member) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:04.158900 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4cc71-5566-4bab-924c-81ccee707614 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:04.160316 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4cc71-5566-4bab-924c-81ccee707614 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:04.169197 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 47/99] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 24 13:00:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:04.169991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4cc71-5566-4bab-924c-81ccee707614 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:04.220222 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cdf76-8502-4817-9b61-3cbf01d4a6e4 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:04.259641 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582e9a0-c40e-4da3-b7f7-708917f131e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:04.260275 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582e9a0-c40e-4da3-b7f7-708917f131e9 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.260556 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582e9a0-c40e-4da3-b7f7-708917f131e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.260832 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582e9a0-c40e-4da3-b7f7-708917f131e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.270915 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6582e9a0-c40e-4da3-b7f7-708917f131e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:04.273559 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:04.276902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-6582e9a0-c40e-4da3-b7f7-708917f131e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:00:04.276902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:04.276902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:04.276902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:04.276902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:04.276902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:04.276902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:04.276902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:04.276902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:04.276902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:04.276902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:04.276902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:04.276902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:04.276902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:04.276902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:04.276902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:04.277760 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:04.277760 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:04.277760 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:04.277760 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:04.277760 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:04.277760 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:04.277760 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:04.277760 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:04.277760 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:04.277760 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:04.277760 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:04.277760 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:04.277760 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:04.277760 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:04.277760 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:04.277760 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:04.278522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:04.278522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:04.278522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:04.278522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:04.278522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:04.278522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:04.278522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:04.278522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:04.278522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:04.278522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:04.278522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:00:04.278522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:04.279124 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4cc71-5566-4bab-924c-81ccee707614 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:04.279191 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 53/100] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 24 13:00:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:04.283527 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582e9a0-c40e-4da3-b7f7-708917f131e9 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:04.314912 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4dfce-9d7f-4538-8ae1-48f4a31b8fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:04.315579 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4dfce-9d7f-4538-8ae1-48f4a31b8fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.315861 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4dfce-9d7f-4538-8ae1-48f4a31b8fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.316133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4dfce-9d7f-4538-8ae1-48f4a31b8fb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.316905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4dfce-9d7f-4538-8ae1-48f4a31b8fb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:04.317207 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4dfce-9d7f-4538-8ae1-48f4a31b8fb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:04.318578 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4dfce-9d7f-4538-8ae1-48f4a31b8fb0 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:04.334632 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 48/101] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:04.334632 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c55da-b1fb-4872-9263-a2a65502d8f1 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.334632 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c55da-b1fb-4872-9263-a2a65502d8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.334632 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c55da-b1fb-4872-9263-a2a65502d8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.342509 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:04.350147 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-8c8c55da-b1fb-4872-9263-a2a65502d8f1 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:04.351504 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8c8c55da-b1fb-4872-9263-a2a65502d8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:04.399285 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582e9a0-c40e-4da3-b7f7-708917f131e9 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:04.430275 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 49/102] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:04.430936 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c55da-b1fb-4872-9263-a2a65502d8f1 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:04.447405 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58112501-e325-44ae-8348-40217f3f97ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:04.448626 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58112501-e325-44ae-8348-40217f3f97ce None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.449363 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58112501-e325-44ae-8348-40217f3f97ce None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.449846 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58112501-e325-44ae-8348-40217f3f97ce None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.451082 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58112501-e325-44ae-8348-40217f3f97ce None admin] RBAC: Adding query filter params (name=member) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:04.451610 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58112501-e325-44ae-8348-40217f3f97ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:04.453848 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58112501-e325-44ae-8348-40217f3f97ce None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:04.465864 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 54/103] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 24 13:00:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:04.466972 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58112501-e325-44ae-8348-40217f3f97ce None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:04.532907 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:04.545557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c55da-b1fb-4872-9263-a2a65502d8f1 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:04.584466 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c8531-3dcb-4279-a45a-27f27adb1fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:04.585106 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c8531-3dcb-4279-a45a-27f27adb1fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.585468 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c8531-3dcb-4279-a45a-27f27adb1fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.585740 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c8531-3dcb-4279-a45a-27f27adb1fd0 None admin] PATH_INFO: `/v3/users/085a4df4c8f84be3b428ea5d8d6cc167` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.587582 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c8531-3dcb-4279-a45a-27f27adb1fd0 None admin] RBAC: Authorizing `identity:get_user(user_id=085a4df4c8f84be3b428ea5d8d6cc167)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:04.589023 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c8531-3dcb-4279-a45a-27f27adb1fd0 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:04.590592 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 50/104] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:00:04 2022] GET /identity/v3/users/085a4df4c8f84be3b428ea5d8d6cc167 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:04.591874 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58112501-e325-44ae-8348-40217f3f97ce None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:04.592448 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c8531-3dcb-4279-a45a-27f27adb1fd0 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:04.605966 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:04.628457 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18492894-ef3a-4051-ab72-d3cd6b209c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:04.629061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18492894-ef3a-4051-ab72-d3cd6b209c9d None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.629337 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18492894-ef3a-4051-ab72-d3cd6b209c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.629605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18492894-ef3a-4051-ab72-d3cd6b209c9d None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.630245 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18492894-ef3a-4051-ab72-d3cd6b209c9d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:04.630541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18492894-ef3a-4051-ab72-d3cd6b209c9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:04.632473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18492894-ef3a-4051-ab72-d3cd6b209c9d None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:04.645001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 55/105] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:04.645001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18492894-ef3a-4051-ab72-d3cd6b209c9d None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:04.711709 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c8531-3dcb-4279-a45a-27f27adb1fd0 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:04.745384 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a45b9-05e9-421b-96fc-b11129662a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:04.746038 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a45b9-05e9-421b-96fc-b11129662a94 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.746568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a45b9-05e9-421b-96fc-b11129662a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.746568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a45b9-05e9-421b-96fc-b11129662a94 None admin] PATH_INFO: `/v3/users/ee790ff9ce0f4b8a9ca3c54f019a2783` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.747733 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a45b9-05e9-421b-96fc-b11129662a94 None admin] RBAC: Authorizing `identity:get_user(user_id=ee790ff9ce0f4b8a9ca3c54f019a2783)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:04.749178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a45b9-05e9-421b-96fc-b11129662a94 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:04.750739 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 51/106] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:00:04 2022] GET /identity/v3/users/ee790ff9ce0f4b8a9ca3c54f019a2783 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:04.751851 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18492894-ef3a-4051-ab72-d3cd6b209c9d None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:04.751955 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c7386-fc2b-4b3e-963a-765c4bb790f5 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.752192 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c7386-fc2b-4b3e-963a-765c4bb790f5 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.752461 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c7386-fc2b-4b3e-963a-765c4bb790f5 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.753811 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 52/107] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:04.754341 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c7386-fc2b-4b3e-963a-765c4bb790f5 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:04.782311 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:04.787550 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164b8c7-5d02-423d-88ab-2baea9b12f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:04.790100 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164b8c7-5d02-423d-88ab-2baea9b12f48 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.790865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164b8c7-5d02-423d-88ab-2baea9b12f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.791158 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164b8c7-5d02-423d-88ab-2baea9b12f48 None admin] PATH_INFO: `/v3/users/085a4df4c8f84be3b428ea5d8d6cc167` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.792346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164b8c7-5d02-423d-88ab-2baea9b12f48 None admin] RBAC: Authorizing `identity:get_user(user_id=085a4df4c8f84be3b428ea5d8d6cc167)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:04.793808 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164b8c7-5d02-423d-88ab-2baea9b12f48 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:04.795384 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 56/108] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:00:04 2022] GET /identity/v3/users/085a4df4c8f84be3b428ea5d8d6cc167 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:04.797289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164b8c7-5d02-423d-88ab-2baea9b12f48 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:04.840244 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:04.856548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c7386-fc2b-4b3e-963a-765c4bb790f5 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:04.889448 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3d598-d014-46ce-a71a-0f1ad491cde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:04.890060 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3d598-d014-46ce-a71a-0f1ad491cde9 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.890345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3d598-d014-46ce-a71a-0f1ad491cde9 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.890621 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3d598-d014-46ce-a71a-0f1ad491cde9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.897035 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164b8c7-5d02-423d-88ab-2baea9b12f48 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:04.929836 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62664d2-a3e6-4cbe-91bf-fe0731c5dd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:04.930464 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62664d2-a3e6-4cbe-91bf-fe0731c5dd0a None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.930753 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62664d2-a3e6-4cbe-91bf-fe0731c5dd0a None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.931031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62664d2-a3e6-4cbe-91bf-fe0731c5dd0a None admin] PATH_INFO: `/v3/users/085a4df4c8f84be3b428ea5d8d6cc167` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.932187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62664d2-a3e6-4cbe-91bf-fe0731c5dd0a None admin] RBAC: Authorizing `identity:get_user(user_id=085a4df4c8f84be3b428ea5d8d6cc167)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:04.933647 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62664d2-a3e6-4cbe-91bf-fe0731c5dd0a None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:04.935224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 57/109] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:00:04 2022] GET /identity/v3/users/085a4df4c8f84be3b428ea5d8d6cc167 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:04.940473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62664d2-a3e6-4cbe-91bf-fe0731c5dd0a None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:04.956890 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3d598-d014-46ce-a71a-0f1ad491cde9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:04.958386 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3d598-d014-46ce-a71a-0f1ad491cde9 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:04.985785 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:05.039945 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62664d2-a3e6-4cbe-91bf-fe0731c5dd0a None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:05.050098 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:05.058209 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 53/110] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:00:05.059050 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3d598-d014-46ce-a71a-0f1ad491cde9 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:05.075064 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05421bb0-af52-4d62-bed8-4acb384a4970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:05.075718 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05421bb0-af52-4d62-bed8-4acb384a4970 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:05.076004 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05421bb0-af52-4d62-bed8-4acb384a4970 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:05.076283 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05421bb0-af52-4d62-bed8-4acb384a4970 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:05.086365 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05421bb0-af52-4d62-bed8-4acb384a4970 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:05.091783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-05421bb0-af52-4d62-bed8-4acb384a4970 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:00:05.091783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:05.091783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:05.091783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:05.091783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:05.091783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:05.091783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:05.091783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:05.091783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:05.091783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:05.091783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:05.091783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:05.091783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:05.091783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:05.091783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:05.091783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:05.092681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:05.092681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:05.092681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:05.092681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:05.092681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:05.092681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:05.092681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:05.092681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:05.092681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:05.092681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:05.092681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:05.092681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:05.092681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:05.092681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:05.092681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:05.092681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:05.093443 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:05.093443 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:05.093443 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:05.093443 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:05.093443 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:05.093443 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:05.093443 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:05.093443 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:05.093443 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:05.093443 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:05.093443 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:00:05.093443 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:05.093443 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 58/111] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:05.094170 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b38af-47bc-4d1c-a355-ff60aa228e9b None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:05.094237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b38af-47bc-4d1c-a355-ff60aa228e9b None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:05.094487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b38af-47bc-4d1c-a355-ff60aa228e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:05.113098 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-350b38af-47bc-4d1c-a355-ff60aa228e9b None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:05.114270 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-350b38af-47bc-4d1c-a355-ff60aa228e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:05.162318 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3d598-d014-46ce-a71a-0f1ad491cde9 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:05.179577 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 59/112] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:05.180432 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b38af-47bc-4d1c-a355-ff60aa228e9b None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:05.189690 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:05.200886 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba7828-61b8-40e3-a528-73baf71d4807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:05.201496 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba7828-61b8-40e3-a528-73baf71d4807 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:05.201773 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba7828-61b8-40e3-a528-73baf71d4807 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:05.202045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba7828-61b8-40e3-a528-73baf71d4807 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:05.272436 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba7828-61b8-40e3-a528-73baf71d4807 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:05.274392 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba7828-61b8-40e3-a528-73baf71d4807 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:05.290314 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:05.294005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b38af-47bc-4d1c-a355-ff60aa228e9b None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:05.333689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600e469-a67d-48f7-ac28-0ca1589534d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:05.334308 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600e469-a67d-48f7-ac28-0ca1589534d4 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:05.334593 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600e469-a67d-48f7-ac28-0ca1589534d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:05.334896 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600e469-a67d-48f7-ac28-0ca1589534d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:05.378450 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 54/113] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:00:05.379221 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba7828-61b8-40e3-a528-73baf71d4807 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:05.408524 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600e469-a67d-48f7-ac28-0ca1589534d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:05.408875 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:05.410001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600e469-a67d-48f7-ac28-0ca1589534d4 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:05.486250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba7828-61b8-40e3-a528-73baf71d4807 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:05.506394 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:05.514796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 60/114] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:00:05.514796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600e469-a67d-48f7-ac28-0ca1589534d4 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:05.525207 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabd478-27ab-43bb-8c6d-5b18bd0bcb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:05.525828 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabd478-27ab-43bb-8c6d-5b18bd0bcb2e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:05.526115 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabd478-27ab-43bb-8c6d-5b18bd0bcb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:05.526397 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabd478-27ab-43bb-8c6d-5b18bd0bcb2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:05.596280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabd478-27ab-43bb-8c6d-5b18bd0bcb2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:05.597764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabd478-27ab-43bb-8c6d-5b18bd0bcb2e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:05.609273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600e469-a67d-48f7-ac28-0ca1589534d4 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:05.623623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:05.642920 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9403e79-c330-401b-8ccd-575b12fd6be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:05.643507 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9403e79-c330-401b-8ccd-575b12fd6be4 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:05.643791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9403e79-c330-401b-8ccd-575b12fd6be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:05.644067 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9403e79-c330-401b-8ccd-575b12fd6be4 None admin] PATH_INFO: `/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:05.645184 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9403e79-c330-401b-8ccd-575b12fd6be4 None admin] RBAC: Authorizing `identity:get_project(project_id=1f8d2f2bddb7409bb80d51b644ee1f01)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:05.646649 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9403e79-c330-401b-8ccd-575b12fd6be4 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:05.648602 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 61/115] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:00:05 2022] GET /identity/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:05.649461 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9403e79-c330-401b-8ccd-575b12fd6be4 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:05.699339 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 55/116] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:00:05.699339 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabd478-27ab-43bb-8c6d-5b18bd0bcb2e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:05.719073 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:05.752827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9403e79-c330-401b-8ccd-575b12fd6be4 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:05.789782 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0c646-6352-40b5-8a02-37f442884905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:05.790392 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0c646-6352-40b5-8a02-37f442884905 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:05.790670 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0c646-6352-40b5-8a02-37f442884905 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:05.790949 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0c646-6352-40b5-8a02-37f442884905 None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:05.791649 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0c646-6352-40b5-8a02-37f442884905 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:05.791952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0c646-6352-40b5-8a02-37f442884905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:05.793344 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0c646-6352-40b5-8a02-37f442884905 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:05.799248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabd478-27ab-43bb-8c6d-5b18bd0bcb2e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:05.801190 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 62/117] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 24 13:00:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:05.806791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0c646-6352-40b5-8a02-37f442884905 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:05.825509 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:05.834599 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f013ff-ba69-4518-8400-8bcd70fa0797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:05.835980 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f013ff-ba69-4518-8400-8bcd70fa0797 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:05.836419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f013ff-ba69-4518-8400-8bcd70fa0797 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:05.836694 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f013ff-ba69-4518-8400-8bcd70fa0797 None admin] PATH_INFO: `/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:05.837821 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f013ff-ba69-4518-8400-8bcd70fa0797 None admin] RBAC: Authorizing `identity:get_project(project_id=1f8d2f2bddb7409bb80d51b644ee1f01)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:05.839275 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f013ff-ba69-4518-8400-8bcd70fa0797 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:05.840922 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 56/118] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:00:05 2022] GET /identity/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:05.841681 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f013ff-ba69-4518-8400-8bcd70fa0797 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:05.910541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0c646-6352-40b5-8a02-37f442884905 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:05.938693 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:05.940910 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f013ff-ba69-4518-8400-8bcd70fa0797 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:05.944975 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a47d64-fb5e-4e3b-a0b9-1afe07e91c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:05.945605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a47d64-fb5e-4e3b-a0b9-1afe07e91c95 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:05.945889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a47d64-fb5e-4e3b-a0b9-1afe07e91c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:05.946455 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a47d64-fb5e-4e3b-a0b9-1afe07e91c95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:05.947614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a47d64-fb5e-4e3b-a0b9-1afe07e91c95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:05.949116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a47d64-fb5e-4e3b-a0b9-1afe07e91c95 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:05.950713 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 63/119] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:05.951498 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a47d64-fb5e-4e3b-a0b9-1afe07e91c95 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:05.977878 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22235037-8ed3-48b6-870e-502fd6eb9591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:05.978501 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22235037-8ed3-48b6-870e-502fd6eb9591 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:05.978770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22235037-8ed3-48b6-870e-502fd6eb9591 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:05.979045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22235037-8ed3-48b6-870e-502fd6eb9591 None admin] PATH_INFO: `/v3/projects/843cd7672acd4d739ea51d899c845e37` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:05.980185 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22235037-8ed3-48b6-870e-502fd6eb9591 None admin] RBAC: Authorizing `identity:get_project(project_id=843cd7672acd4d739ea51d899c845e37)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:05.981619 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22235037-8ed3-48b6-870e-502fd6eb9591 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:05.983377 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 57/120] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:00:05 2022] GET /identity/v3/projects/843cd7672acd4d739ea51d899c845e37 => generated 312 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:05.984062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22235037-8ed3-48b6-870e-502fd6eb9591 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:06.044349 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:06.055566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a47d64-fb5e-4e3b-a0b9-1afe07e91c95 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:06.084264 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22235037-8ed3-48b6-870e-502fd6eb9591 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:06.089420 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83d39c-8a04-4014-b90f-1cb701c56d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:06.090025 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83d39c-8a04-4014-b90f-1cb701c56d3a None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:06.090308 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83d39c-8a04-4014-b90f-1cb701c56d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:06.090586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83d39c-8a04-4014-b90f-1cb701c56d3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:06.091306 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83d39c-8a04-4014-b90f-1cb701c56d3a None admin] RBAC: Adding query filter params (role.id=b2da36c699a445fda4d2372471051f41, scope.project.id=1f8d2f2bddb7409bb80d51b644ee1f01, user.id=085a4df4c8f84be3b428ea5d8d6cc167) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:06.091655 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83d39c-8a04-4014-b90f-1cb701c56d3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:06.093118 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83d39c-8a04-4014-b90f-1cb701c56d3a None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:06.100278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 64/121] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:00:05 2022] GET /identity/v3/role_assignments?user.id=085a4df4c8f84be3b428ea5d8d6cc167&scope.project.id=1f8d2f2bddb7409bb80d51b644ee1f01&role.id=b2da36c699a445fda4d2372471051f41 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:06.101776 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83d39c-8a04-4014-b90f-1cb701c56d3a None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:06.123020 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12663f-e393-4365-83dd-01accb4cfc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:06.123719 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12663f-e393-4365-83dd-01accb4cfc56 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:06.123996 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12663f-e393-4365-83dd-01accb4cfc56 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:06.124268 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12663f-e393-4365-83dd-01accb4cfc56 None admin] PATH_INFO: `/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:06.125457 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12663f-e393-4365-83dd-01accb4cfc56 None admin] RBAC: Authorizing `identity:get_project(project_id=1f8d2f2bddb7409bb80d51b644ee1f01)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:06.126938 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12663f-e393-4365-83dd-01accb4cfc56 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:06.128856 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 58/122] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:00:05 2022] GET /identity/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:06.129574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12663f-e393-4365-83dd-01accb4cfc56 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:06.181300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:06.226238 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83d39c-8a04-4014-b90f-1cb701c56d3a None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:06.246192 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12663f-e393-4365-83dd-01accb4cfc56 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:06.264709 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f6d02-efcb-44be-aac2-03d65c00d0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:06.265466 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f6d02-efcb-44be-aac2-03d65c00d0dd None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:06.265745 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f6d02-efcb-44be-aac2-03d65c00d0dd None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:06.266130 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f6d02-efcb-44be-aac2-03d65c00d0dd None admin] PATH_INFO: `/v3/users/fd558ff5bcc840c5a08aca52b6ac46d7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:06.280631 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:06.284250 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f6d02-efcb-44be-aac2-03d65c00d0dd None admin] RBAC: Authorizing `identity:get_user(user_id=fd558ff5bcc840c5a08aca52b6ac46d7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:06.285745 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f6d02-efcb-44be-aac2-03d65c00d0dd None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:06.287473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 65/123] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:00:06 2022] GET /identity/v3/users/fd558ff5bcc840c5a08aca52b6ac46d7 => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:06.288123 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc3133-3e2a-4600-8f41-cad8fb6dfd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:06.288336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f6d02-efcb-44be-aac2-03d65c00d0dd None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:06.288760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc3133-3e2a-4600-8f41-cad8fb6dfd4b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:06.289040 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc3133-3e2a-4600-8f41-cad8fb6dfd4b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:06.289315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc3133-3e2a-4600-8f41-cad8fb6dfd4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:06.290049 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc3133-3e2a-4600-8f41-cad8fb6dfd4b None admin] RBAC: Adding query filter params (role.id=23ca6ecd60b2470cba913daeaf54f0f7, scope.project.id=1f8d2f2bddb7409bb80d51b644ee1f01, user.id=ee790ff9ce0f4b8a9ca3c54f019a2783) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:06.290358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc3133-3e2a-4600-8f41-cad8fb6dfd4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:06.291879 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc3133-3e2a-4600-8f41-cad8fb6dfd4b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:06.299536 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 59/124] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:00:06 2022] GET /identity/v3/role_assignments?user.id=ee790ff9ce0f4b8a9ca3c54f019a2783&scope.project.id=1f8d2f2bddb7409bb80d51b644ee1f01&role.id=23ca6ecd60b2470cba913daeaf54f0f7 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:06.300552 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc3133-3e2a-4600-8f41-cad8fb6dfd4b None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:06.423110 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f6d02-efcb-44be-aac2-03d65c00d0dd None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:06.430504 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc3133-3e2a-4600-8f41-cad8fb6dfd4b None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:06.446997 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:06.464709 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54484d3-8ab7-452e-b974-727773d83531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:06.465329 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54484d3-8ab7-452e-b974-727773d83531 None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:06.465607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54484d3-8ab7-452e-b974-727773d83531 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:06.465880 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54484d3-8ab7-452e-b974-727773d83531 None admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:06.466592 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54484d3-8ab7-452e-b974-727773d83531 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:06.468061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54484d3-8ab7-452e-b974-727773d83531 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:06.468530 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c08ac-cd4d-47cd-9c97-ad154241c882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:06.469154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c08ac-cd4d-47cd-9c97-ad154241c882 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:06.469440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c08ac-cd4d-47cd-9c97-ad154241c882 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:06.469719 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c08ac-cd4d-47cd-9c97-ad154241c882 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:06.470457 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c08ac-cd4d-47cd-9c97-ad154241c882 None admin] RBAC: Adding query filter params (role.id=b2da36c699a445fda4d2372471051f41, scope.project.id=843cd7672acd4d739ea51d899c845e37, user.id=085a4df4c8f84be3b428ea5d8d6cc167) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:06.470772 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c08ac-cd4d-47cd-9c97-ad154241c882 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:06.472250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c08ac-cd4d-47cd-9c97-ad154241c882 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:06.487451 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 60/125] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:00:06 2022] GET /identity/v3/role_assignments?user.id=085a4df4c8f84be3b428ea5d8d6cc167&scope.project.id=843cd7672acd4d739ea51d899c845e37&role.id=b2da36c699a445fda4d2372471051f41 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:06.487451 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c08ac-cd4d-47cd-9c97-ad154241c882 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:06.511321 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 66/126] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 24 13:00:06 2022] POST /identity/v3/projects => generated 302 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:00:06.512340 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54484d3-8ab7-452e-b974-727773d83531 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:06.581654 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:06.648901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c08ac-cd4d-47cd-9c97-ad154241c882 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:06.672899 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54484d3-8ab7-452e-b974-727773d83531 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:06.704112 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7116c-e1e3-481e-a896-1b0f0e6f2105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:06.704857 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7116c-e1e3-481e-a896-1b0f0e6f2105 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:06.705174 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7116c-e1e3-481e-a896-1b0f0e6f2105 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:06.711478 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7116c-e1e3-481e-a896-1b0f0e6f2105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:06.711478 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7116c-e1e3-481e-a896-1b0f0e6f2105 None admin] RBAC: Adding query filter params (role.id=4bcba8c3ff16483b9115020b5b886522, scope.project.id=1f8d2f2bddb7409bb80d51b644ee1f01, user.id=085a4df4c8f84be3b428ea5d8d6cc167) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:06.711478 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7116c-e1e3-481e-a896-1b0f0e6f2105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:06.711478 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7116c-e1e3-481e-a896-1b0f0e6f2105 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:06.718791 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 61/127] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:00:06 2022] GET /identity/v3/role_assignments?user.id=085a4df4c8f84be3b428ea5d8d6cc167&scope.project.id=1f8d2f2bddb7409bb80d51b644ee1f01&role.id=4bcba8c3ff16483b9115020b5b886522 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:06.727667 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc53789-def7-4182-8bfb-48273db7326a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:06.728353 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc53789-def7-4182-8bfb-48273db7326a None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:06.728639 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc53789-def7-4182-8bfb-48273db7326a None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:06.728918 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc53789-def7-4182-8bfb-48273db7326a None admin] PATH_INFO: `/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:06.730233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc53789-def7-4182-8bfb-48273db7326a None admin] RBAC: Authorizing `identity:get_project(project_id=1f8d2f2bddb7409bb80d51b644ee1f01)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:06.732255 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc53789-def7-4182-8bfb-48273db7326a None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:06.735543 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 67/128] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:00:06 2022] GET /identity/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:06.742915 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7116c-e1e3-481e-a896-1b0f0e6f2105 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:06.861714 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7116c-e1e3-481e-a896-1b0f0e6f2105 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:06.887663 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:06.900651 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e90eb-c67d-4e7d-b806-3851d3493b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:06.901321 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e90eb-c67d-4e7d-b806-3851d3493b68 None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:06.901606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e90eb-c67d-4e7d-b806-3851d3493b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:06.901885 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e90eb-c67d-4e7d-b806-3851d3493b68 None admin] PATH_INFO: `/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01/users/fd558ff5bcc840c5a08aca52b6ac46d7/roles/9d89ffc8145c487f80034d6daaf2f771` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:06.903859 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e90eb-c67d-4e7d-b806-3851d3493b68 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f8d2f2bddb7409bb80d51b644ee1f01, user_id=fd558ff5bcc840c5a08aca52b6ac46d7, role_id=9d89ffc8145c487f80034d6daaf2f771)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:06.905352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e90eb-c67d-4e7d-b806-3851d3493b68 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:06.921297 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 62/129] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 13:00:06 2022] PUT /identity/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01/users/fd558ff5bcc840c5a08aca52b6ac46d7/roles/9d89ffc8145c487f80034d6daaf2f771 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:08.796381 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d189637-7e8d-429f-ae06-e67116276b66 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:08.796870 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d189637-7e8d-429f-ae06-e67116276b66 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:08.796870 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d189637-7e8d-429f-ae06-e67116276b66 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:08.798178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 68/130] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:08.803542 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37289dda-d206-4134-b4c1-c128c1e85724 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:08.804576 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37289dda-d206-4134-b4c1-c128c1e85724 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:08.804859 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37289dda-d206-4134-b4c1-c128c1e85724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:08.824474 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-37289dda-d206-4134-b4c1-c128c1e85724 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:08.825649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-37289dda-d206-4134-b4c1-c128c1e85724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:08.888926 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 63/131] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:09.088555 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de42c3-af1c-4e99-a15a-b58238f8b937 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:09.088771 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de42c3-af1c-4e99-a15a-b58238f8b937 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:09.089046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de42c3-af1c-4e99-a15a-b58238f8b937 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:09.090391 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 69/132] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:09.095741 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb47f1-87ab-4728-a2c6-8dcf60e07bd4 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:09.096040 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb47f1-87ab-4728-a2c6-8dcf60e07bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:09.096320 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb47f1-87ab-4728-a2c6-8dcf60e07bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:09.114093 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-42bb47f1-87ab-4728-a2c6-8dcf60e07bd4 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:09.115269 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-42bb47f1-87ab-4728-a2c6-8dcf60e07bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:09.160168 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de42c3-af1c-4e99-a15a-b58238f8b937 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:09.181240 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 64/133] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:09.203920 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:09.263618 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de42c3-af1c-4e99-a15a-b58238f8b937 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:09.295740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe49c6-7997-4cda-a964-daa0edd52ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:09.296360 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe49c6-7997-4cda-a964-daa0edd52ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:09.296641 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe49c6-7997-4cda-a964-daa0edd52ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:09.296909 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe49c6-7997-4cda-a964-daa0edd52ed4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:09.297979 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe49c6-7997-4cda-a964-daa0edd52ed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:09.299459 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe49c6-7997-4cda-a964-daa0edd52ed4 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:09.301005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 70/134] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:09.307605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb47f1-87ab-4728-a2c6-8dcf60e07bd4 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:09.351988 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:09.406454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb47f1-87ab-4728-a2c6-8dcf60e07bd4 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:09.438394 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e87414-86a1-42a2-8d22-b550ec6787ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:09.439001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e87414-86a1-42a2-8d22-b550ec6787ed None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:09.439285 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e87414-86a1-42a2-8d22-b550ec6787ed None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:09.439591 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e87414-86a1-42a2-8d22-b550ec6787ed None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:09.440252 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e87414-86a1-42a2-8d22-b550ec6787ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:09.441696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e87414-86a1-42a2-8d22-b550ec6787ed None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:09.462269 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 65/135] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 24 13:00:09 2022] POST /identity/v3/users => generated 283 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:00:09.470678 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe49c6-7997-4cda-a964-daa0edd52ed4 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:09.580506 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe49c6-7997-4cda-a964-daa0edd52ed4 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:09.592095 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:09.618629 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72a410-c073-4b7c-acb7-967f0ba6decf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:09.619183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72a410-c073-4b7c-acb7-967f0ba6decf None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:09.619486 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72a410-c073-4b7c-acb7-967f0ba6decf None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:09.619758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72a410-c073-4b7c-acb7-967f0ba6decf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:09.630169 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72a410-c073-4b7c-acb7-967f0ba6decf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:09.636086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-2a72a410-c073-4b7c-acb7-967f0ba6decf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:00:09.636086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:09.636086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:09.636086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:09.636086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:09.636086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:09.636086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:09.636086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:09.636086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:09.636086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:09.636086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:09.636086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:09.636086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:09.636086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:09.636086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:09.636086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:09.637117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:09.637117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:09.637117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:09.637117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:09.637117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:09.637117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:09.637117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:09.637117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:09.637117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:09.637117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:09.637117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:09.637117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:09.637117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:09.637117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:09.637117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:09.637117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:09.638061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:09.638061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:09.638061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:09.638061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:09.638061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:09.638061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:09.638061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:09.638061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:09.638061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:09.638061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:09.638061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:00:09.638061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:09.638061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 71/136] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:09.642996 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e87414-86a1-42a2-8d22-b550ec6787ed None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:09.742199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:09.749240 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e87414-86a1-42a2-8d22-b550ec6787ed None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:09.786434 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d94ff-1549-4489-b3a7-e27bb9b7c40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:09.787053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d94ff-1549-4489-b3a7-e27bb9b7c40e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:09.787333 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d94ff-1549-4489-b3a7-e27bb9b7c40e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:09.787645 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d94ff-1549-4489-b3a7-e27bb9b7c40e None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:09.788363 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d94ff-1549-4489-b3a7-e27bb9b7c40e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:09.788951 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d94ff-1549-4489-b3a7-e27bb9b7c40e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:09.790417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d94ff-1549-4489-b3a7-e27bb9b7c40e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:09.799224 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 66/137] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 24 13:00:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:09.805862 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72a410-c073-4b7c-acb7-967f0ba6decf None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:09.919677 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72a410-c073-4b7c-acb7-967f0ba6decf None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:09.956472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869993ad-8791-45d2-8ad7-15e963611515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:09.957121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869993ad-8791-45d2-8ad7-15e963611515 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:09.957406 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869993ad-8791-45d2-8ad7-15e963611515 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:09.957682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869993ad-8791-45d2-8ad7-15e963611515 None admin] PATH_INFO: `/v3/users/fd558ff5bcc840c5a08aca52b6ac46d7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:09.958829 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869993ad-8791-45d2-8ad7-15e963611515 None admin] RBAC: Authorizing `identity:get_user(user_id=fd558ff5bcc840c5a08aca52b6ac46d7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:09.961162 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869993ad-8791-45d2-8ad7-15e963611515 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:09.963070 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 72/138] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:00:09 2022] GET /identity/v3/users/fd558ff5bcc840c5a08aca52b6ac46d7 => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:09.968788 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d94ff-1549-4489-b3a7-e27bb9b7c40e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:10.077187 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d94ff-1549-4489-b3a7-e27bb9b7c40e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:10.117954 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9b527-5978-4858-8873-ff5aa16cbb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:10.118569 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9b527-5978-4858-8873-ff5aa16cbb62 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:10.118852 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9b527-5978-4858-8873-ff5aa16cbb62 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:10.119125 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9b527-5978-4858-8873-ff5aa16cbb62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:10.152037 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:10.189597 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9b527-5978-4858-8873-ff5aa16cbb62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:10.191076 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9b527-5978-4858-8873-ff5aa16cbb62 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:10.293770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 67/139] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:00:10.299204 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869993ad-8791-45d2-8ad7-15e963611515 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:10.337663 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:10.409522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869993ad-8791-45d2-8ad7-15e963611515 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:10.445330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509035ed-a2b7-462e-a640-bc0253a4dba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:10.445865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509035ed-a2b7-462e-a640-bc0253a4dba5 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:10.446139 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509035ed-a2b7-462e-a640-bc0253a4dba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:10.446660 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509035ed-a2b7-462e-a640-bc0253a4dba5 None admin] PATH_INFO: `/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:10.447847 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509035ed-a2b7-462e-a640-bc0253a4dba5 None admin] RBAC: Authorizing `identity:get_project(project_id=1f8d2f2bddb7409bb80d51b644ee1f01)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:10.449319 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509035ed-a2b7-462e-a640-bc0253a4dba5 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:10.451025 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 73/140] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:00:10 2022] GET /identity/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:10.457775 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9b527-5978-4858-8873-ff5aa16cbb62 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:10.517552 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:10.568140 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9b527-5978-4858-8873-ff5aa16cbb62 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:10.604358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbd22b-48f1-49a1-a8da-ccabf664159c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:10.604957 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbd22b-48f1-49a1-a8da-ccabf664159c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:10.605236 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbd22b-48f1-49a1-a8da-ccabf664159c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:10.605507 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbd22b-48f1-49a1-a8da-ccabf664159c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:10.606224 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbd22b-48f1-49a1-a8da-ccabf664159c None admin] RBAC: Adding query filter params (role.id=9d89ffc8145c487f80034d6daaf2f771, scope.project.id=1f8d2f2bddb7409bb80d51b644ee1f01, user.id=fd558ff5bcc840c5a08aca52b6ac46d7) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:10.606527 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbd22b-48f1-49a1-a8da-ccabf664159c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:10.608102 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbd22b-48f1-49a1-a8da-ccabf664159c None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:10.613902 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 68/141] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:00:10 2022] GET /identity/v3/role_assignments?user.id=fd558ff5bcc840c5a08aca52b6ac46d7&scope.project.id=1f8d2f2bddb7409bb80d51b644ee1f01&role.id=9d89ffc8145c487f80034d6daaf2f771 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:11.807572 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21d51d-65b1-492f-b26e-e5091b90e8d1 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:11.808102 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21d51d-65b1-492f-b26e-e5091b90e8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:11.808102 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21d51d-65b1-492f-b26e-e5091b90e8d1 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:11.809502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 74/142] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:11.816256 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735f21e-d1bc-42f1-af0e-1e7cc8c525d6 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:11.816723 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735f21e-d1bc-42f1-af0e-1e7cc8c525d6 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:11.817191 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735f21e-d1bc-42f1-af0e-1e7cc8c525d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:11.840557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-a735f21e-d1bc-42f1-af0e-1e7cc8c525d6 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:11.841742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a735f21e-d1bc-42f1-af0e-1e7cc8c525d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:11.915134 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 69/143] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:12.096261 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af527ab5-7083-4e23-a1ad-33d7d54f5159 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:12.096558 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af527ab5-7083-4e23-a1ad-33d7d54f5159 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:12.096741 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af527ab5-7083-4e23-a1ad-33d7d54f5159 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:12.098239 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 75/144] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:12.104844 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b727716-8a26-463b-b914-8bcd75ba1214 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:12.105133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b727716-8a26-463b-b914-8bcd75ba1214 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:12.105407 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b727716-8a26-463b-b914-8bcd75ba1214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:12.124096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-8b727716-8a26-463b-b914-8bcd75ba1214 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:12.125271 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8b727716-8a26-463b-b914-8bcd75ba1214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:12.152956 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2178980-b993-44e5-b880-eb81e702923b None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:12.153275 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2178980-b993-44e5-b880-eb81e702923b None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:12.153520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2178980-b993-44e5-b880-eb81e702923b None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:12.154866 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 76/145] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:00:12.159682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427307af-9cad-48e3-9f6b-b68437619044 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:12.159968 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427307af-9cad-48e3-9f6b-b68437619044 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:12.160246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427307af-9cad-48e3-9f6b-b68437619044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:12.177038 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:12.180764 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-427307af-9cad-48e3-9f6b-b68437619044 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:12.182410 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-427307af-9cad-48e3-9f6b-b68437619044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:12.198326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 70/146] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:12.198326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b727716-8a26-463b-b914-8bcd75ba1214 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:12.252706 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 77/147] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:00:12.304847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b727716-8a26-463b-b914-8bcd75ba1214 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:12.340033 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c8477-f72c-4ed6-9a6a-2e808941f45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:12.340669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c8477-f72c-4ed6-9a6a-2e808941f45b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:12.340952 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c8477-f72c-4ed6-9a6a-2e808941f45b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:12.341229 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c8477-f72c-4ed6-9a6a-2e808941f45b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:12.352147 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c8477-f72c-4ed6-9a6a-2e808941f45b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:12.356974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-041c8477-f72c-4ed6-9a6a-2e808941f45b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:00:12.356974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:12.356974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:12.356974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:12.356974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:12.356974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:12.356974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:12.356974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:12.356974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:12.356974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:12.356974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:12.356974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:12.356974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:12.356974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:12.356974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:12.356974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:12.357862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:12.357862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:12.357862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:12.357862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:12.357862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:12.357862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:12.357862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:12.357862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:12.357862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:12.357862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:12.357862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:12.357862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:12.357862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:12.357862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:12.357862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:12.357862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:12.358674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:12.358674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:12.358674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:12.358674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:12.358674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:12.358674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:12.358674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:12.358674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:12.358674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:12.358674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:12.358674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:00:12.358674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:12.358674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 71/148] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 24 13:00:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:12.363933 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427307af-9cad-48e3-9f6b-b68437619044 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:12.400534 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:12.468827 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c8477-f72c-4ed6-9a6a-2e808941f45b None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:12.469331 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427307af-9cad-48e3-9f6b-b68437619044 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:12.507884 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a5ebc-7801-4ae6-8aac-beb7e524c8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:12.508496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a5ebc-7801-4ae6-8aac-beb7e524c8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:12.508774 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a5ebc-7801-4ae6-8aac-beb7e524c8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:12.509047 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a5ebc-7801-4ae6-8aac-beb7e524c8b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:12.509705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a5ebc-7801-4ae6-8aac-beb7e524c8b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:12.510005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a5ebc-7801-4ae6-8aac-beb7e524c8b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:12.511401 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a5ebc-7801-4ae6-8aac-beb7e524c8b2 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:12.520276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 78/149] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:12.526672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a5ebc-7801-4ae6-8aac-beb7e524c8b2 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:12.530036 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:12.584937 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c8477-f72c-4ed6-9a6a-2e808941f45b None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:12.619175 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e07098-356a-40ce-9cfc-2792516826d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:12.619764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e07098-356a-40ce-9cfc-2792516826d1 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:12.620048 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e07098-356a-40ce-9cfc-2792516826d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:12.620322 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e07098-356a-40ce-9cfc-2792516826d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:12.621416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e07098-356a-40ce-9cfc-2792516826d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:12.622509 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:12.622874 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e07098-356a-40ce-9cfc-2792516826d1 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:12.624459 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 72/150] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:12.627620 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e07098-356a-40ce-9cfc-2792516826d1 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:12.628713 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a5ebc-7801-4ae6-8aac-beb7e524c8b2 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:12.661660 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fee82e-e84c-4a76-b2e2-a9d5557b3488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:12.662277 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fee82e-e84c-4a76-b2e2-a9d5557b3488 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:12.662552 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fee82e-e84c-4a76-b2e2-a9d5557b3488 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:12.662820 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fee82e-e84c-4a76-b2e2-a9d5557b3488 None admin] PATH_INFO: `/v3/users/670a3ab2fe514c1daf3b2dc7f5d90990` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:12.676587 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fee82e-e84c-4a76-b2e2-a9d5557b3488 None admin] RBAC: Authorizing `identity:get_user(user_id=670a3ab2fe514c1daf3b2dc7f5d90990)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:12.678061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fee82e-e84c-4a76-b2e2-a9d5557b3488 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:12.680017 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 79/151] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:00:12 2022] GET /identity/v3/users/670a3ab2fe514c1daf3b2dc7f5d90990 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:12.680758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fee82e-e84c-4a76-b2e2-a9d5557b3488 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:12.728793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e07098-356a-40ce-9cfc-2792516826d1 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:12.741482 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:12.762683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585e2be-4b7a-4d55-8d5d-10e69dc94b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:12.763311 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585e2be-4b7a-4d55-8d5d-10e69dc94b2d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:12.763615 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585e2be-4b7a-4d55-8d5d-10e69dc94b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:12.763890 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585e2be-4b7a-4d55-8d5d-10e69dc94b2d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:12.781580 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585e2be-4b7a-4d55-8d5d-10e69dc94b2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:12.783642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fee82e-e84c-4a76-b2e2-a9d5557b3488 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:12.786516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-6585e2be-4b7a-4d55-8d5d-10e69dc94b2d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:00:12.786516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:12.786516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:12.786516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:12.786516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:12.786516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:12.786516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:12.786516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:12.786516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:12.786516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:12.786516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:12.786516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:12.786516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:12.786516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:12.786516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:12.786516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:12.787547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:12.787547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:12.787547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:12.787547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:12.787547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:12.787547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:12.787547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:12.787547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:12.787547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:12.787547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:12.787547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:12.787547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:12.787547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:12.787547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:12.787547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:12.787547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:12.789182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:12.789182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:12.789182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:12.789182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:12.789182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:12.789182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:12.789182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:12.789182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:12.789182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:12.789182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:12.789182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:00:12.789182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:12.789182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 73/152] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 24 13:00:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:12.789182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585e2be-4b7a-4d55-8d5d-10e69dc94b2d None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:12.817598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8a34c-92e6-4992-b854-78ab2a558eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:12.818194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8a34c-92e6-4992-b854-78ab2a558eaa None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:12.818476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8a34c-92e6-4992-b854-78ab2a558eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:12.818743 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8a34c-92e6-4992-b854-78ab2a558eaa None admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:12.819411 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8a34c-92e6-4992-b854-78ab2a558eaa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:12.821036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8a34c-92e6-4992-b854-78ab2a558eaa None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:12.844329 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 80/153] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 24 13:00:12 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:00:12.845134 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8a34c-92e6-4992-b854-78ab2a558eaa None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:12.859203 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:12.910922 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585e2be-4b7a-4d55-8d5d-10e69dc94b2d None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:12.952601 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f6c23-1aa3-4b02-8891-32564711a25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:12.953366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f6c23-1aa3-4b02-8891-32564711a25d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:12.953568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f6c23-1aa3-4b02-8891-32564711a25d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:12.953844 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f6c23-1aa3-4b02-8891-32564711a25d None admin] PATH_INFO: `/v3/projects/a40f8a0ec4334236ab27bfadc581d177` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:12.955075 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f6c23-1aa3-4b02-8891-32564711a25d None admin] RBAC: Authorizing `identity:get_project(project_id=a40f8a0ec4334236ab27bfadc581d177)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:12.956403 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8a34c-92e6-4992-b854-78ab2a558eaa None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:12.956586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f6c23-1aa3-4b02-8891-32564711a25d None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:12.958587 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 74/154] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:00:12 2022] GET /identity/v3/projects/a40f8a0ec4334236ab27bfadc581d177 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:12.965063 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f6c23-1aa3-4b02-8891-32564711a25d None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:12.995354 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432bb31-0760-4511-8fe3-9ba4c5737a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:12.995998 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432bb31-0760-4511-8fe3-9ba4c5737a9c None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:12.996289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432bb31-0760-4511-8fe3-9ba4c5737a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:12.996581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432bb31-0760-4511-8fe3-9ba4c5737a9c None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:12.997248 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432bb31-0760-4511-8fe3-9ba4c5737a9c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:12.997547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432bb31-0760-4511-8fe3-9ba4c5737a9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:12.999085 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432bb31-0760-4511-8fe3-9ba4c5737a9c None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:13.008601 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 81/155] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:13.011740 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:13.016471 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432bb31-0760-4511-8fe3-9ba4c5737a9c None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:13.084781 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f6c23-1aa3-4b02-8891-32564711a25d None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:13.097206 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:13.129520 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ae472-11e5-4136-808e-75ba2a402f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:13.130187 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ae472-11e5-4136-808e-75ba2a402f9d None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:13.130470 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ae472-11e5-4136-808e-75ba2a402f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:13.130747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ae472-11e5-4136-808e-75ba2a402f9d None admin] PATH_INFO: `/v3/projects/a40f8a0ec4334236ab27bfadc581d177/users/670a3ab2fe514c1daf3b2dc7f5d90990/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:13.133277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ae472-11e5-4136-808e-75ba2a402f9d None admin] RBAC: Authorizing `identity:create_grant(project_id=a40f8a0ec4334236ab27bfadc581d177, user_id=670a3ab2fe514c1daf3b2dc7f5d90990, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:13.135271 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ae472-11e5-4136-808e-75ba2a402f9d None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:13.137669 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432bb31-0760-4511-8fe3-9ba4c5737a9c None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:13.154919 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 75/156] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 13:00:12 2022] PUT /identity/v3/projects/a40f8a0ec4334236ab27bfadc581d177/users/670a3ab2fe514c1daf3b2dc7f5d90990/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:00:13.182444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18ac85-3cd1-49f8-9fb4-c4c90910c239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:13.183030 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18ac85-3cd1-49f8-9fb4-c4c90910c239 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:13.183493 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18ac85-3cd1-49f8-9fb4-c4c90910c239 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:13.185032 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18ac85-3cd1-49f8-9fb4-c4c90910c239 None admin] PATH_INFO: `/v3/users/670a3ab2fe514c1daf3b2dc7f5d90990` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:13.186119 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18ac85-3cd1-49f8-9fb4-c4c90910c239 None admin] RBAC: Authorizing `identity:get_user(user_id=670a3ab2fe514c1daf3b2dc7f5d90990)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:13.188193 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18ac85-3cd1-49f8-9fb4-c4c90910c239 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:13.189581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 82/157] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:00:13 2022] GET /identity/v3/users/670a3ab2fe514c1daf3b2dc7f5d90990 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:13.196029 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ae472-11e5-4136-808e-75ba2a402f9d None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:13.315910 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:13.321243 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ae472-11e5-4136-808e-75ba2a402f9d None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:13.365887 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb34deb-deb8-49c1-8309-60abd9e29bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:13.367077 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb34deb-deb8-49c1-8309-60abd9e29bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:13.367353 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb34deb-deb8-49c1-8309-60abd9e29bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:13.367666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb34deb-deb8-49c1-8309-60abd9e29bd5 None admin] PATH_INFO: `/v3/projects/a40f8a0ec4334236ab27bfadc581d177` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:13.368792 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb34deb-deb8-49c1-8309-60abd9e29bd5 None admin] RBAC: Authorizing `identity:get_project(project_id=a40f8a0ec4334236ab27bfadc581d177)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:13.370234 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb34deb-deb8-49c1-8309-60abd9e29bd5 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:13.371893 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 76/158] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:00:13 2022] GET /identity/v3/projects/a40f8a0ec4334236ab27bfadc581d177 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:13.378755 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18ac85-3cd1-49f8-9fb4-c4c90910c239 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:13.489224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18ac85-3cd1-49f8-9fb4-c4c90910c239 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:13.526485 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccf66d-9f5b-49bb-9989-93ac099a4211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:13.527196 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccf66d-9f5b-49bb-9989-93ac099a4211 None admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:13.527510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccf66d-9f5b-49bb-9989-93ac099a4211 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:13.527784 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccf66d-9f5b-49bb-9989-93ac099a4211 None admin] PATH_INFO: `/v3/projects/a40f8a0ec4334236ab27bfadc581d177/users/670a3ab2fe514c1daf3b2dc7f5d90990/roles/4bcba8c3ff16483b9115020b5b886522` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:13.530006 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fccf66d-9f5b-49bb-9989-93ac099a4211 None admin] RBAC: Authorizing `identity:create_grant(project_id=a40f8a0ec4334236ab27bfadc581d177, user_id=670a3ab2fe514c1daf3b2dc7f5d90990, role_id=4bcba8c3ff16483b9115020b5b886522)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:13.531561 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fccf66d-9f5b-49bb-9989-93ac099a4211 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:13.545311 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:13.550978 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 83/159] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 13:00:13 2022] PUT /identity/v3/projects/a40f8a0ec4334236ab27bfadc581d177/users/670a3ab2fe514c1daf3b2dc7f5d90990/roles/4bcba8c3ff16483b9115020b5b886522 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:15.158288 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549730d3-a72f-49be-b96a-1a478c803962 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:15.158836 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549730d3-a72f-49be-b96a-1a478c803962 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:15.158836 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549730d3-a72f-49be-b96a-1a478c803962 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:15.160345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 77/160] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:15.166187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e96e2a-ea3f-4fc8-853a-398d9311a116 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:15.166621 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e96e2a-ea3f-4fc8-853a-398d9311a116 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:15.166724 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e96e2a-ea3f-4fc8-853a-398d9311a116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:15.185695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-d9e96e2a-ea3f-4fc8-853a-398d9311a116 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:15.186881 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d9e96e2a-ea3f-4fc8-853a-398d9311a116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:15.262862 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 84/161] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:15.337986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17948d48-d9bc-4670-a909-86f4d4746ad4 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:15.338328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17948d48-d9bc-4670-a909-86f4d4746ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:15.338546 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17948d48-d9bc-4670-a909-86f4d4746ad4 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:15.340104 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 78/162] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:15.349572 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5379d64-8aba-4d4c-b212-9858b2a94428 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:15.349572 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5379d64-8aba-4d4c-b212-9858b2a94428 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:15.349572 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5379d64-8aba-4d4c-b212-9858b2a94428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:15.368861 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-c5379d64-8aba-4d4c-b212-9858b2a94428 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:15.370123 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-c5379d64-8aba-4d4c-b212-9858b2a94428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:15.439954 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 85/163] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:15.440763 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54dad0-1cd7-4106-b65a-e986ff00ca63 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:15.441043 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54dad0-1cd7-4106-b65a-e986ff00ca63 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:15.441313 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54dad0-1cd7-4106-b65a-e986ff00ca63 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:15.442747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 79/164] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:15.448804 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab577969-0b0c-4f0b-b615-0f2d75564ad5 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:15.449091 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab577969-0b0c-4f0b-b615-0f2d75564ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:15.449420 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab577969-0b0c-4f0b-b615-0f2d75564ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:15.467960 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-ab577969-0b0c-4f0b-b615-0f2d75564ad5 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:15.469135 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-ab577969-0b0c-4f0b-b615-0f2d75564ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:15.527743 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:15.540069 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 86/165] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:15.573316 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54dad0-1cd7-4106-b65a-e986ff00ca63 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:15.682125 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54dad0-1cd7-4106-b65a-e986ff00ca63 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:15.718976 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093e883-d958-48b3-8e18-d8da3fc1b8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:15.719560 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093e883-d958-48b3-8e18-d8da3fc1b8fa None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:15.719889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093e883-d958-48b3-8e18-d8da3fc1b8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:15.720210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093e883-d958-48b3-8e18-d8da3fc1b8fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:15.720988 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab577969-0b0c-4f0b-b615-0f2d75564ad5 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:15.732865 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093e883-d958-48b3-8e18-d8da3fc1b8fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:15.738214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-1093e883-d958-48b3-8e18-d8da3fc1b8fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:00:15.738214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:15.738214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:15.738214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:15.738214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:15.738214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:15.738214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:15.738214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:15.738214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:15.738214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:15.738214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:15.738214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:15.738214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:15.738214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:15.738214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:15.738214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:15.739099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:15.739099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:15.739099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:15.739099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:15.739099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:15.739099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:15.739099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:15.739099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:15.739099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:15.739099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:15.739099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:15.739099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:15.739099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:15.739099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:15.739099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:15.739099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:15.739931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:15.739931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:15.739931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:15.739931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:15.739931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:15.739931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:15.739931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:15.739931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:15.739931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:15.739931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:15.739931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:00:15.739931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:15.739931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 80/166] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:15.747177 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093e883-d958-48b3-8e18-d8da3fc1b8fa None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:15.778553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:15.843988 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab577969-0b0c-4f0b-b615-0f2d75564ad5 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:15.854046 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093e883-d958-48b3-8e18-d8da3fc1b8fa None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:15.878142 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa011e-2dce-4164-8716-9583e45accb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:15.878766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa011e-2dce-4164-8716-9583e45accb5 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:15.879037 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa011e-2dce-4164-8716-9583e45accb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:15.879300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa011e-2dce-4164-8716-9583e45accb5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:15.880409 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa011e-2dce-4164-8716-9583e45accb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:15.881853 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa011e-2dce-4164-8716-9583e45accb5 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:15.884337 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 87/167] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:15.885434 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca016e-ceab-43a9-bcaa-3864a4d20c96 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:15.885710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca016e-ceab-43a9-bcaa-3864a4d20c96 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:15.885978 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca016e-ceab-43a9-bcaa-3864a4d20c96 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:15.887165 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 88/168] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:15.889430 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca016e-ceab-43a9-bcaa-3864a4d20c96 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:15.891820 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55629985-ddbe-4325-a0d5-f6c18ed2b692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:15.892442 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55629985-ddbe-4325-a0d5-f6c18ed2b692 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:15.892720 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55629985-ddbe-4325-a0d5-f6c18ed2b692 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:15.892991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55629985-ddbe-4325-a0d5-f6c18ed2b692 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:15.893659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55629985-ddbe-4325-a0d5-f6c18ed2b692 None admin] RBAC: Adding query filter params (name=member) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:15.893960 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55629985-ddbe-4325-a0d5-f6c18ed2b692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:15.895349 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55629985-ddbe-4325-a0d5-f6c18ed2b692 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:15.903601 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 81/169] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 24 13:00:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:15.904357 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55629985-ddbe-4325-a0d5-f6c18ed2b692 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:15.951967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:15.994430 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:15.995244 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca016e-ceab-43a9-bcaa-3864a4d20c96 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:16.004224 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55629985-ddbe-4325-a0d5-f6c18ed2b692 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:16.027959 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a59e80-c295-4da3-a5c3-f0b6bdde9e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:16.028582 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a59e80-c295-4da3-a5c3-f0b6bdde9e0e None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:16.028869 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a59e80-c295-4da3-a5c3-f0b6bdde9e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:16.029136 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a59e80-c295-4da3-a5c3-f0b6bdde9e0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:16.037498 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831c577-1e9d-4a58-8b0b-44d024fbf2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:16.038098 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831c577-1e9d-4a58-8b0b-44d024fbf2eb None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:16.038978 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831c577-1e9d-4a58-8b0b-44d024fbf2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:16.039247 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831c577-1e9d-4a58-8b0b-44d024fbf2eb None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:16.039654 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a59e80-c295-4da3-a5c3-f0b6bdde9e0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:16.039986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831c577-1e9d-4a58-8b0b-44d024fbf2eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:16.041421 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831c577-1e9d-4a58-8b0b-44d024fbf2eb None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:16.044548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-b0a59e80-c295-4da3-a5c3-f0b6bdde9e0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:00:16.044548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:16.044548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:16.044548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:16.044548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:16.044548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:16.044548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:16.044548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:16.044548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:16.044548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:16.044548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:16.044548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:16.044548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:16.044548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:16.044548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:16.044548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:16.045597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:16.045597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:16.045597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:16.045597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:16.045597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:16.045597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:16.045597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:16.045597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:16.045597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:16.045597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:16.045597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:16.045597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:16.045597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:16.045597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:16.045597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:16.045597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:16.048322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:16.048322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:16.048322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:16.048322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:16.048322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:16.048322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:16.048322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:16.048322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:16.048322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:16.048322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:16.048322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:00:16.048322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:16.048322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 89/170] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 24 13:00:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:16.048322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664be51-c070-4bcc-abd2-de66f7d027f2 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:16.049039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664be51-c070-4bcc-abd2-de66f7d027f2 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:16.049039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664be51-c070-4bcc-abd2-de66f7d027f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:16.062833 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 82/171] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 24 13:00:15 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:00:16.063976 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831c577-1e9d-4a58-8b0b-44d024fbf2eb None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:16.066416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-6664be51-c070-4bcc-abd2-de66f7d027f2 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:16.067663 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-6664be51-c070-4bcc-abd2-de66f7d027f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:16.146044 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 90/172] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:16.147281 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664be51-c070-4bcc-abd2-de66f7d027f2 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:16.189883 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831c577-1e9d-4a58-8b0b-44d024fbf2eb None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:16.217199 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:16.235666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0963211-26aa-415e-95dd-8e8b51f6614e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:16.236635 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0963211-26aa-415e-95dd-8e8b51f6614e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:16.237081 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0963211-26aa-415e-95dd-8e8b51f6614e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:16.237501 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0963211-26aa-415e-95dd-8e8b51f6614e None admin] PATH_INFO: `/v3/users/d1f578182bca48e38ce2b2105d17d4bc` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:16.255205 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0963211-26aa-415e-95dd-8e8b51f6614e None admin] RBAC: Authorizing `identity:get_user(user_id=d1f578182bca48e38ce2b2105d17d4bc)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:16.256975 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0963211-26aa-415e-95dd-8e8b51f6614e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:16.260750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 83/173] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:00:16 2022] GET /identity/v3/users/d1f578182bca48e38ce2b2105d17d4bc => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:16.266342 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0963211-26aa-415e-95dd-8e8b51f6614e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:16.271337 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:16.283326 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664be51-c070-4bcc-abd2-de66f7d027f2 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:16.323792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc90d9-b15e-4694-bf91-9b25bb807a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:16.324459 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc90d9-b15e-4694-bf91-9b25bb807a6b None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:16.324738 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc90d9-b15e-4694-bf91-9b25bb807a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:16.325007 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc90d9-b15e-4694-bf91-9b25bb807a6b None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:16.325671 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc90d9-b15e-4694-bf91-9b25bb807a6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:16.325969 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc90d9-b15e-4694-bf91-9b25bb807a6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:16.327353 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc90d9-b15e-4694-bf91-9b25bb807a6b None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:16.343925 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 91/174] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:16.356445 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc90d9-b15e-4694-bf91-9b25bb807a6b None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:16.405879 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0963211-26aa-415e-95dd-8e8b51f6614e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:16.451549 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd173965-76d6-445e-8c07-4d2658986e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:16.452194 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd173965-76d6-445e-8c07-4d2658986e3d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:16.452467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd173965-76d6-445e-8c07-4d2658986e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:16.452732 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd173965-76d6-445e-8c07-4d2658986e3d None admin] PATH_INFO: `/v3/projects/a40f8a0ec4334236ab27bfadc581d177` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:16.453879 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd173965-76d6-445e-8c07-4d2658986e3d None admin] RBAC: Authorizing `identity:get_project(project_id=a40f8a0ec4334236ab27bfadc581d177)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:16.455339 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd173965-76d6-445e-8c07-4d2658986e3d None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:16.457001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 84/175] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:00:16 2022] GET /identity/v3/projects/a40f8a0ec4334236ab27bfadc581d177 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:16.457761 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd173965-76d6-445e-8c07-4d2658986e3d None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:16.478594 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc90d9-b15e-4694-bf91-9b25bb807a6b None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:16.493700 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:16.526756 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826171d-1c64-44ba-a7f5-11a23a08e72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:16.528074 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826171d-1c64-44ba-a7f5-11a23a08e72e None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:16.528957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826171d-1c64-44ba-a7f5-11a23a08e72e None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:16.529714 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826171d-1c64-44ba-a7f5-11a23a08e72e None admin] PATH_INFO: `/v3/users/670a3ab2fe514c1daf3b2dc7f5d90990` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:16.531719 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826171d-1c64-44ba-a7f5-11a23a08e72e None admin] RBAC: Authorizing `identity:get_user(user_id=670a3ab2fe514c1daf3b2dc7f5d90990)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:16.533783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826171d-1c64-44ba-a7f5-11a23a08e72e None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:16.535969 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 92/176] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:00:16 2022] GET /identity/v3/users/670a3ab2fe514c1daf3b2dc7f5d90990 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:16.536978 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826171d-1c64-44ba-a7f5-11a23a08e72e None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:16.546199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:16.584720 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd173965-76d6-445e-8c07-4d2658986e3d None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:16.625168 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcbacb-6daf-4934-82a8-72a7e4de9cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:16.625799 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcbacb-6daf-4934-82a8-72a7e4de9cda None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:16.626071 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcbacb-6daf-4934-82a8-72a7e4de9cda None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:16.626339 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcbacb-6daf-4934-82a8-72a7e4de9cda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:16.639359 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcbacb-6daf-4934-82a8-72a7e4de9cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:16.645614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-e6dcbacb-6daf-4934-82a8-72a7e4de9cda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:00:16.645614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:16.645614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:16.645614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:16.645614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:16.645614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:16.645614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:16.645614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:16.645614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:16.645614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:16.645614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:16.645614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:16.645614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:16.645614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:16.645614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:16.645614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:16.646518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:16.646518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:16.646518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:16.646518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:16.646518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:16.646518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:16.646518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:16.646518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:16.646518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:16.646518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:16.646518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:16.646518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:16.646518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:16.646518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:16.646518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:16.646518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:16.647308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:16.647308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:16.647308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:16.647308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:16.647308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:16.647308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:16.647308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:16.647308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:16.647308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:16.647308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:16.647308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:00:16.647308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:16.647308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 85/177] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 24 13:00:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:16.648176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcbacb-6daf-4934-82a8-72a7e4de9cda None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:16.666444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826171d-1c64-44ba-a7f5-11a23a08e72e None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:16.705776 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1b586-605b-4d21-85ec-36e31bdd0738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:16.706826 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1b586-605b-4d21-85ec-36e31bdd0738 None admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:16.707371 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1b586-605b-4d21-85ec-36e31bdd0738 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:16.707861 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1b586-605b-4d21-85ec-36e31bdd0738 None admin] PATH_INFO: `/v3/projects/a40f8a0ec4334236ab27bfadc581d177/users/d1f578182bca48e38ce2b2105d17d4bc/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:16.710461 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1b586-605b-4d21-85ec-36e31bdd0738 None admin] RBAC: Authorizing `identity:create_grant(project_id=a40f8a0ec4334236ab27bfadc581d177, user_id=d1f578182bca48e38ce2b2105d17d4bc, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:16.712336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1b586-605b-4d21-85ec-36e31bdd0738 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:16.730134 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 93/178] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 13:00:16 2022] PUT /identity/v3/projects/a40f8a0ec4334236ab27bfadc581d177/users/d1f578182bca48e38ce2b2105d17d4bc/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:16.731293 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1b586-605b-4d21-85ec-36e31bdd0738 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:16.764857 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcbacb-6daf-4934-82a8-72a7e4de9cda None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:16.794744 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:16.807543 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:16.816182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cb60b-2dc1-4dd4-815f-624664c9c932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:16.817249 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cb60b-2dc1-4dd4-815f-624664c9c932 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:16.817880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cb60b-2dc1-4dd4-815f-624664c9c932 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:16.818352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cb60b-2dc1-4dd4-815f-624664c9c932 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:16.874684 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1b586-605b-4d21-85ec-36e31bdd0738 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:16.914071 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e852d-2f50-4a55-9678-1dd4d0025f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:16.914721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e852d-2f50-4a55-9678-1dd4d0025f9e None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:16.914828 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e852d-2f50-4a55-9678-1dd4d0025f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:16.915075 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e852d-2f50-4a55-9678-1dd4d0025f9e None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:16.915842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e852d-2f50-4a55-9678-1dd4d0025f9e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:16.916127 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e852d-2f50-4a55-9678-1dd4d0025f9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:16.917578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e852d-2f50-4a55-9678-1dd4d0025f9e None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:16.923907 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7cb60b-2dc1-4dd4-815f-624664c9c932 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:16.925948 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7cb60b-2dc1-4dd4-815f-624664c9c932 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:16.926610 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 94/179] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:16.948175 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e852d-2f50-4a55-9678-1dd4d0025f9e None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:17.063823 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 86/180] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:00:17.070026 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cb60b-2dc1-4dd4-815f-624664c9c932 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:17.097104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:17.100270 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e852d-2f50-4a55-9678-1dd4d0025f9e None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:17.114984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:17.139826 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c927b-db87-4836-984c-e6c15b86bd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:17.140633 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c927b-db87-4836-984c-e6c15b86bd92 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:17.141095 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c927b-db87-4836-984c-e6c15b86bd92 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:17.141476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c927b-db87-4836-984c-e6c15b86bd92 None admin] PATH_INFO: `/v3/users/670a3ab2fe514c1daf3b2dc7f5d90990` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:17.143008 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c927b-db87-4836-984c-e6c15b86bd92 None admin] RBAC: Authorizing `identity:get_user(user_id=670a3ab2fe514c1daf3b2dc7f5d90990)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:17.144694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c927b-db87-4836-984c-e6c15b86bd92 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:17.150742 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 95/181] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:00:16 2022] GET /identity/v3/users/670a3ab2fe514c1daf3b2dc7f5d90990 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:17.153022 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c927b-db87-4836-984c-e6c15b86bd92 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:17.213250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cb60b-2dc1-4dd4-815f-624664c9c932 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:17.252167 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7f73a-eeef-4e92-b1f4-1fa5692709fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:17.252823 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7f73a-eeef-4e92-b1f4-1fa5692709fd None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:17.253095 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7f73a-eeef-4e92-b1f4-1fa5692709fd None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:17.253361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7f73a-eeef-4e92-b1f4-1fa5692709fd None admin] PATH_INFO: `/v3/projects/a40f8a0ec4334236ab27bfadc581d177` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:17.258379 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7f73a-eeef-4e92-b1f4-1fa5692709fd None admin] RBAC: Authorizing `identity:get_project(project_id=a40f8a0ec4334236ab27bfadc581d177)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:17.259925 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7f73a-eeef-4e92-b1f4-1fa5692709fd None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:17.263498 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 87/182] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:00:17 2022] GET /identity/v3/projects/a40f8a0ec4334236ab27bfadc581d177 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:17.269096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7f73a-eeef-4e92-b1f4-1fa5692709fd None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:17.344588 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c927b-db87-4836-984c-e6c15b86bd92 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:17.412494 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78eea0-0502-432d-8de2-2d05926ac3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:17.413103 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78eea0-0502-432d-8de2-2d05926ac3c4 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:17.413963 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78eea0-0502-432d-8de2-2d05926ac3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:17.414243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78eea0-0502-432d-8de2-2d05926ac3c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:17.453931 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:17.475829 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:17.482222 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7f73a-eeef-4e92-b1f4-1fa5692709fd None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:17.493975 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78eea0-0502-432d-8de2-2d05926ac3c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:17.495488 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78eea0-0502-432d-8de2-2d05926ac3c4 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:17.558716 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e275e4-2256-4d96-9765-75dd455196ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:17.559337 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e275e4-2256-4d96-9765-75dd455196ca None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:17.560000 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e275e4-2256-4d96-9765-75dd455196ca None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:17.560280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e275e4-2256-4d96-9765-75dd455196ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:17.561616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e275e4-2256-4d96-9765-75dd455196ca None admin] RBAC: Adding query filter params (role.id=23ca6ecd60b2470cba913daeaf54f0f7, scope.project.id=a40f8a0ec4334236ab27bfadc581d177, user.id=670a3ab2fe514c1daf3b2dc7f5d90990) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:17.561923 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e275e4-2256-4d96-9765-75dd455196ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:17.563370 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e275e4-2256-4d96-9765-75dd455196ca None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:17.577197 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 88/183] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:00:17 2022] GET /identity/v3/role_assignments?user.id=670a3ab2fe514c1daf3b2dc7f5d90990&scope.project.id=a40f8a0ec4334236ab27bfadc581d177&role.id=23ca6ecd60b2470cba913daeaf54f0f7 => generated 608 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:17.669380 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 96/184] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:00:17.674789 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e275e4-2256-4d96-9765-75dd455196ca None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:17.788358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e275e4-2256-4d96-9765-75dd455196ca None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:17.826089 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ea7a0-56fa-4c6a-93aa-30001c69658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:17.826736 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ea7a0-56fa-4c6a-93aa-30001c69658d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:17.827016 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ea7a0-56fa-4c6a-93aa-30001c69658d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:17.827285 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ea7a0-56fa-4c6a-93aa-30001c69658d None admin] PATH_INFO: `/v3/projects/a40f8a0ec4334236ab27bfadc581d177` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:17.828439 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ea7a0-56fa-4c6a-93aa-30001c69658d None admin] RBAC: Authorizing `identity:get_project(project_id=a40f8a0ec4334236ab27bfadc581d177)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:17.829950 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ea7a0-56fa-4c6a-93aa-30001c69658d None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:17.831768 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 89/185] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:00:17 2022] GET /identity/v3/projects/a40f8a0ec4334236ab27bfadc581d177 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:17.837917 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78eea0-0502-432d-8de2-2d05926ac3c4 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:17.908234 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:17.945366 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78eea0-0502-432d-8de2-2d05926ac3c4 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:17.981241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab85080-7dff-441c-951c-f5c0cf9ddac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:17.981842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab85080-7dff-441c-951c-f5c0cf9ddac7 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:17.982159 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab85080-7dff-441c-951c-f5c0cf9ddac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:17.982431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab85080-7dff-441c-951c-f5c0cf9ddac7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:17.983147 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab85080-7dff-441c-951c-f5c0cf9ddac7 None admin] RBAC: Adding query filter params (role.id=4bcba8c3ff16483b9115020b5b886522, scope.project.id=a40f8a0ec4334236ab27bfadc581d177, user.id=670a3ab2fe514c1daf3b2dc7f5d90990) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:17.983469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab85080-7dff-441c-951c-f5c0cf9ddac7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:17.984931 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab85080-7dff-441c-951c-f5c0cf9ddac7 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:17.991126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 97/186] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:00:17 2022] GET /identity/v3/role_assignments?user.id=670a3ab2fe514c1daf3b2dc7f5d90990&scope.project.id=a40f8a0ec4334236ab27bfadc581d177&role.id=4bcba8c3ff16483b9115020b5b886522 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:18.646737 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930967a4-6384-42e5-a6ee-376850ef92a4 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:18.647250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930967a4-6384-42e5-a6ee-376850ef92a4 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:18.647250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930967a4-6384-42e5-a6ee-376850ef92a4 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:18.649326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 90/187] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:18.654495 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df92287-273e-43b5-a990-af83bc2426c0 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:18.654910 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df92287-273e-43b5-a990-af83bc2426c0 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:18.655072 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df92287-273e-43b5-a990-af83bc2426c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:18.673743 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-1df92287-273e-43b5-a990-af83bc2426c0 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:18.674917 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-1df92287-273e-43b5-a990-af83bc2426c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:18.737611 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ba82e-a732-4d88-b06d-18d31d55cbbe None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:18.737904 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ba82e-a732-4d88-b06d-18d31d55cbbe None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:18.738181 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ba82e-a732-4d88-b06d-18d31d55cbbe None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:18.740002 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 91/188] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:00:18.744878 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a782d-3e85-4d8f-ad04-952ac888d19b None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:18.745168 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a782d-3e85-4d8f-ad04-952ac888d19b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:18.745445 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a782d-3e85-4d8f-ad04-952ac888d19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:18.745541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 98/189] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:18.763601 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-912a782d-3e85-4d8f-ad04-952ac888d19b None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:18.764795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-912a782d-3e85-4d8f-ad04-952ac888d19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:18.792812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:18.836907 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 92/190] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:00:19.022081 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df92287-273e-43b5-a990-af83bc2426c0 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:19.084106 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:19.113711 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a782d-3e85-4d8f-ad04-952ac888d19b None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:19.127291 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df92287-273e-43b5-a990-af83bc2426c0 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:19.165608 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb7ba0-407c-4773-919d-9ffb072c79f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:19.166566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb7ba0-407c-4773-919d-9ffb072c79f3 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:19.167017 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb7ba0-407c-4773-919d-9ffb072c79f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:19.167600 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb7ba0-407c-4773-919d-9ffb072c79f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:19.168918 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb7ba0-407c-4773-919d-9ffb072c79f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:19.170541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb7ba0-407c-4773-919d-9ffb072c79f3 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:19.172435 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 99/191] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:19.178244 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb7ba0-407c-4773-919d-9ffb072c79f3 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:19.220878 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a782d-3e85-4d8f-ad04-952ac888d19b None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:19.256035 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d9e47-e1d1-47bc-b3f0-2da9cbdf6aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:19.256681 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d9e47-e1d1-47bc-b3f0-2da9cbdf6aac None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:19.256979 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d9e47-e1d1-47bc-b3f0-2da9cbdf6aac None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:19.257787 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d9e47-e1d1-47bc-b3f0-2da9cbdf6aac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:19.267901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d9e47-e1d1-47bc-b3f0-2da9cbdf6aac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:19.273367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-037d9e47-e1d1-47bc-b3f0-2da9cbdf6aac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:00:19.273367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:19.273367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:19.273367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:19.273367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:19.273367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:19.273367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:19.273367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:19.273367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:19.273367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:19.273367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:19.273367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:19.273367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:19.273367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:19.273367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:19.273367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:19.274623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:19.274623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:19.274623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:19.274623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:19.274623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:19.274623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:19.274623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:19.274623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:19.274623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:19.274623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:19.274623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:19.274623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:19.274623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:19.274623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:19.274623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:19.274623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:19.276003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:19.276003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:19.276003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:19.276003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:19.276003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:19.276003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:19.276003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:19.276003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:19.276003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:19.276003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:19.276003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:00:19.276003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:19.276003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 93/192] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:19.280176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d9e47-e1d1-47bc-b3f0-2da9cbdf6aac None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:19.295930 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb7ba0-407c-4773-919d-9ffb072c79f3 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:19.308512 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:19.325919 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:19.332802 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77855b1a-05f2-491c-aa66-ab9c0c92027d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:19.333417 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77855b1a-05f2-491c-aa66-ab9c0c92027d None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:19.333696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77855b1a-05f2-491c-aa66-ab9c0c92027d None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:19.334069 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77855b1a-05f2-491c-aa66-ab9c0c92027d None admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:19.334781 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77855b1a-05f2-491c-aa66-ab9c0c92027d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:19.336265 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77855b1a-05f2-491c-aa66-ab9c0c92027d None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:19.358408 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 100/193] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 24 13:00:19 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:00:19.359778 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4043944-d667-4ad6-afc6-5158f5d9b7c8 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:19.360067 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4043944-d667-4ad6-afc6-5158f5d9b7c8 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:19.360338 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4043944-d667-4ad6-afc6-5158f5d9b7c8 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:19.361732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 101/194] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:19.368089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46cf63-a4d2-48a9-b006-328bef0a55d5 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:19.368571 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46cf63-a4d2-48a9-b006-328bef0a55d5 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:19.369046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46cf63-a4d2-48a9-b006-328bef0a55d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:19.389086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-5f46cf63-a4d2-48a9-b006-328bef0a55d5 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:19.390299 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-5f46cf63-a4d2-48a9-b006-328bef0a55d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:19.398479 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d9e47-e1d1-47bc-b3f0-2da9cbdf6aac None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:19.440817 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e0faa-86d3-49f9-a744-e5f6d442e17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:19.441441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e0faa-86d3-49f9-a744-e5f6d442e17c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:19.441724 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e0faa-86d3-49f9-a744-e5f6d442e17c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:19.442001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e0faa-86d3-49f9-a744-e5f6d442e17c None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:19.442679 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e0faa-86d3-49f9-a744-e5f6d442e17c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:19.443098 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e0faa-86d3-49f9-a744-e5f6d442e17c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:19.445565 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e0faa-86d3-49f9-a744-e5f6d442e17c None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:19.461212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 94/195] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 24 13:00:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:19.462370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 102/196] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:00:19.462523 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e0faa-86d3-49f9-a744-e5f6d442e17c None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:19.561693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:19.579305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e0faa-86d3-49f9-a744-e5f6d442e17c None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:19.614872 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0ad1f-5218-439c-a737-a4e30b20b9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:19.615453 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0ad1f-5218-439c-a737-a4e30b20b9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:19.615745 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0ad1f-5218-439c-a737-a4e30b20b9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:19.616019 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0ad1f-5218-439c-a737-a4e30b20b9b1 None admin] PATH_INFO: `/v3/users/033cfc2596a048e992f8652ebfe016a2` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:19.629634 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0ad1f-5218-439c-a737-a4e30b20b9b1 None admin] RBAC: Authorizing `identity:get_user(user_id=033cfc2596a048e992f8652ebfe016a2)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:19.631126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0ad1f-5218-439c-a737-a4e30b20b9b1 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:19.633149 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 95/197] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:00:19 2022] GET /identity/v3/users/033cfc2596a048e992f8652ebfe016a2 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:19.638405 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46cf63-a4d2-48a9-b006-328bef0a55d5 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:19.732280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0ad1f-5218-439c-a737-a4e30b20b9b1 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:19.753021 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46cf63-a4d2-48a9-b006-328bef0a55d5 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:19.774784 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:19.797992 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e3bde-c662-4083-a990-964c36d48031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:19.799175 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e3bde-c662-4083-a990-964c36d48031 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:19.799480 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e3bde-c662-4083-a990-964c36d48031 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:19.800035 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e3bde-c662-4083-a990-964c36d48031 None admin] PATH_INFO: `/v3/projects/a40f8a0ec4334236ab27bfadc581d177` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:19.801400 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e3bde-c662-4083-a990-964c36d48031 None admin] RBAC: Authorizing `identity:get_project(project_id=a40f8a0ec4334236ab27bfadc581d177)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:19.803594 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e3bde-c662-4083-a990-964c36d48031 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:19.806321 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 103/198] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:00:19 2022] GET /identity/v3/projects/a40f8a0ec4334236ab27bfadc581d177 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:19.811896 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e3bde-c662-4083-a990-964c36d48031 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:19.849373 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0ad1f-5218-439c-a737-a4e30b20b9b1 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:19.890975 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9313cf4-fd1b-4f75-b604-5ba7438fd942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:19.891569 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9313cf4-fd1b-4f75-b604-5ba7438fd942 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:19.891852 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9313cf4-fd1b-4f75-b604-5ba7438fd942 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:19.892127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9313cf4-fd1b-4f75-b604-5ba7438fd942 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:19.906942 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9313cf4-fd1b-4f75-b604-5ba7438fd942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:19.912607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-f9313cf4-fd1b-4f75-b604-5ba7438fd942 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:00:19.912607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:19.912607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:19.912607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:19.912607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:19.912607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:19.912607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:19.912607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:19.912607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:19.912607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:19.912607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:19.912607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:19.912607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:19.912607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:19.912607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:19.912607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:19.914250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:19.914250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:19.914250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:19.914250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:19.914250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:19.914250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:19.914250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:19.914250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:19.914250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:19.914250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:19.914250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:19.914250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:19.914250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:19.914250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:19.914250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:19.914250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:19.915084 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:19.915084 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:19.915084 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:19.915084 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:19.915084 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:19.915084 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:19.915084 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:19.915084 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:19.915084 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:19.915084 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:19.915084 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:00:19.915084 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:19.915084 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 96/199] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:19.922244 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9313cf4-fd1b-4f75-b604-5ba7438fd942 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:19.926533 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:19.935392 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e3bde-c662-4083-a990-964c36d48031 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:19.973302 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd130ca1-eec7-48a9-bb9a-9082deb5348b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:19.973962 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd130ca1-eec7-48a9-bb9a-9082deb5348b None admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:19.974263 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd130ca1-eec7-48a9-bb9a-9082deb5348b None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:19.974769 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd130ca1-eec7-48a9-bb9a-9082deb5348b None admin] PATH_INFO: `/v3/projects/a40f8a0ec4334236ab27bfadc581d177/users/033cfc2596a048e992f8652ebfe016a2/roles/9d89ffc8145c487f80034d6daaf2f771` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:19.977355 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd130ca1-eec7-48a9-bb9a-9082deb5348b None admin] RBAC: Authorizing `identity:create_grant(project_id=a40f8a0ec4334236ab27bfadc581d177, user_id=033cfc2596a048e992f8652ebfe016a2, role_id=9d89ffc8145c487f80034d6daaf2f771)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:19.978975 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd130ca1-eec7-48a9-bb9a-9082deb5348b None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:19.996601 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 104/200] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 13:00:19 2022] PUT /identity/v3/projects/a40f8a0ec4334236ab27bfadc581d177/users/033cfc2596a048e992f8652ebfe016a2/roles/9d89ffc8145c487f80034d6daaf2f771 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:00:20.042625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9313cf4-fd1b-4f75-b604-5ba7438fd942 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:20.087607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635754b5-7045-4048-8185-267f52c36b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:20.088592 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635754b5-7045-4048-8185-267f52c36b7e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:20.089107 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635754b5-7045-4048-8185-267f52c36b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:20.089581 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635754b5-7045-4048-8185-267f52c36b7e None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:20.090470 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635754b5-7045-4048-8185-267f52c36b7e None admin] RBAC: Adding query filter params (name=member) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:20.090982 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635754b5-7045-4048-8185-267f52c36b7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:20.092689 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635754b5-7045-4048-8185-267f52c36b7e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:20.103916 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 97/201] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 24 13:00:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:20.110043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd130ca1-eec7-48a9-bb9a-9082deb5348b None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:20.163730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:20.226859 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd130ca1-eec7-48a9-bb9a-9082deb5348b None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:20.265166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4b05f-3cc3-4d0d-bdf6-d85a902fa5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:20.266168 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4b05f-3cc3-4d0d-bdf6-d85a902fa5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:20.266646 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4b05f-3cc3-4d0d-bdf6-d85a902fa5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:20.267111 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4b05f-3cc3-4d0d-bdf6-d85a902fa5e5 None admin] PATH_INFO: `/v3/users/d1f578182bca48e38ce2b2105d17d4bc` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:20.268505 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4b05f-3cc3-4d0d-bdf6-d85a902fa5e5 None admin] RBAC: Authorizing `identity:get_user(user_id=d1f578182bca48e38ce2b2105d17d4bc)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:20.270160 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4b05f-3cc3-4d0d-bdf6-d85a902fa5e5 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:20.272044 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 105/202] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:00:20 2022] GET /identity/v3/users/d1f578182bca48e38ce2b2105d17d4bc => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:20.278781 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635754b5-7045-4048-8185-267f52c36b7e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:20.344234 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:20.385729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635754b5-7045-4048-8185-267f52c36b7e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:20.420504 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fb73b-f374-48f6-b9a3-f52f30263458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:20.421039 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fb73b-f374-48f6-b9a3-f52f30263458 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:20.421322 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fb73b-f374-48f6-b9a3-f52f30263458 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:20.421598 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fb73b-f374-48f6-b9a3-f52f30263458 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:20.497110 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1fb73b-f374-48f6-b9a3-f52f30263458 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:20.498595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1fb73b-f374-48f6-b9a3-f52f30263458 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:20.567819 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:20.601819 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 98/203] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:00:20.607343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4b05f-3cc3-4d0d-bdf6-d85a902fa5e5 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:20.716087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4b05f-3cc3-4d0d-bdf6-d85a902fa5e5 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:20.729685 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:20.751958 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4343fc1-d9ba-4d76-b4c2-d67defb30b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:20.752657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4343fc1-d9ba-4d76-b4c2-d67defb30b61 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:20.752997 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4343fc1-d9ba-4d76-b4c2-d67defb30b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:20.753273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4343fc1-d9ba-4d76-b4c2-d67defb30b61 None admin] PATH_INFO: `/v3/projects/a40f8a0ec4334236ab27bfadc581d177` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:20.754479 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4343fc1-d9ba-4d76-b4c2-d67defb30b61 None admin] RBAC: Authorizing `identity:get_project(project_id=a40f8a0ec4334236ab27bfadc581d177)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:20.756360 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4343fc1-d9ba-4d76-b4c2-d67defb30b61 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:20.758814 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 106/204] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:00:20 2022] GET /identity/v3/projects/a40f8a0ec4334236ab27bfadc581d177 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:20.764879 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fb73b-f374-48f6-b9a3-f52f30263458 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:20.873565 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fb73b-f374-48f6-b9a3-f52f30263458 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:20.908512 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e8f85-9334-4fe8-81cc-5defaddafe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:20.909123 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e8f85-9334-4fe8-81cc-5defaddafe7b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:20.909405 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e8f85-9334-4fe8-81cc-5defaddafe7b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:20.909681 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e8f85-9334-4fe8-81cc-5defaddafe7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:20.910410 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e8f85-9334-4fe8-81cc-5defaddafe7b None admin] RBAC: Adding query filter params (role.id=b2da36c699a445fda4d2372471051f41, scope.project.id=a40f8a0ec4334236ab27bfadc581d177, user.id=d1f578182bca48e38ce2b2105d17d4bc) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:20.910718 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e8f85-9334-4fe8-81cc-5defaddafe7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:20.912201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e8f85-9334-4fe8-81cc-5defaddafe7b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:20.918894 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 99/205] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:00:20 2022] GET /identity/v3/role_assignments?user.id=d1f578182bca48e38ce2b2105d17d4bc&scope.project.id=a40f8a0ec4334236ab27bfadc581d177&role.id=b2da36c699a445fda4d2372471051f41 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:21.724182 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da6920-d5df-4338-8ae0-1bc9eeffcdcb None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:21.724570 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da6920-d5df-4338-8ae0-1bc9eeffcdcb None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:21.724806 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da6920-d5df-4338-8ae0-1bc9eeffcdcb None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:21.726318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 107/206] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:21.731742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf976fb-694c-44a2-b99f-e7ca7b49099e None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:21.732029 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf976fb-694c-44a2-b99f-e7ca7b49099e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:21.732301 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf976fb-694c-44a2-b99f-e7ca7b49099e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:21.751755 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-9cf976fb-694c-44a2-b99f-e7ca7b49099e None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:21.752976 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9cf976fb-694c-44a2-b99f-e7ca7b49099e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:21.779999 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:21.826267 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 100/207] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:21.867282 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8f179-0bc4-4791-a67d-83ee8bbdd3c0 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:21.868074 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8f179-0bc4-4791-a67d-83ee8bbdd3c0 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:21.868179 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8f179-0bc4-4791-a67d-83ee8bbdd3c0 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:21.869485 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 108/208] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:21.874858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806af938-2fc1-4d33-8ad1-2b87a1bb0dcf None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:21.875153 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806af938-2fc1-4d33-8ad1-2b87a1bb0dcf None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:21.875450 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806af938-2fc1-4d33-8ad1-2b87a1bb0dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:21.894176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-806af938-2fc1-4d33-8ad1-2b87a1bb0dcf None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:21.895358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-806af938-2fc1-4d33-8ad1-2b87a1bb0dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:21.961678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 101/209] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:22.089661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8f179-0bc4-4791-a67d-83ee8bbdd3c0 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:22.196263 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8f179-0bc4-4791-a67d-83ee8bbdd3c0 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:22.229655 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6d970-32bd-4eef-9f04-d49b112aca6a None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:22.229981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6d970-32bd-4eef-9f04-d49b112aca6a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:22.230207 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6d970-32bd-4eef-9f04-d49b112aca6a None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:22.231751 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 102/210] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:00:22.232348 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7921b-450c-47a5-b74a-30b2755b7535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:22.232971 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7921b-450c-47a5-b74a-30b2755b7535 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:22.233388 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7921b-450c-47a5-b74a-30b2755b7535 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:22.233488 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7921b-450c-47a5-b74a-30b2755b7535 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:22.234164 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6d970-32bd-4eef-9f04-d49b112aca6a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:22.244271 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7921b-450c-47a5-b74a-30b2755b7535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:22.249126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-66a7921b-450c-47a5-b74a-30b2755b7535 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:00:22.249126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:22.249126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:22.249126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:22.249126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:22.249126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:22.249126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:22.249126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:22.249126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:22.249126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:22.249126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:22.249126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:22.249126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:22.249126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:22.249126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:22.249126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:22.250180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:22.250180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:22.250180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:22.250180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:22.250180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:22.250180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:22.250180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:22.250180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:22.250180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:22.250180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:22.250180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:22.250180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:22.250180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:22.250180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:22.250180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:22.250180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:22.251567 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:22.251567 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:22.251567 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:22.251567 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:22.251567 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:22.251567 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:22.251567 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:22.251567 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:22.251567 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:22.251567 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:22.251567 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:00:22.251567 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:22.251567 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 109/211] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:22.252995 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276cfa4-7f9c-454f-a263-dc676eb1b967 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:22.253282 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276cfa4-7f9c-454f-a263-dc676eb1b967 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:22.253561 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276cfa4-7f9c-454f-a263-dc676eb1b967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:22.270842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-5276cfa4-7f9c-454f-a263-dc676eb1b967 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:22.272061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-5276cfa4-7f9c-454f-a263-dc676eb1b967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:22.307270 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:22.326720 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:22.339633 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 110/212] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:22.340032 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6d970-32bd-4eef-9f04-d49b112aca6a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:22.344279 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276cfa4-7f9c-454f-a263-dc676eb1b967 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:22.376128 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af3d1f-dec5-4a23-8f77-d1973956426c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:22.376756 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af3d1f-dec5-4a23-8f77-d1973956426c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:22.377036 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af3d1f-dec5-4a23-8f77-d1973956426c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:22.377307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af3d1f-dec5-4a23-8f77-d1973956426c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:22.378399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af3d1f-dec5-4a23-8f77-d1973956426c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:22.380094 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af3d1f-dec5-4a23-8f77-d1973956426c None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:22.381653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 103/213] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:22.387744 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af3d1f-dec5-4a23-8f77-d1973956426c None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:22.447667 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276cfa4-7f9c-454f-a263-dc676eb1b967 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:22.480286 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0fadc-67a3-4fe7-90bb-3b75185f7b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:22.480892 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0fadc-67a3-4fe7-90bb-3b75185f7b61 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:22.481174 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0fadc-67a3-4fe7-90bb-3b75185f7b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:22.481447 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0fadc-67a3-4fe7-90bb-3b75185f7b61 None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:22.482100 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0fadc-67a3-4fe7-90bb-3b75185f7b61 None admin] RBAC: Adding query filter params (name=member) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:22.482401 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0fadc-67a3-4fe7-90bb-3b75185f7b61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:22.483857 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0fadc-67a3-4fe7-90bb-3b75185f7b61 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:22.493422 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 111/214] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 24 13:00:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:22.494081 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af3d1f-dec5-4a23-8f77-d1973956426c None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:22.499006 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0fadc-67a3-4fe7-90bb-3b75185f7b61 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:22.530881 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:22.532799 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d61b3-e8a7-4c97-ae5e-e0b233b26d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:22.533439 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d61b3-e8a7-4c97-ae5e-e0b233b26d10 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:22.533718 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d61b3-e8a7-4c97-ae5e-e0b233b26d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:22.534022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d61b3-e8a7-4c97-ae5e-e0b233b26d10 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:22.534814 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d61b3-e8a7-4c97-ae5e-e0b233b26d10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:22.538448 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d61b3-e8a7-4c97-ae5e-e0b233b26d10 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:22.567545 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 104/215] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 24 13:00:22 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:00:22.612517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d61b3-e8a7-4c97-ae5e-e0b233b26d10 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:22.614711 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0fadc-67a3-4fe7-90bb-3b75185f7b61 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:22.643799 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:22.655081 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcecfa-d2fa-4a73-a615-6bdf13a66c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:22.655755 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcecfa-d2fa-4a73-a615-6bdf13a66c30 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:22.656029 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcecfa-d2fa-4a73-a615-6bdf13a66c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:22.656296 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcecfa-d2fa-4a73-a615-6bdf13a66c30 None admin] PATH_INFO: `/v3/users/cdc9a437d9f2420e8307a7413e9d32f8` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:22.673112 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcecfa-d2fa-4a73-a615-6bdf13a66c30 None admin] RBAC: Authorizing `identity:get_user(user_id=cdc9a437d9f2420e8307a7413e9d32f8)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:22.674649 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcecfa-d2fa-4a73-a615-6bdf13a66c30 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:22.676534 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 112/216] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:00:22 2022] GET /identity/v3/users/cdc9a437d9f2420e8307a7413e9d32f8 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:22.682958 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcecfa-d2fa-4a73-a615-6bdf13a66c30 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:22.731838 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d61b3-e8a7-4c97-ae5e-e0b233b26d10 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:22.772768 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af25f2c-3fb6-42bd-ba74-82eb32baf904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:22.774296 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af25f2c-3fb6-42bd-ba74-82eb32baf904 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:22.774672 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af25f2c-3fb6-42bd-ba74-82eb32baf904 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:22.775038 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af25f2c-3fb6-42bd-ba74-82eb32baf904 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:22.783899 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:22.787624 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af25f2c-3fb6-42bd-ba74-82eb32baf904 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:22.793096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-6af25f2c-3fb6-42bd-ba74-82eb32baf904 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:00:22.793096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:22.793096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:22.793096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:22.793096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:22.793096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:22.793096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:22.793096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:22.793096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:22.793096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:22.793096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:22.793096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:22.793096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:22.793096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:22.793096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:22.793096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:22.793985 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:22.793985 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:22.793985 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:22.793985 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:22.793985 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:22.793985 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:22.793985 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:22.793985 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:22.793985 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:22.793985 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:22.793985 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:22.793985 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:22.793985 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:22.793985 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:22.793985 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:22.793985 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:22.794934 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:22.794934 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:22.794934 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:22.794934 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:22.794934 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:22.794934 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:22.794934 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:22.794934 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:22.794934 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:22.794934 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:22.794934 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:00:22.794934 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:22.794934 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 105/217] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:22.798800 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcecfa-d2fa-4a73-a615-6bdf13a66c30 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:22.799907 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af25f2c-3fb6-42bd-ba74-82eb32baf904 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:22.845897 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d42c1-393c-47de-a7a1-dfe170c8371c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:22.846531 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d42c1-393c-47de-a7a1-dfe170c8371c None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:22.846805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d42c1-393c-47de-a7a1-dfe170c8371c None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:22.847071 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d42c1-393c-47de-a7a1-dfe170c8371c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:22.847836 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d42c1-393c-47de-a7a1-dfe170c8371c None admin] RBAC: Adding query filter params (role.id=b2da36c699a445fda4d2372471051f41, user.id=cdc9a437d9f2420e8307a7413e9d32f8, scope.system=all) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:22.848142 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d42c1-393c-47de-a7a1-dfe170c8371c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:22.849626 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d42c1-393c-47de-a7a1-dfe170c8371c None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:22.856121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 113/218] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Oct 24 13:00:22 2022] GET /identity/v3/role_assignments?user.id=cdc9a437d9f2420e8307a7413e9d32f8&scope.system=all&role.id=b2da36c699a445fda4d2372471051f41 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:22.892811 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:22.927062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af25f2c-3fb6-42bd-ba74-82eb32baf904 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:22.965368 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb436ed-00b0-40d6-8aa1-58bd32961658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:22.966003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb436ed-00b0-40d6-8aa1-58bd32961658 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:22.966308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb436ed-00b0-40d6-8aa1-58bd32961658 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:22.966580 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb436ed-00b0-40d6-8aa1-58bd32961658 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:22.967267 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb436ed-00b0-40d6-8aa1-58bd32961658 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:22.967652 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb436ed-00b0-40d6-8aa1-58bd32961658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:22.969072 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb436ed-00b0-40d6-8aa1-58bd32961658 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:22.979229 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 106/219] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 24 13:00:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:22.985113 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d42c1-393c-47de-a7a1-dfe170c8371c None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:23.099397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d42c1-393c-47de-a7a1-dfe170c8371c None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:23.135989 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cd122-7fa8-4ce9-97b3-d1f985fe9f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:23.136631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cd122-7fa8-4ce9-97b3-d1f985fe9f10 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:23.136907 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cd122-7fa8-4ce9-97b3-d1f985fe9f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:23.137180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cd122-7fa8-4ce9-97b3-d1f985fe9f10 None admin] PATH_INFO: `/v3/users/033cfc2596a048e992f8652ebfe016a2` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:23.138317 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4cd122-7fa8-4ce9-97b3-d1f985fe9f10 None admin] RBAC: Authorizing `identity:get_user(user_id=033cfc2596a048e992f8652ebfe016a2)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:23.139829 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4cd122-7fa8-4ce9-97b3-d1f985fe9f10 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:23.141436 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 114/220] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:00:22 2022] GET /identity/v3/users/033cfc2596a048e992f8652ebfe016a2 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:23.147028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb436ed-00b0-40d6-8aa1-58bd32961658 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:23.261855 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb436ed-00b0-40d6-8aa1-58bd32961658 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:23.297528 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bcea1-03a7-4a94-be1a-f3f7da08f122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:23.298150 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bcea1-03a7-4a94-be1a-f3f7da08f122 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:23.298430 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bcea1-03a7-4a94-be1a-f3f7da08f122 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:23.298723 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bcea1-03a7-4a94-be1a-f3f7da08f122 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:23.301517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:23.372641 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bcea1-03a7-4a94-be1a-f3f7da08f122 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:23.374141 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bcea1-03a7-4a94-be1a-f3f7da08f122 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:23.482439 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 107/221] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:00:23.487777 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cd122-7fa8-4ce9-97b3-d1f985fe9f10 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:23.514391 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:23.596992 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cd122-7fa8-4ce9-97b3-d1f985fe9f10 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:23.636587 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c6485-98d9-4c4a-9450-a5ad239ecc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:23.637303 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c6485-98d9-4c4a-9450-a5ad239ecc1b None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:23.637582 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c6485-98d9-4c4a-9450-a5ad239ecc1b None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:23.637855 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c6485-98d9-4c4a-9450-a5ad239ecc1b None admin] PATH_INFO: `/v3/projects/a40f8a0ec4334236ab27bfadc581d177` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:23.639042 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c6485-98d9-4c4a-9450-a5ad239ecc1b None admin] RBAC: Authorizing `identity:get_project(project_id=a40f8a0ec4334236ab27bfadc581d177)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:23.640557 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c6485-98d9-4c4a-9450-a5ad239ecc1b None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:23.642484 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 115/222] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:00:23 2022] GET /identity/v3/projects/a40f8a0ec4334236ab27bfadc581d177 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:23.648582 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bcea1-03a7-4a94-be1a-f3f7da08f122 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:23.683036 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:23.753321 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bcea1-03a7-4a94-be1a-f3f7da08f122 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:23.787218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f45e6-8599-44f3-b988-3d6d2478e59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:23.787845 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f45e6-8599-44f3-b988-3d6d2478e59b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:23.788442 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f45e6-8599-44f3-b988-3d6d2478e59b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:23.788442 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f45e6-8599-44f3-b988-3d6d2478e59b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:23.789694 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f45e6-8599-44f3-b988-3d6d2478e59b None admin] RBAC: Adding query filter params (role.id=9d89ffc8145c487f80034d6daaf2f771, scope.project.id=a40f8a0ec4334236ab27bfadc581d177, user.id=033cfc2596a048e992f8652ebfe016a2) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:23.789995 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f45e6-8599-44f3-b988-3d6d2478e59b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:23.791444 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f45e6-8599-44f3-b988-3d6d2478e59b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:23.797258 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 108/223] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:00:23 2022] GET /identity/v3/role_assignments?user.id=033cfc2596a048e992f8652ebfe016a2&scope.project.id=a40f8a0ec4334236ab27bfadc581d177&role.id=9d89ffc8145c487f80034d6daaf2f771 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:24.918484 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1927480-993b-4314-b7e0-acda722e5751 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:24.919198 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1927480-993b-4314-b7e0-acda722e5751 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:24.919198 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1927480-993b-4314-b7e0-acda722e5751 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:24.920613 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 116/224] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:24.929073 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225984ac-9b81-4e0e-a7e4-478a2dbd5e7e None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:24.929946 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225984ac-9b81-4e0e-a7e4-478a2dbd5e7e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:24.930103 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225984ac-9b81-4e0e-a7e4-478a2dbd5e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:24.956662 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-225984ac-9b81-4e0e-a7e4-478a2dbd5e7e None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:24.958165 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-225984ac-9b81-4e0e-a7e4-478a2dbd5e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:25.039264 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 109/225] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:25.046804 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2406220-b2e3-4a4d-a259-dcb3407e0a51 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:25.047347 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2406220-b2e3-4a4d-a259-dcb3407e0a51 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:25.047848 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2406220-b2e3-4a4d-a259-dcb3407e0a51 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:25.049401 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 117/226] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:25.055348 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6570c1-5c34-4e07-ad14-21066512c789 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:25.055810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6570c1-5c34-4e07-ad14-21066512c789 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:25.056247 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6570c1-5c34-4e07-ad14-21066512c789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:25.074717 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-ca6570c1-5c34-4e07-ad14-21066512c789 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:25.076189 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ca6570c1-5c34-4e07-ad14-21066512c789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:25.100229 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:25.128661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a801a-0bb8-4324-beae-7a7600aa63bf None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:25.128944 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a801a-0bb8-4324-beae-7a7600aa63bf None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:25.129399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a801a-0bb8-4324-beae-7a7600aa63bf None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:25.130732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 118/227] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:00:25.135673 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0e218-7271-4ec9-857b-7a079ea048b3 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:25.135956 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0e218-7271-4ec9-857b-7a079ea048b3 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:25.136230 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0e218-7271-4ec9-857b-7a079ea048b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:25.149808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 110/228] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:25.154591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-69b0e218-7271-4ec9-857b-7a079ea048b3 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:25.155809 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-69b0e218-7271-4ec9-857b-7a079ea048b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:25.225348 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 119/229] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:00:25.310643 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6570c1-5c34-4e07-ad14-21066512c789 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:25.409017 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6570c1-5c34-4e07-ad14-21066512c789 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:25.418987 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0e218-7271-4ec9-857b-7a079ea048b3 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:25.442988 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:25.449712 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37c5e4-98b5-42a1-a04e-69e3d1d346b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:25.450342 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37c5e4-98b5-42a1-a04e-69e3d1d346b3 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:25.450774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37c5e4-98b5-42a1-a04e-69e3d1d346b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:25.451041 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37c5e4-98b5-42a1-a04e-69e3d1d346b3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:25.462304 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37c5e4-98b5-42a1-a04e-69e3d1d346b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:25.467326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-3f37c5e4-98b5-42a1-a04e-69e3d1d346b3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:00:25.467326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:25.467326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:25.467326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:25.467326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:25.467326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:25.467326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:25.467326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:25.467326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:25.467326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:25.467326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:25.467326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:25.467326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:25.467326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:25.467326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:25.467326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:25.468232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:25.468232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:25.468232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:25.468232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:25.468232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:25.468232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:25.468232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:25.468232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:25.468232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:25.468232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:25.468232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:25.468232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:25.468232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:25.468232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:25.468232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:25.468232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:25.469023 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:25.469023 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:25.469023 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:25.469023 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:25.469023 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:25.469023 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:25.469023 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:25.469023 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:25.469023 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:25.469023 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:25.469023 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:00:25.469023 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:25.469023 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 111/230] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:25.474566 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37c5e4-98b5-42a1-a04e-69e3d1d346b3 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:25.495737 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:25.527581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0e218-7271-4ec9-857b-7a079ea048b3 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:25.561202 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c12efc-83ce-466c-8a1e-c462e964e7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:25.561832 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c12efc-83ce-466c-8a1e-c462e964e7bd None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:25.562109 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c12efc-83ce-466c-8a1e-c462e964e7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:25.562378 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c12efc-83ce-466c-8a1e-c462e964e7bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:25.563486 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c12efc-83ce-466c-8a1e-c462e964e7bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:25.564986 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c12efc-83ce-466c-8a1e-c462e964e7bd None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:25.566551 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 120/231] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:25.567305 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c12efc-83ce-466c-8a1e-c462e964e7bd None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:25.582322 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37c5e4-98b5-42a1-a04e-69e3d1d346b3 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:25.615358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a89af-e872-46cc-abc4-61ad22812664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:25.616137 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a89af-e872-46cc-abc4-61ad22812664 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:25.616411 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a89af-e872-46cc-abc4-61ad22812664 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:25.617468 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a89af-e872-46cc-abc4-61ad22812664 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:25.618124 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a89af-e872-46cc-abc4-61ad22812664 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:25.618499 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a89af-e872-46cc-abc4-61ad22812664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:25.620343 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a89af-e872-46cc-abc4-61ad22812664 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:25.628257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 112/232] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 24 13:00:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:25.629019 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a89af-e872-46cc-abc4-61ad22812664 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:25.660936 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:25.673277 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c12efc-83ce-466c-8a1e-c462e964e7bd None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:25.707648 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df92ec-11cf-4193-a200-dbb3de1ac97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:25.708276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df92ec-11cf-4193-a200-dbb3de1ac97f None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:25.708369 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:25.708552 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df92ec-11cf-4193-a200-dbb3de1ac97f None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:25.709007 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df92ec-11cf-4193-a200-dbb3de1ac97f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:25.720928 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df92ec-11cf-4193-a200-dbb3de1ac97f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:25.725840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-57df92ec-11cf-4193-a200-dbb3de1ac97f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:00:25.725840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:25.725840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:25.725840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:25.725840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:25.725840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:25.725840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:25.725840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:25.725840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:25.725840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:25.725840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:25.725840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:25.725840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:25.725840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:25.725840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:25.725840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:25.727287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:25.727287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:25.727287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:25.727287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:25.727287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:25.727287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:25.727287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:25.727287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:25.727287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:25.727287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:25.727287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:25.727287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:25.727287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:25.727287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:25.727287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:25.727287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:25.728126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:25.728126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:25.728126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:25.728126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:25.728126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:25.728126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:25.728126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:25.728126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:25.728126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:25.728126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:25.728126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:00:25.728126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:25.728126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 121/233] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:25.728803 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df92ec-11cf-4193-a200-dbb3de1ac97f None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:25.728870 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a89af-e872-46cc-abc4-61ad22812664 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:25.762204 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512bf76-d837-4fa5-8d24-8378896867f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:25.762750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512bf76-d837-4fa5-8d24-8378896867f1 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:25.763028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512bf76-d837-4fa5-8d24-8378896867f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:25.763303 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512bf76-d837-4fa5-8d24-8378896867f1 None admin] PATH_INFO: `/v3/groups` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:25.763958 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512bf76-d837-4fa5-8d24-8378896867f1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:25.765413 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512bf76-d837-4fa5-8d24-8378896867f1 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:25.780034 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 113/234] 10.222.0.18 () {60 vars in 1134 bytes} [Mon Oct 24 13:00:25 2022] POST /identity/v3/groups => generated 229 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:00:25.780829 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512bf76-d837-4fa5-8d24-8378896867f1 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:25.850713 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df92ec-11cf-4193-a200-dbb3de1ac97f None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:25.890214 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba1325-8d9f-4474-821c-978798ca9ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:25.890849 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba1325-8d9f-4474-821c-978798ca9ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:25.891125 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba1325-8d9f-4474-821c-978798ca9ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:25.891390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba1325-8d9f-4474-821c-978798ca9ef3 None admin] PATH_INFO: `/v3/users/2408cd16bcea4c82a01b0b40a9a30484` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:25.895074 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512bf76-d837-4fa5-8d24-8378896867f1 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:25.906573 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba1325-8d9f-4474-821c-978798ca9ef3 None admin] RBAC: Authorizing `identity:get_user(user_id=2408cd16bcea4c82a01b0b40a9a30484)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:25.908125 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba1325-8d9f-4474-821c-978798ca9ef3 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:25.909894 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 122/235] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:00:25 2022] GET /identity/v3/users/2408cd16bcea4c82a01b0b40a9a30484 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:25.916035 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba1325-8d9f-4474-821c-978798ca9ef3 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:25.925029 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:25.936544 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087292d-c854-425c-aa91-c569bffe2de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:25.937157 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087292d-c854-425c-aa91-c569bffe2de8 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:25.937433 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087292d-c854-425c-aa91-c569bffe2de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:25.937729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087292d-c854-425c-aa91-c569bffe2de8 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:25.938365 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087292d-c854-425c-aa91-c569bffe2de8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:25.938676 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087292d-c854-425c-aa91-c569bffe2de8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:25.940203 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087292d-c854-425c-aa91-c569bffe2de8 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:25.950769 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 114/236] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 24 13:00:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:25.956819 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087292d-c854-425c-aa91-c569bffe2de8 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:25.959561 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:26.033577 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba1325-8d9f-4474-821c-978798ca9ef3 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:26.068229 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2400d-473e-4f58-b150-fea9386f8228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:26.068743 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087292d-c854-425c-aa91-c569bffe2de8 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:26.068852 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2400d-473e-4f58-b150-fea9386f8228 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:26.069084 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2400d-473e-4f58-b150-fea9386f8228 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:26.069349 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2400d-473e-4f58-b150-fea9386f8228 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:26.070657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2400d-473e-4f58-b150-fea9386f8228 None admin] RBAC: Adding query filter params (role.id=9d89ffc8145c487f80034d6daaf2f771, user.id=2408cd16bcea4c82a01b0b40a9a30484, scope.system=all) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:26.071045 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2400d-473e-4f58-b150-fea9386f8228 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:26.072786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2400d-473e-4f58-b150-fea9386f8228 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:26.077873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 123/237] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Oct 24 13:00:25 2022] GET /identity/v3/role_assignments?user.id=2408cd16bcea4c82a01b0b40a9a30484&scope.system=all&role.id=9d89ffc8145c487f80034d6daaf2f771 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:26.107780 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4beea-4a64-496c-a730-7572a7e9adfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:26.108772 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4beea-4a64-496c-a730-7572a7e9adfc None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:26.109222 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4beea-4a64-496c-a730-7572a7e9adfc None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:26.109662 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4beea-4a64-496c-a730-7572a7e9adfc None admin] PATH_INFO: `/v3/users/cdc9a437d9f2420e8307a7413e9d32f8` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:26.111057 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4beea-4a64-496c-a730-7572a7e9adfc None admin] RBAC: Authorizing `identity:get_user(user_id=cdc9a437d9f2420e8307a7413e9d32f8)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:26.112794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4beea-4a64-496c-a730-7572a7e9adfc None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:26.119982 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 115/238] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:00:25 2022] GET /identity/v3/users/cdc9a437d9f2420e8307a7413e9d32f8 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:26.121694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2400d-473e-4f58-b150-fea9386f8228 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:26.202461 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:26.236999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2400d-473e-4f58-b150-fea9386f8228 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:26.274502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5317d9d-01c2-424d-84a5-dc0877f2b9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:26.275157 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5317d9d-01c2-424d-84a5-dc0877f2b9e4 None admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:26.275450 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5317d9d-01c2-424d-84a5-dc0877f2b9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:26.275720 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5317d9d-01c2-424d-84a5-dc0877f2b9e4 None admin] PATH_INFO: `/v3/system/users/cdc9a437d9f2420e8307a7413e9d32f8/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:26.277106 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5317d9d-01c2-424d-84a5-dc0877f2b9e4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cdc9a437d9f2420e8307a7413e9d32f8, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:26.278497 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5317d9d-01c2-424d-84a5-dc0877f2b9e4 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:26.288711 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 124/239] 10.222.0.18 () {58 vars in 1334 bytes} [Mon Oct 24 13:00:26 2022] PUT /identity/v3/system/users/cdc9a437d9f2420e8307a7413e9d32f8/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:27.993070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc366f-0690-46e8-891b-b731b969b136 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:27.993607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc366f-0690-46e8-891b-b731b969b136 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:27.993607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc366f-0690-46e8-891b-b731b969b136 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:27.994981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 116/240] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:28.000239 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceab88f-3927-4b20-a8a7-e030b16ac04d None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:28.000626 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceab88f-3927-4b20-a8a7-e030b16ac04d None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:28.000781 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceab88f-3927-4b20-a8a7-e030b16ac04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:28.019358 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-4ceab88f-3927-4b20-a8a7-e030b16ac04d None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:28.020552 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-4ceab88f-3927-4b20-a8a7-e030b16ac04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:28.088964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 125/241] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:28.285966 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c755a-b66d-401b-ba64-4144ae6d850e None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:28.286317 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c755a-b66d-401b-ba64-4144ae6d850e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:28.286428 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c755a-b66d-401b-ba64-4144ae6d850e None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:28.287920 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 117/242] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:28.293199 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee86e2-6fdf-4462-933e-935591f5682b None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:28.293486 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee86e2-6fdf-4462-933e-935591f5682b None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:28.293760 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee86e2-6fdf-4462-933e-935591f5682b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:28.312553 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-a2ee86e2-6fdf-4462-933e-935591f5682b None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:28.313716 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-a2ee86e2-6fdf-4462-933e-935591f5682b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:28.360410 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c755a-b66d-401b-ba64-4144ae6d850e None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:28.381906 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:28.393225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 126/243] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:28.436675 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:28.464999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424827c1-f8bf-45f4-801c-8682146b6a03 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:28.465292 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424827c1-f8bf-45f4-801c-8682146b6a03 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:28.465546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424827c1-f8bf-45f4-801c-8682146b6a03 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:28.466881 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 127/244] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:00:28.470487 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c755a-b66d-401b-ba64-4144ae6d850e None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:28.471933 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923818e-e825-4454-b36c-24dab24c82a9 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:28.472377 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923818e-e825-4454-b36c-24dab24c82a9 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:28.472649 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923818e-e825-4454-b36c-24dab24c82a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:28.490015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-4923818e-e825-4454-b36c-24dab24c82a9 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:28.491166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-4923818e-e825-4454-b36c-24dab24c82a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:28.509286 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e19dc-d5db-4889-b397-fd4e9981f84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:28.510387 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e19dc-d5db-4889-b397-fd4e9981f84d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:28.510996 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e19dc-d5db-4889-b397-fd4e9981f84d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:28.511289 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e19dc-d5db-4889-b397-fd4e9981f84d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:28.512414 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e19dc-d5db-4889-b397-fd4e9981f84d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:28.514313 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e19dc-d5db-4889-b397-fd4e9981f84d None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:28.516185 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 118/245] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:28.521151 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e19dc-d5db-4889-b397-fd4e9981f84d None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:28.566992 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 128/246] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:00:28.632570 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e19dc-d5db-4889-b397-fd4e9981f84d None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:28.667063 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99112e-2556-4127-ac05-e32658eb50b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:28.667935 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99112e-2556-4127-ac05-e32658eb50b5 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:28.668352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99112e-2556-4127-ac05-e32658eb50b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:28.668766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99112e-2556-4127-ac05-e32658eb50b5 None admin] PATH_INFO: `/v3/groups` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:28.669542 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99112e-2556-4127-ac05-e32658eb50b5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:28.671123 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99112e-2556-4127-ac05-e32658eb50b5 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:28.671950 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923818e-e825-4454-b36c-24dab24c82a9 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:28.682572 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:28.690557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 119/247] 10.222.0.18 () {60 vars in 1134 bytes} [Mon Oct 24 13:00:28 2022] POST /identity/v3/groups => generated 226 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:00:28.784818 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923818e-e825-4454-b36c-24dab24c82a9 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:28.812019 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:28.825499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85657147-3d7a-4c7f-ade7-19a1de89d6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:28.826144 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85657147-3d7a-4c7f-ade7-19a1de89d6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:28.826470 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85657147-3d7a-4c7f-ade7-19a1de89d6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:28.826744 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85657147-3d7a-4c7f-ade7-19a1de89d6e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:28.839098 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85657147-3d7a-4c7f-ade7-19a1de89d6e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:28.845725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-85657147-3d7a-4c7f-ade7-19a1de89d6e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:00:28.845725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:28.845725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:28.845725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:28.845725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:28.845725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:28.845725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:28.845725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:28.845725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:28.845725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:28.845725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:28.845725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:28.845725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:28.845725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:28.845725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:28.845725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:28.846696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:28.846696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:28.846696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:28.846696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:28.846696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:28.846696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:28.846696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:28.846696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:28.846696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:28.846696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:28.846696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:28.846696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:28.846696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:28.846696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:28.846696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:28.846696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:28.847954 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:28.847954 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:28.847954 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:28.847954 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:28.847954 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:28.847954 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:28.847954 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:28.847954 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:28.847954 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:28.847954 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:28.847954 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:00:28.847954 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:28.848731 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99112e-2556-4127-ac05-e32658eb50b5 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:28.848815 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 129/248] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:28.852006 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85657147-3d7a-4c7f-ade7-19a1de89d6e6 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:28.971942 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99112e-2556-4127-ac05-e32658eb50b5 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:28.977564 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85657147-3d7a-4c7f-ade7-19a1de89d6e6 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:29.018211 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b56c89-d747-436c-93c9-836e0d6f4a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:29.018876 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b56c89-d747-436c-93c9-836e0d6f4a3d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:29.019148 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b56c89-d747-436c-93c9-836e0d6f4a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:29.019439 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b56c89-d747-436c-93c9-836e0d6f4a3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:29.024894 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e6c11-f671-4466-858a-057e0705b377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:29.026070 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e6c11-f671-4466-858a-057e0705b377 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:29.026542 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e6c11-f671-4466-858a-057e0705b377 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:29.027006 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e6c11-f671-4466-858a-057e0705b377 None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:29.028077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e6c11-f671-4466-858a-057e0705b377 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:29.028685 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e6c11-f671-4466-858a-057e0705b377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:29.030160 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e6c11-f671-4466-858a-057e0705b377 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:29.033252 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b56c89-d747-436c-93c9-836e0d6f4a3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:29.040618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-b7b56c89-d747-436c-93c9-836e0d6f4a3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:00:29.040618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:29.040618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:29.040618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:29.040618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:29.040618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:29.040618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:29.040618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:29.040618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:29.040618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:29.040618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:29.040618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:29.040618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:29.040618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:29.040618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:29.040618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:29.041529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:29.041529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:29.041529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:29.041529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:29.041529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:29.041529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:29.041529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:29.041529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:29.041529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:29.041529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:29.041529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:29.041529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:29.041529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:29.041529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:29.041529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:29.041529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:29.042328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:29.042328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:29.042328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:29.042328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:29.042328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:29.042328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:29.042328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:29.042328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:29.042328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:29.042328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:29.042328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:00:29.042328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:29.044987 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 130/250] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 24 13:00:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:29.045106 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 120/250] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:29.048520 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b56c89-d747-436c-93c9-836e0d6f4a3d None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:29.050357 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e6c11-f671-4466-858a-057e0705b377 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:29.116472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:29.125857 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:29.180709 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b56c89-d747-436c-93c9-836e0d6f4a3d None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:29.186849 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e6c11-f671-4466-858a-057e0705b377 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:29.222454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c723c-e96e-4e17-b27b-9078c186b37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:29.223791 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c723c-e96e-4e17-b27b-9078c186b37b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:29.224077 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c723c-e96e-4e17-b27b-9078c186b37b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:29.224350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c723c-e96e-4e17-b27b-9078c186b37b None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:29.225205 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c723c-e96e-4e17-b27b-9078c186b37b None admin] RBAC: Adding query filter params (name=member) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:29.225603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c723c-e96e-4e17-b27b-9078c186b37b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:29.227761 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c723c-e96e-4e17-b27b-9078c186b37b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:29.230801 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef36dd-b91b-4f4c-a529-cd687de8d4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:29.231721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef36dd-b91b-4f4c-a529-cd687de8d4f6 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:29.232191 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef36dd-b91b-4f4c-a529-cd687de8d4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:29.232649 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef36dd-b91b-4f4c-a529-cd687de8d4f6 None admin] PATH_INFO: `/v3/users/2408cd16bcea4c82a01b0b40a9a30484` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:29.234066 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef36dd-b91b-4f4c-a529-cd687de8d4f6 None admin] RBAC: Authorizing `identity:get_user(user_id=2408cd16bcea4c82a01b0b40a9a30484)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:29.235820 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef36dd-b91b-4f4c-a529-cd687de8d4f6 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:29.237884 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 131/252] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:00:29 2022] GET /identity/v3/users/2408cd16bcea4c82a01b0b40a9a30484 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:29.238577 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 121/252] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 24 13:00:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:29.242904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef36dd-b91b-4f4c-a529-cd687de8d4f6 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:29.244198 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c723c-e96e-4e17-b27b-9078c186b37b None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:29.359516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c723c-e96e-4e17-b27b-9078c186b37b None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:29.370657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef36dd-b91b-4f4c-a529-cd687de8d4f6 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:29.385340 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:29.388968 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:29.406112 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea1392-a376-4727-843f-1b39c3c3c269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:29.407070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea1392-a376-4727-843f-1b39c3c3c269 None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:29.408030 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea1392-a376-4727-843f-1b39c3c3c269 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:29.408550 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea1392-a376-4727-843f-1b39c3c3c269 None admin] PATH_INFO: `/v3/system/users/2408cd16bcea4c82a01b0b40a9a30484/roles/9d89ffc8145c487f80034d6daaf2f771` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:29.410243 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea1392-a376-4727-843f-1b39c3c3c269 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2408cd16bcea4c82a01b0b40a9a30484, role_id=9d89ffc8145c487f80034d6daaf2f771)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:29.411794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea1392-a376-4727-843f-1b39c3c3c269 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:29.414968 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1733f17-4516-445f-b605-526605f8cd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:29.415689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1733f17-4516-445f-b605-526605f8cd97 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:29.416030 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1733f17-4516-445f-b605-526605f8cd97 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:29.416362 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1733f17-4516-445f-b605-526605f8cd97 None admin] PATH_INFO: `/v3/users/cdc9a437d9f2420e8307a7413e9d32f8` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:29.418014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1733f17-4516-445f-b605-526605f8cd97 None admin] RBAC: Authorizing `identity:get_user(user_id=cdc9a437d9f2420e8307a7413e9d32f8)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:29.419758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1733f17-4516-445f-b605-526605f8cd97 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:29.425725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 132/253] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:00:29 2022] GET /identity/v3/users/cdc9a437d9f2420e8307a7413e9d32f8 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:29.427708 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 122/254] 10.222.0.18 () {58 vars in 1334 bytes} [Mon Oct 24 13:00:29 2022] PUT /identity/v3/system/users/2408cd16bcea4c82a01b0b40a9a30484/roles/9d89ffc8145c487f80034d6daaf2f771 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:29.433579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1733f17-4516-445f-b605-526605f8cd97 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:29.566277 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1733f17-4516-445f-b605-526605f8cd97 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:29.607712 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb365de9-f306-4026-a09b-3b39a7267375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:29.608328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb365de9-f306-4026-a09b-3b39a7267375 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:29.608600 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb365de9-f306-4026-a09b-3b39a7267375 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:29.608865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb365de9-f306-4026-a09b-3b39a7267375 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:29.609598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb365de9-f306-4026-a09b-3b39a7267375 None admin] RBAC: Adding query filter params (role.id=b2da36c699a445fda4d2372471051f41, user.id=cdc9a437d9f2420e8307a7413e9d32f8, scope.system=all) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:29.609901 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb365de9-f306-4026-a09b-3b39a7267375 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:29.611372 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb365de9-f306-4026-a09b-3b39a7267375 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:29.627204 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 133/255] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Oct 24 13:00:29 2022] GET /identity/v3/role_assignments?user.id=cdc9a437d9f2420e8307a7413e9d32f8&scope.system=all&role.id=b2da36c699a445fda4d2372471051f41 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:31.438197 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51a588-edc6-4286-a3ff-de1dfc39ca58 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:31.438737 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51a588-edc6-4286-a3ff-de1dfc39ca58 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:31.438737 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51a588-edc6-4286-a3ff-de1dfc39ca58 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:31.440318 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 123/256] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:31.457108 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99f174-0d2b-472e-b6d9-dad4c89cbea7 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:31.458178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99f174-0d2b-472e-b6d9-dad4c89cbea7 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:31.458771 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99f174-0d2b-472e-b6d9-dad4c89cbea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:31.485255 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-db99f174-0d2b-472e-b6d9-dad4c89cbea7 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:31.487742 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-db99f174-0d2b-472e-b6d9-dad4c89cbea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:31.549945 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:31.574929 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 134/257] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 13:00:31.746668 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a49142-41ec-4ea9-b45b-c55a7d1d25d5 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:31.746999 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a49142-41ec-4ea9-b45b-c55a7d1d25d5 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:31.747174 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a49142-41ec-4ea9-b45b-c55a7d1d25d5 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:31.748758 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 124/258] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:31.753809 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91110eb-3a83-447b-9cbf-70eb0e336ea6 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:31.754098 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91110eb-3a83-447b-9cbf-70eb0e336ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:31.754407 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91110eb-3a83-447b-9cbf-70eb0e336ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:31.779030 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-e91110eb-3a83-447b-9cbf-70eb0e336ea6 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:31.780296 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-e91110eb-3a83-447b-9cbf-70eb0e336ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:31.792982 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 135/259] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 13:00:32.101117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a49142-41ec-4ea9-b45b-c55a7d1d25d5 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:32.114755 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a49142-41ec-4ea9-b45b-c55a7d1d25d5 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:32.119390 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d817290-fd82-4b0d-b44e-e56f6f32fe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:32.120091 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d817290-fd82-4b0d-b44e-e56f6f32fe74 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.120367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d817290-fd82-4b0d-b44e-e56f6f32fe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.120635 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d817290-fd82-4b0d-b44e-e56f6f32fe74 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.127081 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91110eb-3a83-447b-9cbf-70eb0e336ea6 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:32.136841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d817290-fd82-4b0d-b44e-e56f6f32fe74 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:32.139000 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91110eb-3a83-447b-9cbf-70eb0e336ea6 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:32.141901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-6d817290-fd82-4b0d-b44e-e56f6f32fe74 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:00:32.141901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:32.141901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:32.141901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:32.141901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:32.141901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:32.141901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:32.141901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:32.141901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:32.141901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:32.141901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:32.141901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:32.141901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:32.141901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:32.141901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:32.141901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:32.142813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:32.142813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:32.142813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:32.142813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:32.142813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:32.142813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:32.142813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:32.142813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:32.142813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:32.142813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:32.142813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:32.142813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:32.142813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:32.142813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:32.142813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:32.142813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:32.143649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:32.143649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:32.143649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:32.143649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:32.143649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:32.143649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:32.143649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:32.143649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:32.143649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:32.143649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:32.143649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:00:32.143649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:32.143649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 125/260] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Oct 24 13:00:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:32.149558 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d817290-fd82-4b0d-b44e-e56f6f32fe74 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:32.153822 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbae6d-b24c-4234-8e59-2a0d2c9225d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:32.154470 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbae6d-b24c-4234-8e59-2a0d2c9225d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.154744 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbae6d-b24c-4234-8e59-2a0d2c9225d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.155018 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbae6d-b24c-4234-8e59-2a0d2c9225d3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.160697 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d817290-fd82-4b0d-b44e-e56f6f32fe74 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:32.166138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72643e-45b9-4d4c-9edc-0f8b2334fc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:32.167049 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72643e-45b9-4d4c-9edc-0f8b2334fc56 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.167560 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72643e-45b9-4d4c-9edc-0f8b2334fc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.168003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72643e-45b9-4d4c-9edc-0f8b2334fc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.168855 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72643e-45b9-4d4c-9edc-0f8b2334fc56 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:32.169322 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72643e-45b9-4d4c-9edc-0f8b2334fc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:32.171518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: WARNING py.warnings [None req-2c72643e-45b9-4d4c-9edc-0f8b2334fc56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:00:32.171518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: warnings.warn(msg) Oct 24 13:00:32.171518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: Oct 24 13:00:32.172870 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72643e-45b9-4d4c-9edc-0f8b2334fc56 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:32.182569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbae6d-b24c-4234-8e59-2a0d2c9225d3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:32.184339 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 126/261] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Oct 24 13:00:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:32.188013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-d1cbae6d-b24c-4234-8e59-2a0d2c9225d3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:00:32.188013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:32.188013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:32.188013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:32.188013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:32.188013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:32.188013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:32.188013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:32.188013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:32.188013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:32.188013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:32.188013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:32.188013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:32.188013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:32.188013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:32.188013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:32.188891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:32.188891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:32.188891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:32.188891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:32.188891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:32.188891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:32.188891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:32.188891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:32.188891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:32.188891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:32.188891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:32.188891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:32.188891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:32.188891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:32.188891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:32.188891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:32.189683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:32.189683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:32.189683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:32.189683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:32.189683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:32.189683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:32.189683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:32.189683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:32.189683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:32.189683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:32.189683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:00:32.189683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:32.189683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 136/262] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Oct 24 13:00:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:32.191687 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72643e-45b9-4d4c-9edc-0f8b2334fc56 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:32.204557 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029611ed-97c0-4185-966b-6f505e5abce5 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.204833 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029611ed-97c0-4185-966b-6f505e5abce5 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.205107 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029611ed-97c0-4185-966b-6f505e5abce5 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.206167 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72643e-45b9-4d4c-9edc-0f8b2334fc56 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:32.206473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 137/263] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:32.210913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d6ddf-9e8d-4ee6-b5d4-cc849ce81daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:32.211770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d6ddf-9e8d-4ee6-b5d4-cc849ce81daa admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.212210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d6ddf-9e8d-4ee6-b5d4-cc849ce81daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.212425 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f1598-704e-44c8-8203-3eab23a91eba None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.212712 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f1598-704e-44c8-8203-3eab23a91eba None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.212899 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d6ddf-9e8d-4ee6-b5d4-cc849ce81daa admin admin] PATH_INFO: `/v3/groups/942bf468fd384fb099e21d325f1ca2f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.213001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f1598-704e-44c8-8203-3eab23a91eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.223043 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d6ddf-9e8d-4ee6-b5d4-cc849ce81daa admin admin] RBAC: Authorizing `identity:get_group(group_id=942bf468fd384fb099e21d325f1ca2f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:32.224409 dv-cinder-862491-1-smb devstack@keystone.service[81601]: WARNING py.warnings [None req-007d6ddf-9e8d-4ee6-b5d4-cc849ce81daa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:00:32.224409 dv-cinder-862491-1-smb devstack@keystone.service[81601]: warnings.warn(msg) Oct 24 13:00:32.224409 dv-cinder-862491-1-smb devstack@keystone.service[81601]: Oct 24 13:00:32.226104 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d6ddf-9e8d-4ee6-b5d4-cc849ce81daa admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:32.229017 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 127/264] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Oct 24 13:00:32 2022] GET /identity/v3/groups/942bf468fd384fb099e21d325f1ca2f7 => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:32.229999 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d6ddf-9e8d-4ee6-b5d4-cc849ce81daa admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:32.241560 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d6ddf-9e8d-4ee6-b5d4-cc849ce81daa admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:32.247306 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4854b-54e4-4f90-99d0-0b581d8bac29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:32.248085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4854b-54e4-4f90-99d0-0b581d8bac29 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.248820 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4854b-54e4-4f90-99d0-0b581d8bac29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.249260 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4854b-54e4-4f90-99d0-0b581d8bac29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.250055 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4854b-54e4-4f90-99d0-0b581d8bac29 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:32.250496 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4854b-54e4-4f90-99d0-0b581d8bac29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:32.252389 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-fe9f1598-704e-44c8-8203-3eab23a91eba None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:32.252624 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4854b-54e4-4f90-99d0-0b581d8bac29 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:32.253593 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-fe9f1598-704e-44c8-8203-3eab23a91eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:32.266276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 128/265] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Oct 24 13:00:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:32.267328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4854b-54e4-4f90-99d0-0b581d8bac29 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:32.278805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 138/266] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 13:00:32.279942 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f1598-704e-44c8-8203-3eab23a91eba None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:32.285974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4854b-54e4-4f90-99d0-0b581d8bac29 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:32.292441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ab382-e57d-4d95-83ab-d147cbf398f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:32.293328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f1598-704e-44c8-8203-3eab23a91eba None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:32.293495 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ab382-e57d-4d95-83ab-d147cbf398f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.294107 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ab382-e57d-4d95-83ab-d147cbf398f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.294581 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ab382-e57d-4d95-83ab-d147cbf398f7 admin admin] PATH_INFO: `/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.295927 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ab382-e57d-4d95-83ab-d147cbf398f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=1f8d2f2bddb7409bb80d51b644ee1f01)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:32.298255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ab382-e57d-4d95-83ab-d147cbf398f7 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:32.300335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 129/267] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Oct 24 13:00:32 2022] GET /identity/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:32.306676 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ab382-e57d-4d95-83ab-d147cbf398f7 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:32.316109 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d8e53-cd12-4a1b-a861-07b317b5c854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:32.316766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d8e53-cd12-4a1b-a861-07b317b5c854 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.317050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d8e53-cd12-4a1b-a861-07b317b5c854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.317326 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d8e53-cd12-4a1b-a861-07b317b5c854 admin admin] PATH_INFO: `/v3/groups/942bf468fd384fb099e21d325f1ca2f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.318340 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ab382-e57d-4d95-83ab-d147cbf398f7 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:32.318456 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d8e53-cd12-4a1b-a861-07b317b5c854 admin admin] RBAC: Authorizing `identity:get_group(group_id=942bf468fd384fb099e21d325f1ca2f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:32.320852 dv-cinder-862491-1-smb devstack@keystone.service[81600]: WARNING py.warnings [None req-515d8e53-cd12-4a1b-a861-07b317b5c854 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:00:32.320852 dv-cinder-862491-1-smb devstack@keystone.service[81600]: warnings.warn(msg) Oct 24 13:00:32.320852 dv-cinder-862491-1-smb devstack@keystone.service[81600]: Oct 24 13:00:32.322098 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d8e53-cd12-4a1b-a861-07b317b5c854 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:32.323957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 139/268] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Oct 24 13:00:32 2022] GET /identity/v3/groups/942bf468fd384fb099e21d325f1ca2f7 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:32.324558 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d56caa-fca4-4056-bd8a-2d75cc4b7c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:32.325436 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d56caa-fca4-4056-bd8a-2d75cc4b7c11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.325850 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d56caa-fca4-4056-bd8a-2d75cc4b7c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.326298 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d56caa-fca4-4056-bd8a-2d75cc4b7c11 admin admin] PATH_INFO: `/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01/groups/942bf468fd384fb099e21d325f1ca2f7/roles/4bcba8c3ff16483b9115020b5b886522` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.328833 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d56caa-fca4-4056-bd8a-2d75cc4b7c11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f8d2f2bddb7409bb80d51b644ee1f01, group_id=942bf468fd384fb099e21d325f1ca2f7, role_id=4bcba8c3ff16483b9115020b5b886522)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:32.329443 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d8e53-cd12-4a1b-a861-07b317b5c854 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:32.330332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: WARNING py.warnings [None req-b9d56caa-fca4-4056-bd8a-2d75cc4b7c11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:00:32.330332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: warnings.warn(msg) Oct 24 13:00:32.330332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: Oct 24 13:00:32.332709 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d56caa-fca4-4056-bd8a-2d75cc4b7c11 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:32.347370 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 130/269] 10.222.0.18 () {58 vars in 1463 bytes} [Mon Oct 24 13:00:32 2022] PUT /identity/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01/groups/942bf468fd384fb099e21d325f1ca2f7/roles/4bcba8c3ff16483b9115020b5b886522 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:00:32.354128 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d8e53-cd12-4a1b-a861-07b317b5c854 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:32.427541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33e88b-0aea-41ed-87e1-21469e74e8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:32.428443 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33e88b-0aea-41ed-87e1-21469e74e8cd admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.428885 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33e88b-0aea-41ed-87e1-21469e74e8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.429289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33e88b-0aea-41ed-87e1-21469e74e8cd admin admin] PATH_INFO: `/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.431446 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33e88b-0aea-41ed-87e1-21469e74e8cd admin admin] RBAC: Authorizing `identity:get_project(project_id=1f8d2f2bddb7409bb80d51b644ee1f01)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:32.433980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33e88b-0aea-41ed-87e1-21469e74e8cd admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:32.436236 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 140/270] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Oct 24 13:00:32 2022] GET /identity/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01 => generated 298 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:32.441948 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d56caa-fca4-4056-bd8a-2d75cc4b7c11 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:32.453990 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d56caa-fca4-4056-bd8a-2d75cc4b7c11 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:32.458778 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2358547-f2c6-434f-92a3-867f2408137d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:32.459976 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2358547-f2c6-434f-92a3-867f2408137d admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.460434 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2358547-f2c6-434f-92a3-867f2408137d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.460928 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2358547-f2c6-434f-92a3-867f2408137d admin admin] PATH_INFO: `/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01/groups/942bf468fd384fb099e21d325f1ca2f7/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.463375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2358547-f2c6-434f-92a3-867f2408137d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f8d2f2bddb7409bb80d51b644ee1f01, group_id=942bf468fd384fb099e21d325f1ca2f7, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:32.468315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2358547-f2c6-434f-92a3-867f2408137d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:32.484972 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 131/271] 10.222.0.18 () {58 vars in 1463 bytes} [Mon Oct 24 13:00:32 2022] PUT /identity/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01/groups/942bf468fd384fb099e21d325f1ca2f7/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:32.656982 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cc855-3e7c-4c2d-ab85-2b2164b797b9 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.657889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cc855-3e7c-4c2d-ab85-2b2164b797b9 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.658360 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cc855-3e7c-4c2d-ab85-2b2164b797b9 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.660429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 141/272] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:32.667467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89b086-0f46-4308-8cb1-2dbf010852ec None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.668159 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89b086-0f46-4308-8cb1-2dbf010852ec None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.668622 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89b086-0f46-4308-8cb1-2dbf010852ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.691981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-3c89b086-0f46-4308-8cb1-2dbf010852ec None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:32.693533 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3c89b086-0f46-4308-8cb1-2dbf010852ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:32.777747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 132/273] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:32.816559 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6cc855-3e7c-4c2d-ab85-2b2164b797b9 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:32.891984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6cc855-3e7c-4c2d-ab85-2b2164b797b9 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:32.898151 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ea546-6f71-4066-b709-a4b503bbf750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:32.899050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ea546-6f71-4066-b709-a4b503bbf750 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.899609 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ea546-6f71-4066-b709-a4b503bbf750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.900089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ea546-6f71-4066-b709-a4b503bbf750 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.911306 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ea546-6f71-4066-b709-a4b503bbf750 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:32.917152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-e28ea546-6f71-4066-b709-a4b503bbf750 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:00:32.917152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:32.917152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:32.917152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:32.917152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:32.917152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:32.917152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:32.917152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:32.917152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:32.917152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:32.917152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:32.917152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:32.917152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:32.917152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:32.917152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:32.917152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:32.918036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:32.918036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:32.918036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:32.918036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:32.918036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:32.918036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:32.918036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:32.918036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:32.918036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:32.918036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:32.918036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:32.918036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:32.918036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:32.918036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:32.918036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:32.918036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:32.918843 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:32.918843 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:32.918843 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:32.918843 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:32.918843 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:32.918843 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:32.918843 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:32.918843 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:32.918843 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:32.918843 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:32.918843 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:00:32.918843 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:32.921166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 142/274] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Oct 24 13:00:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:32.927050 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89b086-0f46-4308-8cb1-2dbf010852ec None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:32.942140 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89b086-0f46-4308-8cb1-2dbf010852ec None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:32.947562 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cf44a-df41-411e-b90d-4a0284b9afb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:32.948731 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cf44a-df41-411e-b90d-4a0284b9afb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.949203 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cf44a-df41-411e-b90d-4a0284b9afb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.949686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cf44a-df41-411e-b90d-4a0284b9afb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.950609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cf44a-df41-411e-b90d-4a0284b9afb3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:32.951127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cf44a-df41-411e-b90d-4a0284b9afb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:32.953034 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cf44a-df41-411e-b90d-4a0284b9afb3 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:32.966419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 133/275] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Oct 24 13:00:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:32.972171 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ea546-6f71-4066-b709-a4b503bbf750 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:32.983123 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ea546-6f71-4066-b709-a4b503bbf750 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:32.991350 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab9238-9ba9-41f4-b643-042cc4b4c0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:32.992873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab9238-9ba9-41f4-b643-042cc4b4c0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.993346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab9238-9ba9-41f4-b643-042cc4b4c0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.993883 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab9238-9ba9-41f4-b643-042cc4b4c0f6 admin admin] PATH_INFO: `/v3/groups/942bf468fd384fb099e21d325f1ca2f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.995205 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab9238-9ba9-41f4-b643-042cc4b4c0f6 admin admin] RBAC: Authorizing `identity:get_group(group_id=942bf468fd384fb099e21d325f1ca2f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:32.997395 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab9238-9ba9-41f4-b643-042cc4b4c0f6 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:33.003757 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 143/276] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Oct 24 13:00:32 2022] GET /identity/v3/groups/942bf468fd384fb099e21d325f1ca2f7 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:33.010048 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cf44a-df41-411e-b90d-4a0284b9afb3 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:33.020437 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cf44a-df41-411e-b90d-4a0284b9afb3 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:33.026417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49384531-6c80-4694-8dd2-f80452f907ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:33.027321 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49384531-6c80-4694-8dd2-f80452f907ac admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:33.027815 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49384531-6c80-4694-8dd2-f80452f907ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:33.028291 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49384531-6c80-4694-8dd2-f80452f907ac admin admin] PATH_INFO: `/v3/projects/a40f8a0ec4334236ab27bfadc581d177` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:33.029653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49384531-6c80-4694-8dd2-f80452f907ac admin admin] RBAC: Authorizing `identity:get_project(project_id=a40f8a0ec4334236ab27bfadc581d177)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:33.032119 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49384531-6c80-4694-8dd2-f80452f907ac admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:33.039069 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 134/277] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Oct 24 13:00:33 2022] GET /identity/v3/projects/a40f8a0ec4334236ab27bfadc581d177 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:33.040470 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab9238-9ba9-41f4-b643-042cc4b4c0f6 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:33.050834 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab9238-9ba9-41f4-b643-042cc4b4c0f6 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:33.058042 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0cd9e-de09-4aa2-87e4-8bd87c7edff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:33.058974 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0cd9e-de09-4aa2-87e4-8bd87c7edff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:33.059501 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0cd9e-de09-4aa2-87e4-8bd87c7edff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:33.059963 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0cd9e-de09-4aa2-87e4-8bd87c7edff1 admin admin] PATH_INFO: `/v3/projects/a40f8a0ec4334236ab27bfadc581d177/groups/942bf468fd384fb099e21d325f1ca2f7/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:33.062217 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0cd9e-de09-4aa2-87e4-8bd87c7edff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40f8a0ec4334236ab27bfadc581d177, group_id=942bf468fd384fb099e21d325f1ca2f7, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:33.063512 dv-cinder-862491-1-smb devstack@keystone.service[81600]: WARNING py.warnings [None req-96b0cd9e-de09-4aa2-87e4-8bd87c7edff1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:00:33.063512 dv-cinder-862491-1-smb devstack@keystone.service[81600]: warnings.warn(msg) Oct 24 13:00:33.063512 dv-cinder-862491-1-smb devstack@keystone.service[81600]: Oct 24 13:00:33.065856 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0cd9e-de09-4aa2-87e4-8bd87c7edff1 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:33.094687 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 144/278] 10.222.0.18 () {58 vars in 1463 bytes} [Mon Oct 24 13:00:33 2022] PUT /identity/v3/projects/a40f8a0ec4334236ab27bfadc581d177/groups/942bf468fd384fb099e21d325f1ca2f7/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:33.251323 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49384531-6c80-4694-8dd2-f80452f907ac admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:33.291362 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:33.379552 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49384531-6c80-4694-8dd2-f80452f907ac admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:33.416808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c6023-67d9-48c8-b00a-af9376e8b808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:33.417448 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6023-67d9-48c8-b00a-af9376e8b808 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:33.417725 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6023-67d9-48c8-b00a-af9376e8b808 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:33.417992 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6023-67d9-48c8-b00a-af9376e8b808 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:33.428852 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c6023-67d9-48c8-b00a-af9376e8b808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:33.435022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-330c6023-67d9-48c8-b00a-af9376e8b808 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:00:33.435022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:33.435022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:33.435022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:33.435022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:33.435022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:33.435022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:33.435022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:33.435022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:33.435022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:33.435022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:33.435022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:33.435022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:33.435022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:33.435022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:33.435022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:33.435986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:33.435986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:33.435986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:33.435986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:33.435986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:33.435986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:33.435986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:33.435986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:33.435986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:33.435986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:33.435986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:33.435986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:33.435986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:33.435986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:33.435986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:33.435986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:33.436759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:33.436759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:33.436759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:33.436759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:33.436759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:33.436759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:33.436759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:33.436759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:33.436759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:33.436759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:33.436759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 13:00:33.436759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:33.436759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 135/279] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:33.443787 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0cd9e-de09-4aa2-87e4-8bd87c7edff1 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:33.495987 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:33.580052 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0cd9e-de09-4aa2-87e4-8bd87c7edff1 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:33.623797 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15e70d-56d1-4ff5-9794-58b37700c307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:33.624418 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15e70d-56d1-4ff5-9794-58b37700c307 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:33.624691 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15e70d-56d1-4ff5-9794-58b37700c307 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:33.625013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15e70d-56d1-4ff5-9794-58b37700c307 None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:33.625690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15e70d-56d1-4ff5-9794-58b37700c307 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:33.625987 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15e70d-56d1-4ff5-9794-58b37700c307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:33.629171 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15e70d-56d1-4ff5-9794-58b37700c307 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:33.638498 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 145/280] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 24 13:00:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:33.643973 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c6023-67d9-48c8-b00a-af9376e8b808 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:33.697233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb73f12-53f1-4ae9-b61d-ba0a2a6a8604 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:33.698005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb73f12-53f1-4ae9-b61d-ba0a2a6a8604 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:33.698104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb73f12-53f1-4ae9-b61d-ba0a2a6a8604 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:33.699486 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 146/281] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:33.733408 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46bb61-9ca6-4b2c-8d1a-1456e32ebb07 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:33.733710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46bb61-9ca6-4b2c-8d1a-1456e32ebb07 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:33.733946 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46bb61-9ca6-4b2c-8d1a-1456e32ebb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:33.754087 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:33.765643 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-1d46bb61-9ca6-4b2c-8d1a-1456e32ebb07 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:33.766770 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-1d46bb61-9ca6-4b2c-8d1a-1456e32ebb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:33.768796 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c6023-67d9-48c8-b00a-af9376e8b808 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:33.823414 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebdfcf-ad5c-4998-9451-c195b8ff0799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:33.824421 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebdfcf-ad5c-4998-9451-c195b8ff0799 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:33.824890 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebdfcf-ad5c-4998-9451-c195b8ff0799 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:33.825359 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebdfcf-ad5c-4998-9451-c195b8ff0799 None admin] PATH_INFO: `/v3/users/2408cd16bcea4c82a01b0b40a9a30484` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:33.830687 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebdfcf-ad5c-4998-9451-c195b8ff0799 None admin] RBAC: Authorizing `identity:get_user(user_id=2408cd16bcea4c82a01b0b40a9a30484)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:33.832513 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebdfcf-ad5c-4998-9451-c195b8ff0799 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:33.834636 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 136/282] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:00:33 2022] GET /identity/v3/users/2408cd16bcea4c82a01b0b40a9a30484 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:33.840976 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebdfcf-ad5c-4998-9451-c195b8ff0799 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:33.853173 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 147/283] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 24 13:00:33.981608 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebdfcf-ad5c-4998-9451-c195b8ff0799 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:34.022018 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec677d-ecb2-4e3c-8d5d-42c9fadb4dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:34.022628 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec677d-ecb2-4e3c-8d5d-42c9fadb4dfe None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:34.022902 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec677d-ecb2-4e3c-8d5d-42c9fadb4dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:34.023231 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec677d-ecb2-4e3c-8d5d-42c9fadb4dfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:34.024822 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec677d-ecb2-4e3c-8d5d-42c9fadb4dfe None admin] RBAC: Adding query filter params (role.id=9d89ffc8145c487f80034d6daaf2f771, user.id=2408cd16bcea4c82a01b0b40a9a30484, scope.system=all) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:34.025086 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec677d-ecb2-4e3c-8d5d-42c9fadb4dfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:34.026517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec677d-ecb2-4e3c-8d5d-42c9fadb4dfe None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:34.042596 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 137/284] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Oct 24 13:00:33 2022] GET /identity/v3/role_assignments?user.id=2408cd16bcea4c82a01b0b40a9a30484&scope.system=all&role.id=9d89ffc8145c487f80034d6daaf2f771 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:34.133143 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408947b0-dd04-40b6-b642-6e53ad4093f3 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:34.133745 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408947b0-dd04-40b6-b642-6e53ad4093f3 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:34.134209 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408947b0-dd04-40b6-b642-6e53ad4093f3 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:34.136176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 148/285] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:34.141576 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e089b7-d48f-4a85-a9c2-257877c0f9f7 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:34.141861 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e089b7-d48f-4a85-a9c2-257877c0f9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:34.142134 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e089b7-d48f-4a85-a9c2-257877c0f9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:34.173307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-03e089b7-d48f-4a85-a9c2-257877c0f9f7 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:34.174504 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-03e089b7-d48f-4a85-a9c2-257877c0f9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:34.184408 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 138/286] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 24 13:00:34.434372 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408947b0-dd04-40b6-b642-6e53ad4093f3 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:34.447966 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408947b0-dd04-40b6-b642-6e53ad4093f3 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:34.456692 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2614763-8459-420f-b1e7-0a868b9fb7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:34.457646 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2614763-8459-420f-b1e7-0a868b9fb7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:34.458122 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2614763-8459-420f-b1e7-0a868b9fb7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:34.458581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2614763-8459-420f-b1e7-0a868b9fb7d9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:34.470769 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2614763-8459-420f-b1e7-0a868b9fb7d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:34.477343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-b2614763-8459-420f-b1e7-0a868b9fb7d9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:00:34.477343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:34.477343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:34.477343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:34.477343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:34.477343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:34.477343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:34.477343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:34.477343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:34.477343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:34.477343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:34.477343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:34.477343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:34.477343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:34.477343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:34.477343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:34.478237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:34.478237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:34.478237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:34.478237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:34.478237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:34.478237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:34.478237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:34.478237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:34.478237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:34.478237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:34.478237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:34.478237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:34.478237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:34.478237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:34.478237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:34.478237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:34.479050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:34.479050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:34.479050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:34.479050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:34.479050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:34.479050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:34.479050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:34.479050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:34.479050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:34.479050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:34.479050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:00:34.479050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:34.484033 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 149/287] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Oct 24 13:00:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:34.489473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e089b7-d48f-4a85-a9c2-257877c0f9f7 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:34.504621 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e089b7-d48f-4a85-a9c2-257877c0f9f7 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:34.517274 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7fa1e-ff33-4239-bcd4-2608a636164e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:34.517901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7fa1e-ff33-4239-bcd4-2608a636164e admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:34.518180 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7fa1e-ff33-4239-bcd4-2608a636164e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:34.518454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7fa1e-ff33-4239-bcd4-2608a636164e admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:34.519118 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd7fa1e-ff33-4239-bcd4-2608a636164e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:34.519414 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd7fa1e-ff33-4239-bcd4-2608a636164e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:34.521060 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd7fa1e-ff33-4239-bcd4-2608a636164e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:34.533915 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 139/288] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Oct 24 13:00:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:34.544675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2614763-8459-420f-b1e7-0a868b9fb7d9 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:34.555673 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2614763-8459-420f-b1e7-0a868b9fb7d9 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:34.564489 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3fb44-c8a1-4773-89f7-9c660c4a59bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:34.565421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3fb44-c8a1-4773-89f7-9c660c4a59bf admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:34.565937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3fb44-c8a1-4773-89f7-9c660c4a59bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:34.566427 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3fb44-c8a1-4773-89f7-9c660c4a59bf admin admin] PATH_INFO: `/v3/groups/942bf468fd384fb099e21d325f1ca2f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:34.567784 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3fb44-c8a1-4773-89f7-9c660c4a59bf admin admin] RBAC: Authorizing `identity:get_group(group_id=942bf468fd384fb099e21d325f1ca2f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:34.570024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3fb44-c8a1-4773-89f7-9c660c4a59bf admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:34.571907 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 150/289] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Oct 24 13:00:34 2022] GET /identity/v3/groups/942bf468fd384fb099e21d325f1ca2f7 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:34.577591 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7fa1e-ff33-4239-bcd4-2608a636164e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:34.588799 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:34.593956 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7fa1e-ff33-4239-bcd4-2608a636164e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:34.605328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3fb44-c8a1-4773-89f7-9c660c4a59bf admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:34.608138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a5c42-0f13-46ad-9d4e-1799f2f0538a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:34.608795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a5c42-0f13-46ad-9d4e-1799f2f0538a admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:34.609075 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a5c42-0f13-46ad-9d4e-1799f2f0538a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:34.609348 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a5c42-0f13-46ad-9d4e-1799f2f0538a admin admin] PATH_INFO: `/v3/projects/a40f8a0ec4334236ab27bfadc581d177` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:34.610515 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a5c42-0f13-46ad-9d4e-1799f2f0538a admin admin] RBAC: Authorizing `identity:get_project(project_id=a40f8a0ec4334236ab27bfadc581d177)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:34.612628 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a5c42-0f13-46ad-9d4e-1799f2f0538a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:34.614579 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 140/290] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Oct 24 13:00:34 2022] GET /identity/v3/projects/a40f8a0ec4334236ab27bfadc581d177 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:34.619296 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3fb44-c8a1-4773-89f7-9c660c4a59bf admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:34.619851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a5c42-0f13-46ad-9d4e-1799f2f0538a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:34.624340 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88728d9-dedf-4e43-a6f0-e21b812adffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:34.625321 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88728d9-dedf-4e43-a6f0-e21b812adffc admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:34.625842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88728d9-dedf-4e43-a6f0-e21b812adffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:34.626350 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88728d9-dedf-4e43-a6f0-e21b812adffc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:34.632133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a5c42-0f13-46ad-9d4e-1799f2f0538a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:34.639321 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b4033-8e37-44bf-902b-fc801f587bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:34.640062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b4033-8e37-44bf-902b-fc801f587bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:34.640341 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b4033-8e37-44bf-902b-fc801f587bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:34.640611 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b4033-8e37-44bf-902b-fc801f587bf6 admin admin] PATH_INFO: `/v3/projects/a40f8a0ec4334236ab27bfadc581d177/groups/942bf468fd384fb099e21d325f1ca2f7/roles/4bcba8c3ff16483b9115020b5b886522` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:34.642498 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88728d9-dedf-4e43-a6f0-e21b812adffc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:34.645210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b4033-8e37-44bf-902b-fc801f587bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40f8a0ec4334236ab27bfadc581d177, group_id=942bf468fd384fb099e21d325f1ca2f7, role_id=4bcba8c3ff16483b9115020b5b886522)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:34.647919 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b4033-8e37-44bf-902b-fc801f587bf6 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:34.649581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-b88728d9-dedf-4e43-a6f0-e21b812adffc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:00:34.649581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:34.649581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:34.649581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:34.649581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:34.649581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:34.649581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:34.649581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:34.649581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:34.649581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:34.649581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:34.649581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:34.649581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:34.649581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:34.649581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:34.649581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:34.650662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:34.650662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:34.650662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:34.650662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:34.650662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:34.650662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:34.650662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:34.650662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:34.650662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:34.650662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:34.650662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:34.650662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:34.650662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:34.650662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:34.650662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:34.650662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:34.651465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:34.651465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:34.651465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:34.651465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:34.651465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:34.651465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:34.651465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:34.651465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:34.651465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:34.651465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:34.651465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:00:34.651465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:34.654185 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 151/291] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Oct 24 13:00:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:34.659823 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88728d9-dedf-4e43-a6f0-e21b812adffc admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:34.670243 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 141/292] 10.222.0.18 () {58 vars in 1463 bytes} [Mon Oct 24 13:00:34 2022] PUT /identity/v3/projects/a40f8a0ec4334236ab27bfadc581d177/groups/942bf468fd384fb099e21d325f1ca2f7/roles/4bcba8c3ff16483b9115020b5b886522 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:00:34.676258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88728d9-dedf-4e43-a6f0-e21b812adffc admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:34.708637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:34.746852 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94ecb8-f9ba-4c47-af97-7e8e3c634825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:34.747485 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94ecb8-f9ba-4c47-af97-7e8e3c634825 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:34.747763 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94ecb8-f9ba-4c47-af97-7e8e3c634825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:34.748033 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94ecb8-f9ba-4c47-af97-7e8e3c634825 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:34.748700 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94ecb8-f9ba-4c47-af97-7e8e3c634825 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:34.748998 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94ecb8-f9ba-4c47-af97-7e8e3c634825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:34.750084 dv-cinder-862491-1-smb devstack@keystone.service[81600]: WARNING py.warnings [None req-2b94ecb8-f9ba-4c47-af97-7e8e3c634825 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:00:34.750084 dv-cinder-862491-1-smb devstack@keystone.service[81600]: warnings.warn(msg) Oct 24 13:00:34.750084 dv-cinder-862491-1-smb devstack@keystone.service[81600]: Oct 24 13:00:34.750992 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94ecb8-f9ba-4c47-af97-7e8e3c634825 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:34.762654 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 152/293] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Oct 24 13:00:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:34.767979 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b4033-8e37-44bf-902b-fc801f587bf6 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:34.782185 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b4033-8e37-44bf-902b-fc801f587bf6 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:34.797389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cfe51-b4aa-4f1a-bb1f-01435f48bf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:34.798079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cfe51-b4aa-4f1a-bb1f-01435f48bf0c admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:34.798342 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cfe51-b4aa-4f1a-bb1f-01435f48bf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:34.798631 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cfe51-b4aa-4f1a-bb1f-01435f48bf0c admin admin] PATH_INFO: `/v3/groups/5c412471fdd8479bb758d1f6ec9570de` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:34.812265 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501cfe51-b4aa-4f1a-bb1f-01435f48bf0c admin admin] RBAC: Authorizing `identity:get_group(group_id=5c412471fdd8479bb758d1f6ec9570de)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:34.814292 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501cfe51-b4aa-4f1a-bb1f-01435f48bf0c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:34.816320 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 142/294] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Oct 24 13:00:34 2022] GET /identity/v3/groups/5c412471fdd8479bb758d1f6ec9570de => generated 229 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:34.822304 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94ecb8-f9ba-4c47-af97-7e8e3c634825 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:34.832862 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94ecb8-f9ba-4c47-af97-7e8e3c634825 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:34.838046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf349360-7057-4ebc-aa39-bc0fee093fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:34.838689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf349360-7057-4ebc-aa39-bc0fee093fab admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:34.838964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf349360-7057-4ebc-aa39-bc0fee093fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:34.839233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf349360-7057-4ebc-aa39-bc0fee093fab admin admin] PATH_INFO: `/v3/projects/7194e8c8c8e64421a9a7846d67cb33c7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:34.840471 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf349360-7057-4ebc-aa39-bc0fee093fab admin admin] RBAC: Authorizing `identity:get_project(project_id=7194e8c8c8e64421a9a7846d67cb33c7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:34.842396 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf349360-7057-4ebc-aa39-bc0fee093fab admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:34.844709 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 153/295] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Oct 24 13:00:34 2022] GET /identity/v3/projects/7194e8c8c8e64421a9a7846d67cb33c7 => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:34.850189 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cfe51-b4aa-4f1a-bb1f-01435f48bf0c admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:34.860977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cfe51-b4aa-4f1a-bb1f-01435f48bf0c admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:34.871854 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37a4b6-983d-4c3b-b020-00d0d95fa3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:34.872549 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37a4b6-983d-4c3b-b020-00d0d95fa3b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:34.872828 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37a4b6-983d-4c3b-b020-00d0d95fa3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:34.873105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37a4b6-983d-4c3b-b020-00d0d95fa3b3 admin admin] PATH_INFO: `/v3/projects/7194e8c8c8e64421a9a7846d67cb33c7/groups/5c412471fdd8479bb758d1f6ec9570de/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:34.880962 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37a4b6-983d-4c3b-b020-00d0d95fa3b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7194e8c8c8e64421a9a7846d67cb33c7, group_id=5c412471fdd8479bb758d1f6ec9570de, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:34.884925 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37a4b6-983d-4c3b-b020-00d0d95fa3b3 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:34.906976 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 143/296] 10.222.0.18 () {58 vars in 1463 bytes} [Mon Oct 24 13:00:34 2022] PUT /identity/v3/projects/7194e8c8c8e64421a9a7846d67cb33c7/groups/5c412471fdd8479bb758d1f6ec9570de/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:35.781498 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82435df4-4684-4356-9a4e-137d31271929 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:35.781994 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82435df4-4684-4356-9a4e-137d31271929 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:35.782096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82435df4-4684-4356-9a4e-137d31271929 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:35.783606 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 154/297] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:35.789986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81cae2-1411-4770-93ab-16a595df159b None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:35.790532 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81cae2-1411-4770-93ab-16a595df159b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:35.790532 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81cae2-1411-4770-93ab-16a595df159b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:35.810017 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-1f81cae2-1411-4770-93ab-16a595df159b None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:35.811122 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1f81cae2-1411-4770-93ab-16a595df159b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:35.899204 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 144/298] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:36.103264 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f570855-9f7d-42fe-9049-4f1ce625dae6 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:36.103622 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f570855-9f7d-42fe-9049-4f1ce625dae6 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:36.103788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f570855-9f7d-42fe-9049-4f1ce625dae6 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:36.105238 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 155/299] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:36.110971 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14899580-615d-436c-b3a0-cedae80ead53 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:36.111259 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14899580-615d-436c-b3a0-cedae80ead53 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:36.111557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14899580-615d-436c-b3a0-cedae80ead53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:36.131637 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-14899580-615d-436c-b3a0-cedae80ead53 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:36.133442 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-14899580-615d-436c-b3a0-cedae80ead53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:36.221410 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 145/300] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:36.301940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0e66a-a0c9-46bd-8ff9-81e88d1f7ef8 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:36.302243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0e66a-a0c9-46bd-8ff9-81e88d1f7ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:36.302469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0e66a-a0c9-46bd-8ff9-81e88d1f7ef8 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:36.304106 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 156/301] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:36.309611 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a0b6a-ad19-4330-9782-6e2a6bf67a17 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:36.310116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a0b6a-ad19-4330-9782-6e2a6bf67a17 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:36.310576 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a0b6a-ad19-4330-9782-6e2a6bf67a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:36.331440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b95a0b6a-ad19-4330-9782-6e2a6bf67a17 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:36.332943 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b95a0b6a-ad19-4330-9782-6e2a6bf67a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:36.355354 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:36.404130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 146/302] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:36.419188 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0e66a-a0c9-46bd-8ff9-81e88d1f7ef8 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:36.559234 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0e66a-a0c9-46bd-8ff9-81e88d1f7ef8 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:36.595130 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d7f6f-29cf-43dc-9f80-4ea6d9f3a3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:36.596006 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d7f6f-29cf-43dc-9f80-4ea6d9f3a3f9 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:36.596417 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d7f6f-29cf-43dc-9f80-4ea6d9f3a3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:36.596819 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d7f6f-29cf-43dc-9f80-4ea6d9f3a3f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:36.609473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d7f6f-29cf-43dc-9f80-4ea6d9f3a3f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:36.614732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-061d7f6f-29cf-43dc-9f80-4ea6d9f3a3f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:00:36.614732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:36.614732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:36.614732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:36.614732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:36.614732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:36.614732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:36.614732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:36.614732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:36.614732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:36.614732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:36.614732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:36.614732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:36.614732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:36.614732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:36.614732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:36.615793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:36.615793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:36.615793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:36.615793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:36.615793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:36.615793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:36.615793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:36.615793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:36.615793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:36.615793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:36.615793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:36.615793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:36.615793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:36.615793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:36.615793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:36.615793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:36.616761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:36.616761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:36.616761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:36.616761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:36.616761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:36.616761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:36.616761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:36.616761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:36.616761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:36.616761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:36.616761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:00:36.616761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:36.619222 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 157/303] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 24 13:00:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:36.624901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a0b6a-ad19-4330-9782-6e2a6bf67a17 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:36.662983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d7f6f-29cf-43dc-9f80-4ea6d9f3a3f9 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:36.682472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:36.766141 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a0b6a-ad19-4330-9782-6e2a6bf67a17 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:36.794226 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d7f6f-29cf-43dc-9f80-4ea6d9f3a3f9 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:36.808641 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84758c2b-6dfb-462e-8943-d2b7762fa61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:36.809177 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84758c2b-6dfb-462e-8943-d2b7762fa61d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:36.809454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84758c2b-6dfb-462e-8943-d2b7762fa61d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:36.809722 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84758c2b-6dfb-462e-8943-d2b7762fa61d None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:36.810380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84758c2b-6dfb-462e-8943-d2b7762fa61d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:36.810674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84758c2b-6dfb-462e-8943-d2b7762fa61d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:36.812287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84758c2b-6dfb-462e-8943-d2b7762fa61d None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:36.821468 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 147/304] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:36.822540 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84758c2b-6dfb-462e-8943-d2b7762fa61d None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:36.836713 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f73ed7-65f2-4974-ba41-ffaa60ac28c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:36.837860 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f73ed7-65f2-4974-ba41-ffaa60ac28c2 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:36.838310 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f73ed7-65f2-4974-ba41-ffaa60ac28c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:36.838874 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f73ed7-65f2-4974-ba41-ffaa60ac28c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:36.843187 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:36.851018 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f73ed7-65f2-4974-ba41-ffaa60ac28c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:36.857740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-98f73ed7-65f2-4974-ba41-ffaa60ac28c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:00:36.857740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:36.857740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:36.857740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:36.857740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:36.857740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:36.857740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:36.857740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:36.857740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:36.857740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:36.857740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:36.857740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:36.857740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:36.857740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:36.857740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:36.857740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:36.858631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:36.858631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:36.858631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:36.858631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:36.858631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:36.858631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:36.858631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:36.858631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:36.858631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:36.858631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:36.858631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:36.858631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:36.858631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:36.858631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:36.858631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:36.858631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:36.859414 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:36.859414 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:36.859414 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:36.859414 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:36.859414 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:36.859414 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:36.859414 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:36.859414 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:36.859414 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:36.859414 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:36.859414 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:00:36.859414 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:36.861808 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 158/305] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:36.862816 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f73ed7-65f2-4974-ba41-ffaa60ac28c2 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:36.933671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84758c2b-6dfb-462e-8943-d2b7762fa61d None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:36.948914 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:36.975112 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373b08b-d9d5-4c9d-a0df-d12846f51b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:36.976078 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373b08b-d9d5-4c9d-a0df-d12846f51b6d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:36.977216 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373b08b-d9d5-4c9d-a0df-d12846f51b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:36.978015 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373b08b-d9d5-4c9d-a0df-d12846f51b6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:36.991660 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f73ed7-65f2-4974-ba41-ffaa60ac28c2 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:36.993544 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373b08b-d9d5-4c9d-a0df-d12846f51b6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:36.999280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-6373b08b-d9d5-4c9d-a0df-d12846f51b6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:00:36.999280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:36.999280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:36.999280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:36.999280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:36.999280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:36.999280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:36.999280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:36.999280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:36.999280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:36.999280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:36.999280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:36.999280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:36.999280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:36.999280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:36.999280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:37.000307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:37.000307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:37.000307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:37.000307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:37.000307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:37.000307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:37.000307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:37.000307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:37.000307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:37.000307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:37.000307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:37.000307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:37.000307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:37.000307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:37.000307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:37.000307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:37.001111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:37.001111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:37.001111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:37.001111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:37.001111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:37.001111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:37.001111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:37.001111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:37.001111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:37.001111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:37.001111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 13:00:37.001111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:37.003631 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 148/306] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:37.004709 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373b08b-d9d5-4c9d-a0df-d12846f51b6d None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:37.042594 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0eaac-c2ca-438c-93ae-c8c888469301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:37.043235 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0eaac-c2ca-438c-93ae-c8c888469301 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:37.043540 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0eaac-c2ca-438c-93ae-c8c888469301 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:37.043821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0eaac-c2ca-438c-93ae-c8c888469301 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:37.108970 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:37.135341 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373b08b-d9d5-4c9d-a0df-d12846f51b6d None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:37.149053 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0eaac-c2ca-438c-93ae-c8c888469301 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:37.151017 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0eaac-c2ca-438c-93ae-c8c888469301 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:37.180756 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503682d-81f4-49a0-9311-30738f18be4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:37.181736 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503682d-81f4-49a0-9311-30738f18be4c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:37.182214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503682d-81f4-49a0-9311-30738f18be4c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:37.182770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503682d-81f4-49a0-9311-30738f18be4c None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:37.183662 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503682d-81f4-49a0-9311-30738f18be4c None admin] RBAC: Adding query filter params (name=member) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:37.184211 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503682d-81f4-49a0-9311-30738f18be4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:37.185880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503682d-81f4-49a0-9311-30738f18be4c None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:37.194729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 149/307] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 24 13:00:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:37.200354 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503682d-81f4-49a0-9311-30738f18be4c None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:37.235707 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:37.277826 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 159/308] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:00:37.278686 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0eaac-c2ca-438c-93ae-c8c888469301 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:37.339001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503682d-81f4-49a0-9311-30738f18be4c None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:37.385872 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9646466-8a6f-4780-8cc7-a1da75abfd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:37.387315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9646466-8a6f-4780-8cc7-a1da75abfd03 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:37.387792 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9646466-8a6f-4780-8cc7-a1da75abfd03 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:37.388500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9646466-8a6f-4780-8cc7-a1da75abfd03 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:37.389349 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9646466-8a6f-4780-8cc7-a1da75abfd03 None admin] RBAC: Adding query filter params (name=member) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:37.390081 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9646466-8a6f-4780-8cc7-a1da75abfd03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:37.392501 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9646466-8a6f-4780-8cc7-a1da75abfd03 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:37.400362 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0eaac-c2ca-438c-93ae-c8c888469301 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:37.408935 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 150/309] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 24 13:00:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:37.410021 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9646466-8a6f-4780-8cc7-a1da75abfd03 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:37.416474 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:37.441118 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b91ab-8a2a-4daf-8ae4-c214378f1708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:37.441821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b91ab-8a2a-4daf-8ae4-c214378f1708 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:37.442169 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b91ab-8a2a-4daf-8ae4-c214378f1708 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:37.442509 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b91ab-8a2a-4daf-8ae4-c214378f1708 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:37.485125 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:37.532584 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b91ab-8a2a-4daf-8ae4-c214378f1708 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:37.534387 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b91ab-8a2a-4daf-8ae4-c214378f1708 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:37.557500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9646466-8a6f-4780-8cc7-a1da75abfd03 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:37.605826 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399274a-1a68-4e62-8d21-194331d7ce2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:37.606575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399274a-1a68-4e62-8d21-194331d7ce2d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:37.606926 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399274a-1a68-4e62-8d21-194331d7ce2d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:37.607325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399274a-1a68-4e62-8d21-194331d7ce2d None admin] PATH_INFO: `/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:37.608599 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399274a-1a68-4e62-8d21-194331d7ce2d None admin] RBAC: Authorizing `identity:get_project(project_id=1f8d2f2bddb7409bb80d51b644ee1f01)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:37.610352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399274a-1a68-4e62-8d21-194331d7ce2d None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:37.612387 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 151/310] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:00:37 2022] GET /identity/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:37.613260 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399274a-1a68-4e62-8d21-194331d7ce2d None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:37.673597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 160/311] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:00:37.674478 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b91ab-8a2a-4daf-8ae4-c214378f1708 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:37.707689 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:37.751478 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399274a-1a68-4e62-8d21-194331d7ce2d None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:37.760747 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:37.793994 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9e8f7-0b4b-476e-a3c3-823d94e2e318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:37.794788 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9e8f7-0b4b-476e-a3c3-823d94e2e318 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:37.795170 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9e8f7-0b4b-476e-a3c3-823d94e2e318 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:37.795577 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9e8f7-0b4b-476e-a3c3-823d94e2e318 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:37.804335 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b91ab-8a2a-4daf-8ae4-c214378f1708 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:37.855587 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce196b14-56e9-4901-a859-a60ec256269d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:37.856617 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce196b14-56e9-4901-a859-a60ec256269d None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:37.857127 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce196b14-56e9-4901-a859-a60ec256269d None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:37.857540 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce196b14-56e9-4901-a859-a60ec256269d None admin] PATH_INFO: `/v3/groups/942bf468fd384fb099e21d325f1ca2f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:37.858815 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce196b14-56e9-4901-a859-a60ec256269d None admin] RBAC: Authorizing `identity:get_group(group_id=942bf468fd384fb099e21d325f1ca2f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:37.860584 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce196b14-56e9-4901-a859-a60ec256269d None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:37.862336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 161/312] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Oct 24 13:00:37 2022] GET /identity/v3/groups/942bf468fd384fb099e21d325f1ca2f7 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:37.863396 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce196b14-56e9-4901-a859-a60ec256269d None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:37.878049 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9e8f7-0b4b-476e-a3c3-823d94e2e318 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:37.879542 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9e8f7-0b4b-476e-a3c3-823d94e2e318 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:37.982911 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:37.988429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce196b14-56e9-4901-a859-a60ec256269d None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:38.023995 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 152/313] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:00:38.025538 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1b38c-d88d-463f-874e-909f1b617d17 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.025538 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1b38c-d88d-463f-874e-909f1b617d17 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.025832 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1b38c-d88d-463f-874e-909f1b617d17 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:38.027147 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 153/314] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:38.029839 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1b38c-d88d-463f-874e-909f1b617d17 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:38.034675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94933d-2da8-4cb1-82eb-c69601e90728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:38.035315 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94933d-2da8-4cb1-82eb-c69601e90728 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.035624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94933d-2da8-4cb1-82eb-c69601e90728 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.035895 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94933d-2da8-4cb1-82eb-c69601e90728 None admin] PATH_INFO: `/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:38.037038 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94933d-2da8-4cb1-82eb-c69601e90728 None admin] RBAC: Authorizing `identity:get_project(project_id=1f8d2f2bddb7409bb80d51b644ee1f01)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:38.038491 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94933d-2da8-4cb1-82eb-c69601e90728 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:38.040856 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 162/315] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:00:37 2022] GET /identity/v3/projects/1f8d2f2bddb7409bb80d51b644ee1f01 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:38.042452 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43eef7e-352b-4c7c-bc33-b5609c9897da None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.043055 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43eef7e-352b-4c7c-bc33-b5609c9897da None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.043332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43eef7e-352b-4c7c-bc33-b5609c9897da None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:38.045336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 163/316] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:38.047577 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43eef7e-352b-4c7c-bc33-b5609c9897da None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:38.052546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:38.150187 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1b38c-d88d-463f-874e-909f1b617d17 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:38.165686 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43eef7e-352b-4c7c-bc33-b5609c9897da None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:38.193215 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcbf86-ad20-419b-92e3-db94c73c400a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:38.193819 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcbf86-ad20-419b-92e3-db94c73c400a None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.194096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcbf86-ad20-419b-92e3-db94c73c400a None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.194367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcbf86-ad20-419b-92e3-db94c73c400a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:38.195085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcbf86-ad20-419b-92e3-db94c73c400a None admin] RBAC: Adding query filter params (group.id=942bf468fd384fb099e21d325f1ca2f7, role.id=4bcba8c3ff16483b9115020b5b886522, scope.project.id=1f8d2f2bddb7409bb80d51b644ee1f01) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:38.196124 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcbf86-ad20-419b-92e3-db94c73c400a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:38.197620 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcbf86-ad20-419b-92e3-db94c73c400a None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:38.204605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 154/317] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Oct 24 13:00:38 2022] GET /identity/v3/role_assignments?group.id=942bf468fd384fb099e21d325f1ca2f7&scope.project.id=1f8d2f2bddb7409bb80d51b644ee1f01&role.id=4bcba8c3ff16483b9115020b5b886522 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:38.205016 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc6571-9f7e-4a35-bc49-60a53a3997e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:38.205627 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496e59c-001f-47bf-946b-f0c4d56ee8d7 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.205732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc6571-9f7e-4a35-bc49-60a53a3997e2 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.205904 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496e59c-001f-47bf-946b-f0c4d56ee8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.206011 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc6571-9f7e-4a35-bc49-60a53a3997e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.206243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc6571-9f7e-4a35-bc49-60a53a3997e2 None admin] PATH_INFO: `/v3/projects/a40f8a0ec4334236ab27bfadc581d177` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:38.207368 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc6571-9f7e-4a35-bc49-60a53a3997e2 None admin] RBAC: Authorizing `identity:get_project(project_id=a40f8a0ec4334236ab27bfadc581d177)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:38.208278 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496e59c-001f-47bf-946b-f0c4d56ee8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:38.208949 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc6571-9f7e-4a35-bc49-60a53a3997e2 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:38.210673 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 164/318] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:00:38 2022] GET /identity/v3/projects/a40f8a0ec4334236ab27bfadc581d177 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:38.213261 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc6571-9f7e-4a35-bc49-60a53a3997e2 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:38.231046 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-0496e59c-001f-47bf-946b-f0c4d56ee8d7 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:38.232297 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0496e59c-001f-47bf-946b-f0c4d56ee8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:38.269653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:38.310893 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:38.319382 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 155/319] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:38.322181 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bebcfa-11ac-4566-b176-148cb3dc307a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.322542 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bebcfa-11ac-4566-b176-148cb3dc307a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.322887 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bebcfa-11ac-4566-b176-148cb3dc307a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:38.344249 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-10bebcfa-11ac-4566-b176-148cb3dc307a None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:38.345681 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-10bebcfa-11ac-4566-b176-148cb3dc307a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:38.355149 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc6571-9f7e-4a35-bc49-60a53a3997e2 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:38.406344 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89a5be-d7fe-4578-87bc-075a8965f910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:38.407794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89a5be-d7fe-4578-87bc-075a8965f910 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.408245 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89a5be-d7fe-4578-87bc-075a8965f910 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.408947 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89a5be-d7fe-4578-87bc-075a8965f910 None admin] PATH_INFO: `/v3/groups/942bf468fd384fb099e21d325f1ca2f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:38.410525 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89a5be-d7fe-4578-87bc-075a8965f910 None admin] RBAC: Authorizing `identity:get_group(group_id=942bf468fd384fb099e21d325f1ca2f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:38.412590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89a5be-d7fe-4578-87bc-075a8965f910 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:38.415627 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 165/320] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Oct 24 13:00:38 2022] GET /identity/v3/groups/942bf468fd384fb099e21d325f1ca2f7 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:38.416180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89a5be-d7fe-4578-87bc-075a8965f910 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:38.434818 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 156/321] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:38.435693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bebcfa-11ac-4566-b176-148cb3dc307a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:38.550390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89a5be-d7fe-4578-87bc-075a8965f910 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:38.556141 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:38.564864 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bebcfa-11ac-4566-b176-148cb3dc307a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:38.603887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba661040-fe85-4713-b2ad-52481f557472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:38.604880 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba661040-fe85-4713-b2ad-52481f557472 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.605355 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba661040-fe85-4713-b2ad-52481f557472 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.605897 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba661040-fe85-4713-b2ad-52481f557472 None admin] PATH_INFO: `/v3/groups/942bf468fd384fb099e21d325f1ca2f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:38.607241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba661040-fe85-4713-b2ad-52481f557472 None admin] RBAC: Authorizing `identity:get_group(group_id=942bf468fd384fb099e21d325f1ca2f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:38.608777 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f822331-3b5b-4224-89a0-4eb3ebfded47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:38.609205 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba661040-fe85-4713-b2ad-52481f557472 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:38.609390 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f822331-3b5b-4224-89a0-4eb3ebfded47 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.609671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f822331-3b5b-4224-89a0-4eb3ebfded47 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.609945 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f822331-3b5b-4224-89a0-4eb3ebfded47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:38.610670 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f822331-3b5b-4224-89a0-4eb3ebfded47 None admin] RBAC: Adding query filter params (group.id=942bf468fd384fb099e21d325f1ca2f7, role.id=b2da36c699a445fda4d2372471051f41, scope.project.id=1f8d2f2bddb7409bb80d51b644ee1f01) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:38.610976 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f822331-3b5b-4224-89a0-4eb3ebfded47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:38.612035 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 166/322] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Oct 24 13:00:38 2022] GET /identity/v3/groups/942bf468fd384fb099e21d325f1ca2f7 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:38.612498 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f822331-3b5b-4224-89a0-4eb3ebfded47 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:38.618727 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba661040-fe85-4713-b2ad-52481f557472 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:38.620284 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 157/323] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Oct 24 13:00:38 2022] GET /identity/v3/role_assignments?group.id=942bf468fd384fb099e21d325f1ca2f7&scope.project.id=1f8d2f2bddb7409bb80d51b644ee1f01&role.id=b2da36c699a445fda4d2372471051f41 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:38.634388 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:38.678618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f822331-3b5b-4224-89a0-4eb3ebfded47 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:38.747324 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba661040-fe85-4713-b2ad-52481f557472 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:38.787471 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae0f89-a1a8-4d9f-8c1b-e01f5fca46bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:38.788103 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae0f89-a1a8-4d9f-8c1b-e01f5fca46bd None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.788383 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae0f89-a1a8-4d9f-8c1b-e01f5fca46bd None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.788655 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae0f89-a1a8-4d9f-8c1b-e01f5fca46bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:38.789458 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae0f89-a1a8-4d9f-8c1b-e01f5fca46bd None admin] RBAC: Adding query filter params (group.id=942bf468fd384fb099e21d325f1ca2f7, role.id=b2da36c699a445fda4d2372471051f41, scope.project.id=a40f8a0ec4334236ab27bfadc581d177) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:38.789737 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae0f89-a1a8-4d9f-8c1b-e01f5fca46bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:38.791375 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae0f89-a1a8-4d9f-8c1b-e01f5fca46bd None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:38.800415 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 167/324] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Oct 24 13:00:38 2022] GET /identity/v3/role_assignments?group.id=942bf468fd384fb099e21d325f1ca2f7&scope.project.id=a40f8a0ec4334236ab27bfadc581d177&role.id=b2da36c699a445fda4d2372471051f41 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:38.801398 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae0f89-a1a8-4d9f-8c1b-e01f5fca46bd None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:38.822882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f822331-3b5b-4224-89a0-4eb3ebfded47 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:38.869902 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c92843-50c9-423a-99f9-46fc4bc4b87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:38.870574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c92843-50c9-423a-99f9-46fc4bc4b87f None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.870857 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c92843-50c9-423a-99f9-46fc4bc4b87f None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.871131 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c92843-50c9-423a-99f9-46fc4bc4b87f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:38.888077 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c92843-50c9-423a-99f9-46fc4bc4b87f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:38.894808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-08c92843-50c9-423a-99f9-46fc4bc4b87f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:00:38.894808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:38.894808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:38.894808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:38.894808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:38.894808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:38.894808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:38.894808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:38.894808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:38.894808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:38.894808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:38.894808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:38.894808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:38.894808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:38.894808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:38.894808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:38.895884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:38.895884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:38.895884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:38.895884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:38.895884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:38.895884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:38.895884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:38.895884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:38.895884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:38.895884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:38.895884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:38.895884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:38.895884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:38.895884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:38.895884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:38.895884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:38.897574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:38.897574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:38.897574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:38.897574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:38.897574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:38.897574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:38.897574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:38.897574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:38.897574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:38.897574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:38.897574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:00:38.897574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:38.897574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 158/325] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 24 13:00:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:38.903290 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c92843-50c9-423a-99f9-46fc4bc4b87f None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:38.904874 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:38.939860 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:38.950059 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae0f89-a1a8-4d9f-8c1b-e01f5fca46bd None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:38.997596 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328d02d-1b20-4c37-8c4a-a4b307ab59dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:38.998254 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328d02d-1b20-4c37-8c4a-a4b307ab59dd None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.998531 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328d02d-1b20-4c37-8c4a-a4b307ab59dd None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.998803 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328d02d-1b20-4c37-8c4a-a4b307ab59dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:39.013236 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328d02d-1b20-4c37-8c4a-a4b307ab59dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:39.018605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-5328d02d-1b20-4c37-8c4a-a4b307ab59dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:00:39.018605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:39.018605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:39.018605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:39.018605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:39.018605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:39.018605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:39.018605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:39.018605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:39.018605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:39.018605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:39.018605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:39.018605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:39.018605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:39.018605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:39.018605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:39.019786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:39.019786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:39.019786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:39.019786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:39.019786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:39.019786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:39.019786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:39.019786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:39.019786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:39.019786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:39.019786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:39.019786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:39.019786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:39.019786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:39.019786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:39.019786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:39.020723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:39.020723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:39.020723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:39.020723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:39.020723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:39.020723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:39.020723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:39.020723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:39.020723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:39.020723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:39.020723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:00:39.020723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:39.020723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 168/326] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 24 13:00:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:39.026676 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328d02d-1b20-4c37-8c4a-a4b307ab59dd None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:39.047230 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c92843-50c9-423a-99f9-46fc4bc4b87f None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:39.095513 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1511a-37bd-4caf-9d3d-8bdd5d106075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:39.096014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1511a-37bd-4caf-9d3d-8bdd5d106075 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:39.096289 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1511a-37bd-4caf-9d3d-8bdd5d106075 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:39.096557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1511a-37bd-4caf-9d3d-8bdd5d106075 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:39.098088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1511a-37bd-4caf-9d3d-8bdd5d106075 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:39.098088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1511a-37bd-4caf-9d3d-8bdd5d106075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:39.099729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1511a-37bd-4caf-9d3d-8bdd5d106075 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:39.113547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 159/327] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:39.115729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1511a-37bd-4caf-9d3d-8bdd5d106075 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:39.157177 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328d02d-1b20-4c37-8c4a-a4b307ab59dd None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:39.193751 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:39.200622 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc38bbd-eda0-42d2-95f5-1f48693e26d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:39.201235 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc38bbd-eda0-42d2-95f5-1f48693e26d6 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:39.201509 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc38bbd-eda0-42d2-95f5-1f48693e26d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:39.201774 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc38bbd-eda0-42d2-95f5-1f48693e26d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:39.202443 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc38bbd-eda0-42d2-95f5-1f48693e26d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:39.203166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc38bbd-eda0-42d2-95f5-1f48693e26d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:39.205011 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc38bbd-eda0-42d2-95f5-1f48693e26d6 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:39.212479 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:39.219589 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 169/328] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:39.221138 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc38bbd-eda0-42d2-95f5-1f48693e26d6 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:39.237530 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1511a-37bd-4caf-9d3d-8bdd5d106075 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:39.277076 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc71a5-6a2b-4cc9-9e0d-5c3a01dff194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:39.277715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc71a5-6a2b-4cc9-9e0d-5c3a01dff194 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:39.277991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc71a5-6a2b-4cc9-9e0d-5c3a01dff194 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:39.278256 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc71a5-6a2b-4cc9-9e0d-5c3a01dff194 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:39.338018 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc38bbd-eda0-42d2-95f5-1f48693e26d6 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:39.357311 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc71a5-6a2b-4cc9-9e0d-5c3a01dff194 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:39.358723 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc71a5-6a2b-4cc9-9e0d-5c3a01dff194 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:39.376220 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699f86a-a9c3-46ea-9ca8-2c54f72d5216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:39.376832 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699f86a-a9c3-46ea-9ca8-2c54f72d5216 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:39.377108 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699f86a-a9c3-46ea-9ca8-2c54f72d5216 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:39.377487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699f86a-a9c3-46ea-9ca8-2c54f72d5216 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:39.449772 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:39.454212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:39.459472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699f86a-a9c3-46ea-9ca8-2c54f72d5216 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:39.460232 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699f86a-a9c3-46ea-9ca8-2c54f72d5216 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:39.477449 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 160/329] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:00:39.483125 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc71a5-6a2b-4cc9-9e0d-5c3a01dff194 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:39.576057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 170/330] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:00:39.577136 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699f86a-a9c3-46ea-9ca8-2c54f72d5216 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:39.600103 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc71a5-6a2b-4cc9-9e0d-5c3a01dff194 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:39.633976 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1efee0-e966-44a8-a9dc-04b483671936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:39.634519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1efee0-e966-44a8-a9dc-04b483671936 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:39.634795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1efee0-e966-44a8-a9dc-04b483671936 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:39.635060 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1efee0-e966-44a8-a9dc-04b483671936 None admin] PATH_INFO: `/v3/projects/a40f8a0ec4334236ab27bfadc581d177` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:39.636189 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1efee0-e966-44a8-a9dc-04b483671936 None admin] RBAC: Authorizing `identity:get_project(project_id=a40f8a0ec4334236ab27bfadc581d177)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:39.637632 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1efee0-e966-44a8-a9dc-04b483671936 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:39.639214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 161/331] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:00:39 2022] GET /identity/v3/projects/a40f8a0ec4334236ab27bfadc581d177 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:39.644652 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1efee0-e966-44a8-a9dc-04b483671936 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:39.668688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:39.675288 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699f86a-a9c3-46ea-9ca8-2c54f72d5216 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:39.694122 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:39.709738 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d1e79-4cdb-40df-99d6-722403b6ed3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:39.710362 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d1e79-4cdb-40df-99d6-722403b6ed3b None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:39.710640 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d1e79-4cdb-40df-99d6-722403b6ed3b None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:39.710994 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d1e79-4cdb-40df-99d6-722403b6ed3b None admin] PATH_INFO: `/v3/projects/7194e8c8c8e64421a9a7846d67cb33c7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:39.712302 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d1e79-4cdb-40df-99d6-722403b6ed3b None admin] RBAC: Authorizing `identity:get_project(project_id=7194e8c8c8e64421a9a7846d67cb33c7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:39.713758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d1e79-4cdb-40df-99d6-722403b6ed3b None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:39.715377 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 171/332] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:00:39 2022] GET /identity/v3/projects/7194e8c8c8e64421a9a7846d67cb33c7 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:39.720761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d1e79-4cdb-40df-99d6-722403b6ed3b None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:39.745895 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1efee0-e966-44a8-a9dc-04b483671936 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:39.779149 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296103e-6d82-4282-97bd-b170e4470a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:39.779802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296103e-6d82-4282-97bd-b170e4470a4a None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:39.780081 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296103e-6d82-4282-97bd-b170e4470a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:39.780355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296103e-6d82-4282-97bd-b170e4470a4a None admin] PATH_INFO: `/v3/groups/942bf468fd384fb099e21d325f1ca2f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:39.781448 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296103e-6d82-4282-97bd-b170e4470a4a None admin] RBAC: Authorizing `identity:get_group(group_id=942bf468fd384fb099e21d325f1ca2f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:39.782897 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296103e-6d82-4282-97bd-b170e4470a4a None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:39.784639 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 162/333] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Oct 24 13:00:39 2022] GET /identity/v3/groups/942bf468fd384fb099e21d325f1ca2f7 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:39.790345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296103e-6d82-4282-97bd-b170e4470a4a None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:39.821074 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d1e79-4cdb-40df-99d6-722403b6ed3b None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:39.855073 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47e37b-0732-4494-8af1-f60bea307b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:39.855730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47e37b-0732-4494-8af1-f60bea307b84 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:39.856009 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47e37b-0732-4494-8af1-f60bea307b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:39.856281 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47e37b-0732-4494-8af1-f60bea307b84 None admin] PATH_INFO: `/v3/groups/5c412471fdd8479bb758d1f6ec9570de` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:39.857370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47e37b-0732-4494-8af1-f60bea307b84 None admin] RBAC: Authorizing `identity:get_group(group_id=5c412471fdd8479bb758d1f6ec9570de)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:39.858808 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47e37b-0732-4494-8af1-f60bea307b84 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:39.860401 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 172/334] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Oct 24 13:00:39 2022] GET /identity/v3/groups/5c412471fdd8479bb758d1f6ec9570de => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:39.866055 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47e37b-0732-4494-8af1-f60bea307b84 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:39.888049 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296103e-6d82-4282-97bd-b170e4470a4a None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:39.896204 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:39.904362 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:39.923684 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838587d3-6dde-4deb-b886-bc5a612ca5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:39.924278 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838587d3-6dde-4deb-b886-bc5a612ca5a5 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:39.924549 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838587d3-6dde-4deb-b886-bc5a612ca5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:39.924818 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838587d3-6dde-4deb-b886-bc5a612ca5a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:39.925523 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838587d3-6dde-4deb-b886-bc5a612ca5a5 None admin] RBAC: Adding query filter params (group.id=942bf468fd384fb099e21d325f1ca2f7, role.id=4bcba8c3ff16483b9115020b5b886522, scope.project.id=a40f8a0ec4334236ab27bfadc581d177) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:39.925852 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838587d3-6dde-4deb-b886-bc5a612ca5a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:39.927263 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838587d3-6dde-4deb-b886-bc5a612ca5a5 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:39.933689 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 163/335] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Oct 24 13:00:39 2022] GET /identity/v3/role_assignments?group.id=942bf468fd384fb099e21d325f1ca2f7&scope.project.id=a40f8a0ec4334236ab27bfadc581d177&role.id=4bcba8c3ff16483b9115020b5b886522 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:39.969921 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47e37b-0732-4494-8af1-f60bea307b84 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:40.006833 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e2726-2bec-4567-b6ba-39d5743d5d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:40.007469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e2726-2bec-4567-b6ba-39d5743d5d5a None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:40.007758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e2726-2bec-4567-b6ba-39d5743d5d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:40.008036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e2726-2bec-4567-b6ba-39d5743d5d5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:40.008944 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e2726-2bec-4567-b6ba-39d5743d5d5a None admin] RBAC: Adding query filter params (group.id=5c412471fdd8479bb758d1f6ec9570de, role.id=23ca6ecd60b2470cba913daeaf54f0f7, scope.project.id=7194e8c8c8e64421a9a7846d67cb33c7) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:40.009242 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e2726-2bec-4567-b6ba-39d5743d5d5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:40.010704 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e2726-2bec-4567-b6ba-39d5743d5d5a None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:40.017136 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 173/336] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Oct 24 13:00:39 2022] GET /identity/v3/role_assignments?group.id=5c412471fdd8479bb758d1f6ec9570de&scope.project.id=7194e8c8c8e64421a9a7846d67cb33c7&role.id=23ca6ecd60b2470cba913daeaf54f0f7 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:42.652805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a9c42-91ee-4ad0-b1ad-e08a2ace031e None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:42.653374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a9c42-91ee-4ad0-b1ad-e08a2ace031e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:42.653374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a9c42-91ee-4ad0-b1ad-e08a2ace031e None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:42.654984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 164/337] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:42.660233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232ad63-ec42-4d79-8632-b1236e8509f3 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:42.661069 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232ad63-ec42-4d79-8632-b1236e8509f3 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:42.661537 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232ad63-ec42-4d79-8632-b1236e8509f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:42.688065 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-9232ad63-ec42-4d79-8632-b1236e8509f3 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:42.689690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-9232ad63-ec42-4d79-8632-b1236e8509f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:42.787452 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 174/338] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:42.822085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a2de3-a4e8-47b8-8445-1bc451343bf8 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:42.822266 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a2de3-a4e8-47b8-8445-1bc451343bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:42.822526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a2de3-a4e8-47b8-8445-1bc451343bf8 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:42.824376 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 165/339] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:42.829800 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ca63e-2891-426a-92c5-d790273ae7f0 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:42.830082 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ca63e-2891-426a-92c5-d790273ae7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:42.830350 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ca63e-2891-426a-92c5-d790273ae7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:42.852807 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-240ca63e-2891-426a-92c5-d790273ae7f0 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:42.853986 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-240ca63e-2891-426a-92c5-d790273ae7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:42.880353 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:42.949499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 175/340] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:43.235694 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a2de3-a4e8-47b8-8445-1bc451343bf8 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:43.249554 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ca63e-2891-426a-92c5-d790273ae7f0 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:43.394177 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a2de3-a4e8-47b8-8445-1bc451343bf8 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:43.421851 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ca63e-2891-426a-92c5-d790273ae7f0 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:43.459693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682edb2-d520-4322-969b-01636efd20dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:43.460789 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682edb2-d520-4322-969b-01636efd20dc None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:43.461979 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682edb2-d520-4322-969b-01636efd20dc None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:43.462677 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682edb2-d520-4322-969b-01636efd20dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:43.463684 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc5cc2-6c01-4fc9-820e-66c1e2a766a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:43.464665 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc5cc2-6c01-4fc9-820e-66c1e2a766a7 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:43.465318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc5cc2-6c01-4fc9-820e-66c1e2a766a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:43.466127 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc5cc2-6c01-4fc9-820e-66c1e2a766a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:43.474494 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682edb2-d520-4322-969b-01636efd20dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:43.475947 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682edb2-d520-4322-969b-01636efd20dc None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:43.479390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc5cc2-6c01-4fc9-820e-66c1e2a766a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:43.481142 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc5cc2-6c01-4fc9-820e-66c1e2a766a7 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:43.491338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-9682edb2-d520-4322-969b-01636efd20dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:43.491338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:43.491338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:43.491338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:43.491338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:43.491338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:43.491338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:43.491338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:43.491338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:43.491338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:43.491338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:43.491338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:43.491338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:43.491338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:43.491338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:43.491338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:43.492526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:43.492526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:43.492526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:43.492526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:43.492526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:43.492526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:43.492526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:43.492526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:43.492526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:43.492526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:43.492526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:43.492526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:43.492526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:43.492526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:43.492526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:43.492526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:43.492526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:43.493453 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:43.493453 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:43.493453 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:43.493453 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 166/341] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:43.494069 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f23a8c-5b17-4073-a1c5-8559e15febea None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:43.494315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f23a8c-5b17-4073-a1c5-8559e15febea None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:43.494577 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f23a8c-5b17-4073-a1c5-8559e15febea None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:43.499483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 167/342] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:43.499483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41344443-c189-4335-b4a7-1e4be56c052c None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:43.499483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41344443-c189-4335-b4a7-1e4be56c052c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:43.499483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41344443-c189-4335-b4a7-1e4be56c052c None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:43.499483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 168/343] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:43.503568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41344443-c189-4335-b4a7-1e4be56c052c None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:43.506792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-08cc5cc2-6c01-4fc9-820e-66c1e2a766a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:43.506792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:43.506792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:43.506792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:43.506792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:43.506792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:43.506792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:43.506792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:43.506792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:43.506792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:43.506792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:43.506792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:43.506792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:43.506792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:43.506792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:43.506792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:43.507695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:43.507695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:43.507695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:43.507695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:43.507695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:43.507695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:43.507695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:43.507695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:43.507695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:43.507695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:43.507695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:43.507695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:43.507695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:43.507695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:43.507695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:43.507695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:43.507695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:43.508606 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:43.508606 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:43.508606 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:43.509139 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 176/344] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:43.510137 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de9cd1-1551-4f4e-a9ac-9cb9e8b922cb None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:43.510417 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de9cd1-1551-4f4e-a9ac-9cb9e8b922cb None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:43.510685 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de9cd1-1551-4f4e-a9ac-9cb9e8b922cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:43.524411 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:43.530192 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-d8de9cd1-1551-4f4e-a9ac-9cb9e8b922cb None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:43.531397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d8de9cd1-1551-4f4e-a9ac-9cb9e8b922cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:43.543878 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:43.606655 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 177/345] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:43.612623 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031613a-e71a-4501-9992-23940ca118e3 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:43.612945 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031613a-e71a-4501-9992-23940ca118e3 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:43.614041 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031613a-e71a-4501-9992-23940ca118e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:43.628791 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41344443-c189-4335-b4a7-1e4be56c052c None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:43.636316 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-b031613a-e71a-4501-9992-23940ca118e3 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:43.637485 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b031613a-e71a-4501-9992-23940ca118e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:43.668749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2aaf1e-88b7-4719-920c-98eab50648f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:43.670584 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2aaf1e-88b7-4719-920c-98eab50648f9 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:43.671085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2aaf1e-88b7-4719-920c-98eab50648f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:43.671603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2aaf1e-88b7-4719-920c-98eab50648f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:43.672518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2aaf1e-88b7-4719-920c-98eab50648f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:43.673021 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2aaf1e-88b7-4719-920c-98eab50648f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:43.674766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2aaf1e-88b7-4719-920c-98eab50648f9 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:43.688077 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 169/346] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:43.689233 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2aaf1e-88b7-4719-920c-98eab50648f9 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:43.728719 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 178/347] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:43.729613 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031613a-e71a-4501-9992-23940ca118e3 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:43.813000 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:43.819144 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:43.841242 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2aaf1e-88b7-4719-920c-98eab50648f9 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:43.862700 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031613a-e71a-4501-9992-23940ca118e3 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:43.901535 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274952fe-4c2f-43fc-b436-b8b164db9eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:43.902141 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274952fe-4c2f-43fc-b436-b8b164db9eb0 None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:43.902414 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274952fe-4c2f-43fc-b436-b8b164db9eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:43.902681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274952fe-4c2f-43fc-b436-b8b164db9eb0 None admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:43.903318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274952fe-4c2f-43fc-b436-b8b164db9eb0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:43.905371 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274952fe-4c2f-43fc-b436-b8b164db9eb0 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:43.918483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74d578-6745-48cd-a8c9-c282a136f00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:43.919486 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74d578-6745-48cd-a8c9-c282a136f00c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:43.919988 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74d578-6745-48cd-a8c9-c282a136f00c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:43.920804 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74d578-6745-48cd-a8c9-c282a136f00c None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:43.921699 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74d578-6745-48cd-a8c9-c282a136f00c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:43.922350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74d578-6745-48cd-a8c9-c282a136f00c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:43.923980 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74d578-6745-48cd-a8c9-c282a136f00c None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:43.938784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 170/349] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:43.940010 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74d578-6745-48cd-a8c9-c282a136f00c None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:43.947461 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 179/349] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 24 13:00:43 2022] POST /identity/v3/users => generated 246 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:00:43.950868 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274952fe-4c2f-43fc-b436-b8b164db9eb0 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:44.134275 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74d578-6745-48cd-a8c9-c282a136f00c None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:44.149312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274952fe-4c2f-43fc-b436-b8b164db9eb0 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:44.176868 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c70636-679b-4923-bea0-e1ceff9092b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:44.177507 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c70636-679b-4923-bea0-e1ceff9092b9 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:44.177786 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c70636-679b-4923-bea0-e1ceff9092b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:44.178049 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c70636-679b-4923-bea0-e1ceff9092b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:44.179198 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:44.189113 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c70636-679b-4923-bea0-e1ceff9092b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:44.190605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c70636-679b-4923-bea0-e1ceff9092b9 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:44.194984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634da16-988f-4553-b5a5-5bd267aacaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:44.195701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634da16-988f-4553-b5a5-5bd267aacaaa None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:44.195992 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634da16-988f-4553-b5a5-5bd267aacaaa None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:44.196244 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634da16-988f-4553-b5a5-5bd267aacaaa None admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:44.197462 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634da16-988f-4553-b5a5-5bd267aacaaa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:44.198554 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634da16-988f-4553-b5a5-5bd267aacaaa None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:44.210419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-64c70636-679b-4923-bea0-e1ceff9092b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:44.210419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:44.210419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:44.210419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:44.210419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:44.210419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:44.210419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:44.210419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:44.210419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:44.210419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:44.210419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:44.210419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:44.210419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:44.210419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:44.210419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:44.210419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:44.212127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:44.212127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:44.212127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:44.212127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:44.212127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:44.212127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:44.212127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:44.212127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:44.212127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:44.212127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:44.212127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:44.212127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:44.212127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:44.212127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:44.212127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:44.212127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:44.212127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:44.212975 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:44.212975 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:44.212975 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:44.212975 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 171/350] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:44.216765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c70636-679b-4923-bea0-e1ceff9092b9 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:44.221164 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:44.233914 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 180/351] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 24 13:00:43 2022] POST /identity/v3/users => generated 248 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:00:44.234942 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634da16-988f-4553-b5a5-5bd267aacaaa None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:44.358450 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634da16-988f-4553-b5a5-5bd267aacaaa None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:44.407502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744872b-fabe-40c4-8ccc-df33d5c24c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:44.408279 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744872b-fabe-40c4-8ccc-df33d5c24c3f None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:44.408561 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744872b-fabe-40c4-8ccc-df33d5c24c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:44.408836 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744872b-fabe-40c4-8ccc-df33d5c24c3f None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:44.409908 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744872b-fabe-40c4-8ccc-df33d5c24c3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:44.410215 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744872b-fabe-40c4-8ccc-df33d5c24c3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:44.411722 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744872b-fabe-40c4-8ccc-df33d5c24c3f None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:44.425721 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c70636-679b-4923-bea0-e1ceff9092b9 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:44.427169 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 181/352] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:44.440126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744872b-fabe-40c4-8ccc-df33d5c24c3f None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:44.511406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9d7de-8ffb-4dd7-bd93-70f55867febc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:44.512072 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9d7de-8ffb-4dd7-bd93-70f55867febc None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:44.512351 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9d7de-8ffb-4dd7-bd93-70f55867febc None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:44.512623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9d7de-8ffb-4dd7-bd93-70f55867febc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:44.518389 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:44.527174 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f9d7de-8ffb-4dd7-bd93-70f55867febc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:44.528769 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f9d7de-8ffb-4dd7-bd93-70f55867febc None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:44.550335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-35f9d7de-8ffb-4dd7-bd93-70f55867febc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:44.550335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:44.550335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:44.550335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:44.550335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:44.550335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:44.550335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:44.550335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:44.550335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:44.550335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:44.550335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:44.550335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:44.550335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:44.550335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:44.550335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:44.550335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:44.551276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:44.551276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:44.551276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:44.551276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:44.551276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:44.551276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:44.551276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:44.551276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:44.551276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:44.551276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:44.551276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:44.551276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:44.551276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:44.551276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:44.551276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:44.551276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:44.551276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:44.552171 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:44.552171 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:44.552171 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:44.552171 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 172/353] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:44.552171 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7e073-f70d-464f-93d1-689e796ed77f None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:44.552457 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7e073-f70d-464f-93d1-689e796ed77f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:44.552544 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7e073-f70d-464f-93d1-689e796ed77f None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:44.558142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 173/354] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:44.559044 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7e073-f70d-464f-93d1-689e796ed77f None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:44.594078 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744872b-fabe-40c4-8ccc-df33d5c24c3f None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:44.623719 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:44.634653 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597682ff-8913-42c0-9d7e-8267846f2104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:44.635627 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597682ff-8913-42c0-9d7e-8267846f2104 None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:44.636147 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597682ff-8913-42c0-9d7e-8267846f2104 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:44.636561 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597682ff-8913-42c0-9d7e-8267846f2104 None admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:44.637436 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597682ff-8913-42c0-9d7e-8267846f2104 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:44.639187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597682ff-8913-42c0-9d7e-8267846f2104 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:44.666194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 182/355] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 24 13:00:44 2022] POST /identity/v3/users => generated 249 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:00:44.671719 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ba8d0-78ec-4a6a-b8b5-a57384d0b726 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:44.671719 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ba8d0-78ec-4a6a-b8b5-a57384d0b726 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:44.671719 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ba8d0-78ec-4a6a-b8b5-a57384d0b726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:44.685935 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7e073-f70d-464f-93d1-689e796ed77f None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:44.703751 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-e50ba8d0-78ec-4a6a-b8b5-a57384d0b726 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:44.705128 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-e50ba8d0-78ec-4a6a-b8b5-a57384d0b726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:44.767467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf8fcd-faf5-4038-80b5-bf7067994222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:44.768102 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf8fcd-faf5-4038-80b5-bf7067994222 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:44.768383 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf8fcd-faf5-4038-80b5-bf7067994222 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:44.768653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf8fcd-faf5-4038-80b5-bf7067994222 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:44.769306 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf8fcd-faf5-4038-80b5-bf7067994222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:44.769607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf8fcd-faf5-4038-80b5-bf7067994222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:44.771015 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf8fcd-faf5-4038-80b5-bf7067994222 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:44.805992 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 174/356] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:44.810729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf8fcd-faf5-4038-80b5-bf7067994222 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:44.867159 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 183/357] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:44.944034 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf8fcd-faf5-4038-80b5-bf7067994222 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:44.963222 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:44.983733 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1289618-cfa7-41ae-a50a-972c03116133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:44.984342 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1289618-cfa7-41ae-a50a-972c03116133 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:44.984616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1289618-cfa7-41ae-a50a-972c03116133 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:44.984881 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1289618-cfa7-41ae-a50a-972c03116133 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:44.985524 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1289618-cfa7-41ae-a50a-972c03116133 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:44.986972 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1289618-cfa7-41ae-a50a-972c03116133 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:45.022238 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 175/358] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 24 13:00:44 2022] POST /identity/v3/users => generated 248 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:00:45.153578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ba8d0-78ec-4a6a-b8b5-a57384d0b726 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:45.183679 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:45.286420 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ba8d0-78ec-4a6a-b8b5-a57384d0b726 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:45.328189 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88c712-5c7e-49db-bb41-2190fc450486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:45.328804 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88c712-5c7e-49db-bb41-2190fc450486 None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:45.329084 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88c712-5c7e-49db-bb41-2190fc450486 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:45.329355 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88c712-5c7e-49db-bb41-2190fc450486 None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:45.330036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88c712-5c7e-49db-bb41-2190fc450486 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:45.331457 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88c712-5c7e-49db-bb41-2190fc450486 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:45.343580 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.sql.core [None req-5c88c712-5c7e-49db-bb41-2190fc450486 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 24 13:00:45.343580 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 24 13:00:45.343580 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [parameters: {'id': 'a8272c5a9bd34ae7a06c4c8c0fc63fa3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 24 13:00:45.343580 dv-cinder-862491-1-smb devstack@keystone.service[81600]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81600) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 13:00:45.360406 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-5c88c712-5c7e-49db-bb41-2190fc450486 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 24 13:00:45.360406 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:45.360406 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 13:00:45.360406 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 13:00:45.360406 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 13:00:45.360406 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 13:00:45.360406 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 13:00:45.360406 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 13:00:45.360406 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 13:00:45.360406 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application conn.query(q) Oct 24 13:00:45.360406 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 13:00:45.360406 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 13:00:45.360406 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 13:00:45.360406 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application result.read() Oct 24 13:00:45.360406 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 13:00:45.361374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 13:00:45.361374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 13:00:45.361374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 13:00:45.361374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 13:00:45.361374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 13:00:45.361374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 13:00:45.361374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 13:00:45.361374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 24 13:00:45.361374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:45.361374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 13:00:45.361374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:45.361374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:45.361374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 13:00:45.361374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 13:00:45.361374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 24 13:00:45.361374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return ref.to_dict() Oct 24 13:00:45.361374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 13:00:45.361374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application next(self.gen) Oct 24 13:00:45.362307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 13:00:45.362307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application yield resource Oct 24 13:00:45.362307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 13:00:45.362307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application next(self.gen) Oct 24 13:00:45.362307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 13:00:45.362307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 13:00:45.362307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 13:00:45.362307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 13:00:45.362307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 13:00:45.362307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise self.value Oct 24 13:00:45.362307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 13:00:45.362307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 13:00:45.362307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 13:00:45.362307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application session.commit() Oct 24 13:00:45.362307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 13:00:45.362307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 13:00:45.362307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 13:00:45.364024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 13:00:45.364024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 13:00:45.364024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self.session.flush() Oct 24 13:00:45.364024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 13:00:45.364024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 13:00:45.364024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 13:00:45.364024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 13:00:45.364024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 13:00:45.364024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application compat.raise_( Oct 24 13:00:45.364024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 13:00:45.364024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception Oct 24 13:00:45.364024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 13:00:45.364024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 13:00:45.364024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 13:00:45.364024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 13:00:45.364024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 13:00:45.364024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 13:00:45.365369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 13:00:45.365369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 13:00:45.365369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 24 13:00:45.365369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 24 13:00:45.365369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 13:00:45.365369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 13:00:45.365369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 13:00:45.365369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 13:00:45.365369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 13:00:45.365369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 13:00:45.365369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 13:00:45.365369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 13:00:45.365369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 13:00:45.365369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 13:00:45.365369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 13:00:45.365369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception Oct 24 13:00:45.368097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 13:00:45.368097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 13:00:45.368097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 13:00:45.368097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 13:00:45.368097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 13:00:45.368097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 13:00:45.368097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 13:00:45.368097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application conn.query(q) Oct 24 13:00:45.368097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 13:00:45.368097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 13:00:45.368097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 13:00:45.368097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application result.read() Oct 24 13:00:45.368097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 13:00:45.368097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 13:00:45.368097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 13:00:45.368097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 13:00:45.370433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 13:00:45.370433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 13:00:45.370433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 13:00:45.370433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 13:00:45.370433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 24 13:00:45.370433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 24 13:00:45.370433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [parameters: {'id': 'a8272c5a9bd34ae7a06c4c8c0fc63fa3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 24 13:00:45.370433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 13:00:45.370433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:45.370433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:45.370433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:45.370433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:45.370433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:45.370433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:45.370433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:45.370433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:45.373444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:45.373444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:45.373444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:45.373444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:45.373444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:45.373444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:45.373444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 24 13:00:45.373444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 24 13:00:45.373444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:45.373444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:45.373444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 24 13:00:45.373444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 24 13:00:45.373444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 13:00:45.373444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 13:00:45.373444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 24 13:00:45.373444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:45.375574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 184/359] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Oct 24 13:00:45 2022] POST /identity/v3/roles => generated 144 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:45.375716 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1289618-cfa7-41ae-a50a-972c03116133 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:45.504175 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1289618-cfa7-41ae-a50a-972c03116133 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:45.554470 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d0c1f-9669-49f5-9769-d26c0afdffde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:45.555143 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d0c1f-9669-49f5-9769-d26c0afdffde None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:45.555413 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d0c1f-9669-49f5-9769-d26c0afdffde None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:45.555897 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d0c1f-9669-49f5-9769-d26c0afdffde None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:45.571264 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d0c1f-9669-49f5-9769-d26c0afdffde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:45.580669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-cc5d0c1f-9669-49f5-9769-d26c0afdffde None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:00:45.580669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:45.580669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:45.580669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:45.580669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:45.580669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:45.580669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:45.580669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:45.580669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:45.580669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:45.580669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:45.580669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:45.580669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:45.580669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:45.580669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:45.580669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:45.581571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:45.581571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:45.581571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:45.581571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:45.581571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:45.581571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:45.581571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:45.581571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:45.581571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:45.581571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:45.581571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:45.581571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:45.581571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:45.581571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:45.581571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:45.581571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:45.582390 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:45.582390 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:45.582390 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:45.582390 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:45.582390 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:45.582390 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:45.582390 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:45.582390 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:45.582390 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:45.582390 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:45.582390 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 13:00:45.582390 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:45.582390 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 176/360] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 24 13:00:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:45.592485 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88c712-5c7e-49db-bb41-2190fc450486 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:45.707184 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:45.724268 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88c712-5c7e-49db-bb41-2190fc450486 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:45.775156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e15c7-c1d6-446b-be76-f52481135387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:45.775813 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e15c7-c1d6-446b-be76-f52481135387 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:45.776094 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e15c7-c1d6-446b-be76-f52481135387 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:45.776367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e15c7-c1d6-446b-be76-f52481135387 None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:45.777045 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e15c7-c1d6-446b-be76-f52481135387 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:45.777343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e15c7-c1d6-446b-be76-f52481135387 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:45.778723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e15c7-c1d6-446b-be76-f52481135387 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:45.791612 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 185/361] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:46.552492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59836497-b68e-4d87-9a74-b594a3c72187 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:46.552973 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59836497-b68e-4d87-9a74-b594a3c72187 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:46.553078 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59836497-b68e-4d87-9a74-b594a3c72187 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:46.554639 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 177/362] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:46.560394 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5b587-9d13-469d-8137-dc9bfb4e5994 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:46.560811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5b587-9d13-469d-8137-dc9bfb4e5994 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:46.561000 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5b587-9d13-469d-8137-dc9bfb4e5994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:46.579994 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-65b5b587-9d13-469d-8137-dc9bfb4e5994 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:46.581203 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-65b5b587-9d13-469d-8137-dc9bfb4e5994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:46.650332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 186/363] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:46.920752 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59836497-b68e-4d87-9a74-b594a3c72187 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:46.953316 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:47.051124 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59836497-b68e-4d87-9a74-b594a3c72187 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:47.093211 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcab56c-e596-44c9-94f0-dd00f28de7bb None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:47.093535 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcab56c-e596-44c9-94f0-dd00f28de7bb None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:47.093761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcab56c-e596-44c9-94f0-dd00f28de7bb None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:47.095518 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 187/364] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:00:47.101209 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f3174-fba0-46be-ab81-3e88eb5bf569 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:47.101343 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69491618-c2d4-4dd6-9c0c-4c4f84a9097c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:47.101536 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f3174-fba0-46be-ab81-3e88eb5bf569 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:47.101862 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f3174-fba0-46be-ab81-3e88eb5bf569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:47.101963 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69491618-c2d4-4dd6-9c0c-4c4f84a9097c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:47.102389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69491618-c2d4-4dd6-9c0c-4c4f84a9097c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:47.102727 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69491618-c2d4-4dd6-9c0c-4c4f84a9097c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:47.114365 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69491618-c2d4-4dd6-9c0c-4c4f84a9097c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:47.120204 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-69491618-c2d4-4dd6-9c0c-4c4f84a9097c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:47.120204 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:47.120204 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:47.120204 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:47.120204 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:47.120204 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:47.120204 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:47.120204 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:47.120204 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:47.120204 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:47.120204 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:47.120204 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:47.120204 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:47.120204 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:47.120204 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:47.120204 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:47.122290 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:47.122290 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:47.122290 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:47.122290 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:47.122290 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:47.122290 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:47.122290 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:47.122290 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:47.122290 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:47.122290 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:47.122290 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:47.122290 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:47.122290 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:47.122290 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:47.122290 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:47.122290 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:47.124257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:47.124257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:47.124257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:47.124257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:47.124257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:47.124257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:47.124257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:47.124257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:47.124257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:47.124257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:47.124257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:47.124257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:47.124257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 178/365] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:47.131441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69491618-c2d4-4dd6-9c0c-4c4f84a9097c None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:47.132625 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-fa2f3174-fba0-46be-ab81-3e88eb5bf569 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:47.134529 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-fa2f3174-fba0-46be-ab81-3e88eb5bf569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:47.276756 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 188/366] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:00:47.281901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:47.293286 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69491618-c2d4-4dd6-9c0c-4c4f84a9097c None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:47.334026 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0aacd-7c87-46cb-8a03-83f97df81df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:47.334685 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0aacd-7c87-46cb-8a03-83f97df81df6 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:47.334965 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0aacd-7c87-46cb-8a03-83f97df81df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:47.335230 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0aacd-7c87-46cb-8a03-83f97df81df6 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:47.335968 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0aacd-7c87-46cb-8a03-83f97df81df6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:47.336417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0aacd-7c87-46cb-8a03-83f97df81df6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:47.337902 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0aacd-7c87-46cb-8a03-83f97df81df6 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:47.346418 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 179/367] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 24 13:00:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:47.352127 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f3174-fba0-46be-ab81-3e88eb5bf569 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:47.372296 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:47.417274 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2518c2-5ba2-415a-acc4-5da229349852 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:47.417565 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2518c2-5ba2-415a-acc4-5da229349852 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:47.417839 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2518c2-5ba2-415a-acc4-5da229349852 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:47.419285 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 180/368] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:00:47.424523 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87661b7f-f512-49ee-9de1-b8fecd6bc35c None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:47.425044 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87661b7f-f512-49ee-9de1-b8fecd6bc35c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:47.425516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87661b7f-f512-49ee-9de1-b8fecd6bc35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:47.445803 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-87661b7f-f512-49ee-9de1-b8fecd6bc35c None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:47.447380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-87661b7f-f512-49ee-9de1-b8fecd6bc35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:47.525487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f3174-fba0-46be-ab81-3e88eb5bf569 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:47.558825 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 181/369] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:00:47.585539 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490800a-1934-4a54-8d07-278d1af0edc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:47.586298 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490800a-1934-4a54-8d07-278d1af0edc8 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:47.586583 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490800a-1934-4a54-8d07-278d1af0edc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:47.586853 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490800a-1934-4a54-8d07-278d1af0edc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:47.603093 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490800a-1934-4a54-8d07-278d1af0edc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:47.604702 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490800a-1934-4a54-8d07-278d1af0edc8 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:47.626492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-e490800a-1934-4a54-8d07-278d1af0edc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:47.626492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:47.626492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:47.626492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:47.626492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:47.626492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:47.626492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:47.626492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:47.626492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:47.626492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:47.626492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:47.626492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:47.626492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:47.626492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:47.626492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:47.626492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:47.627469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:47.627469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:47.627469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:47.627469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:47.627469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:47.627469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:47.627469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:47.627469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:47.627469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:47.627469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:47.627469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:47.627469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:47.627469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:47.627469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:47.627469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:47.627469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:47.627469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:47.628353 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:47.628353 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:47.628353 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:47.628353 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 189/370] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:47.633851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87661b7f-f512-49ee-9de1-b8fecd6bc35c None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:47.675567 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490800a-1934-4a54-8d07-278d1af0edc8 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:47.797073 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:47.801933 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:47.835927 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87661b7f-f512-49ee-9de1-b8fecd6bc35c None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:47.875871 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad537166-2cb1-4e8e-8ee5-cdff2e10eee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:47.876485 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad537166-2cb1-4e8e-8ee5-cdff2e10eee6 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:47.876824 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad537166-2cb1-4e8e-8ee5-cdff2e10eee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:47.877101 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad537166-2cb1-4e8e-8ee5-cdff2e10eee6 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:47.877856 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad537166-2cb1-4e8e-8ee5-cdff2e10eee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:47.878159 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad537166-2cb1-4e8e-8ee5-cdff2e10eee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:47.879557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad537166-2cb1-4e8e-8ee5-cdff2e10eee6 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:47.891240 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490800a-1934-4a54-8d07-278d1af0edc8 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:47.893012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 182/371] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:47.899514 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad537166-2cb1-4e8e-8ee5-cdff2e10eee6 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:47.938946 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8594d9c-b6b1-4833-a6e4-03e306c7175b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:47.939912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8594d9c-b6b1-4833-a6e4-03e306c7175b None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:47.940193 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8594d9c-b6b1-4833-a6e4-03e306c7175b None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:47.940464 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8594d9c-b6b1-4833-a6e4-03e306c7175b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:47.952265 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8594d9c-b6b1-4833-a6e4-03e306c7175b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:47.957620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-e8594d9c-b6b1-4833-a6e4-03e306c7175b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:47.957620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:47.957620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:47.957620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:47.957620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:47.957620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:47.957620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:47.957620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:47.957620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:47.957620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:47.957620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:47.957620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:47.957620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:47.957620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:47.957620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:47.957620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:47.958475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:47.958475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:47.958475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:47.958475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:47.958475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:47.958475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:47.958475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:47.958475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:47.958475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:47.958475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:47.958475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:47.958475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:47.958475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:47.958475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:47.958475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:47.958475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:47.959272 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:47.959272 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:47.959272 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:47.959272 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:47.959272 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:47.959272 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:47.959272 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:47.959272 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:47.959272 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:47.959272 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:47.959272 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:47.959272 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:47.959272 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 190/372] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:47.960020 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8594d9c-b6b1-4833-a6e4-03e306c7175b None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:48.017147 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad537166-2cb1-4e8e-8ee5-cdff2e10eee6 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:48.051743 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd949e-989c-4de8-8c61-cb5c180ad138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:48.052423 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd949e-989c-4de8-8c61-cb5c180ad138 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.052646 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd949e-989c-4de8-8c61-cb5c180ad138 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.052915 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd949e-989c-4de8-8c61-cb5c180ad138 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.060970 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd949e-989c-4de8-8c61-cb5c180ad138 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:48.062399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd949e-989c-4de8-8c61-cb5c180ad138 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:48.066431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8594d9c-b6b1-4833-a6e4-03e306c7175b None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:48.075548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-a5cd949e-989c-4de8-8c61-cb5c180ad138 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:00:48.075548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:48.075548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:48.075548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:48.075548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:48.075548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:48.075548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:48.075548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:48.075548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:48.075548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:48.075548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:48.075548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:48.075548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:48.075548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:48.075548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:48.075548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:48.076473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:48.076473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:48.076473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:48.076473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:48.076473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:48.076473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:48.076473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:48.076473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:48.076473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:48.076473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:48.076473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:48.076473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:48.076473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:48.076473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:48.076473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:48.076473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:48.076473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:48.076473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:48.082301 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:48.082301 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:48.082301 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:48.082301 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:48.082301 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:48.082301 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:48.082301 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:48.082301 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:48.082301 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:00:48.082301 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:48.082301 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 183/373] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Oct 24 13:00:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:48.082301 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3f5ec-f1a6-478b-b702-0245cc2c24b2 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.082301 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3f5ec-f1a6-478b-b702-0245cc2c24b2 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.083198 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3f5ec-f1a6-478b-b702-0245cc2c24b2 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.085210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 184/374] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:48.085986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3f5ec-f1a6-478b-b702-0245cc2c24b2 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:48.090231 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:48.102619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:48.116050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac6299-4c4f-49ec-b584-69b252640061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:48.116681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac6299-4c4f-49ec-b584-69b252640061 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.116956 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac6299-4c4f-49ec-b584-69b252640061 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.117225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac6299-4c4f-49ec-b584-69b252640061 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.128579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac6299-4c4f-49ec-b584-69b252640061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:48.134578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-59ac6299-4c4f-49ec-b584-69b252640061 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:48.134578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:48.134578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:48.134578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:48.134578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:48.134578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:48.134578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:48.134578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:48.134578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:48.134578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:48.134578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:48.134578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:48.134578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:48.134578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:48.134578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:48.134578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:48.135579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:48.135579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:48.135579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:48.135579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:48.135579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:48.135579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:48.135579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:48.135579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:48.135579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:48.135579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:48.135579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:48.135579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:48.135579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:48.135579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:48.135579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:48.135579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:48.136431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:48.136431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:48.136431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:48.136431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:48.136431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:48.136431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:48.136431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:48.136431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:48.136431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:48.136431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:48.136431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:48.136431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:48.136431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 191/375] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:48.137116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac6299-4c4f-49ec-b584-69b252640061 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:48.203020 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3f5ec-f1a6-478b-b702-0245cc2c24b2 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:48.239734 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c989d88-bcbe-4843-af80-667ed0df40ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:48.240656 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c989d88-bcbe-4843-af80-667ed0df40ba None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.241192 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c989d88-bcbe-4843-af80-667ed0df40ba None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.241471 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c989d88-bcbe-4843-af80-667ed0df40ba None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.242129 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c989d88-bcbe-4843-af80-667ed0df40ba None admin] RBAC: Adding query filter params (name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:48.242975 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c989d88-bcbe-4843-af80-667ed0df40ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:48.244459 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c989d88-bcbe-4843-af80-667ed0df40ba None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:48.246759 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac6299-4c4f-49ec-b584-69b252640061 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:48.254147 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 185/376] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 24 13:00:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:48.255897 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6fda1-0d09-4e8e-a540-9db0d4b05fd6 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.256317 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6fda1-0d09-4e8e-a540-9db0d4b05fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.256738 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6fda1-0d09-4e8e-a540-9db0d4b05fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.276273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-c0b6fda1-0d09-4e8e-a540-9db0d4b05fd6 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:48.277454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c0b6fda1-0d09-4e8e-a540-9db0d4b05fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:48.281558 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2b1e8-5161-4db4-ba06-eb8b53893420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:48.282156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2b1e8-5161-4db4-ba06-eb8b53893420 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.282431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2b1e8-5161-4db4-ba06-eb8b53893420 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.282696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2b1e8-5161-4db4-ba06-eb8b53893420 None admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.283412 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2b1e8-5161-4db4-ba06-eb8b53893420 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:48.283738 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2b1e8-5161-4db4-ba06-eb8b53893420 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:48.285173 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2b1e8-5161-4db4-ba06-eb8b53893420 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:48.325158 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 192/377] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Oct 24 13:00:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:48.325925 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2b1e8-5161-4db4-ba06-eb8b53893420 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:48.344507 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:48.353805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 186/378] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:48.354843 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6fda1-0d09-4e8e-a540-9db0d4b05fd6 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:48.382817 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:48.463758 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6fda1-0d09-4e8e-a540-9db0d4b05fd6 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:48.465657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2b1e8-5161-4db4-ba06-eb8b53893420 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:48.503376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907031b-fa72-4cfb-9b06-2412eaaa931e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:48.504395 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907031b-fa72-4cfb-9b06-2412eaaa931e None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.504883 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907031b-fa72-4cfb-9b06-2412eaaa931e None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.505366 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907031b-fa72-4cfb-9b06-2412eaaa931e None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.506200 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907031b-fa72-4cfb-9b06-2412eaaa931e None admin] RBAC: Adding query filter params (name=service) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:48.506684 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907031b-fa72-4cfb-9b06-2412eaaa931e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:48.508221 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf57397-2d56-494f-a201-0081a64f5575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:48.508572 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907031b-fa72-4cfb-9b06-2412eaaa931e None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:48.509058 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf57397-2d56-494f-a201-0081a64f5575 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.509338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf57397-2d56-494f-a201-0081a64f5575 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.509611 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf57397-2d56-494f-a201-0081a64f5575 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.521779 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf57397-2d56-494f-a201-0081a64f5575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:48.522549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 193/379] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 24 13:00:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:48.522952 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf57397-2d56-494f-a201-0081a64f5575 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:48.524435 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907031b-fa72-4cfb-9b06-2412eaaa931e None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:48.551795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-8cf57397-2d56-494f-a201-0081a64f5575 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:48.551795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:48.551795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:48.551795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:48.551795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:48.551795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:48.551795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:48.551795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:48.551795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:48.551795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:48.551795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:48.551795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:48.551795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:48.551795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:48.551795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:48.551795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:48.552770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:48.552770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:48.552770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:48.552770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:48.552770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:48.552770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:48.552770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:48.552770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:48.552770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:48.552770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:48.552770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:48.552770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:48.552770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:48.552770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:48.552770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:48.552770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:48.552770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:48.553609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:48.553609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:48.553609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:48.553609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 187/380] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:48.554267 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf57397-2d56-494f-a201-0081a64f5575 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:48.619642 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:48.643793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907031b-fa72-4cfb-9b06-2412eaaa931e None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:48.645785 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:48.681725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d427938-5d69-4122-b9b0-f8fbb0ece47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:48.681962 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf57397-2d56-494f-a201-0081a64f5575 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:48.682358 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d427938-5d69-4122-b9b0-f8fbb0ece47e None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.682638 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d427938-5d69-4122-b9b0-f8fbb0ece47e None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.682910 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d427938-5d69-4122-b9b0-f8fbb0ece47e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.693380 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d427938-5d69-4122-b9b0-f8fbb0ece47e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:48.694850 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d427938-5d69-4122-b9b0-f8fbb0ece47e None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:48.710014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-9d427938-5d69-4122-b9b0-f8fbb0ece47e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:48.710014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:48.710014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:48.710014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:48.710014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:48.710014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:48.710014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:48.710014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:48.710014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:48.710014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:48.710014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:48.710014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:48.710014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:48.710014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:48.710014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:48.710014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:48.710964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:48.710964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:48.710964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:48.710964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:48.710964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:48.710964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:48.710964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:48.710964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:48.710964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:48.710964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:48.710964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:48.710964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:48.710964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:48.710964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:48.710964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:48.710964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:48.710964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:48.712784 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:48.712784 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:48.712784 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:48.712784 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 194/381] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:48.712784 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d427938-5d69-4122-b9b0-f8fbb0ece47e None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:48.725413 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f490445-a369-4648-86fe-61a516878786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:48.726152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f490445-a369-4648-86fe-61a516878786 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.726485 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f490445-a369-4648-86fe-61a516878786 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.726822 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f490445-a369-4648-86fe-61a516878786 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.739139 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f490445-a369-4648-86fe-61a516878786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:48.740611 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f490445-a369-4648-86fe-61a516878786 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:48.754793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-4f490445-a369-4648-86fe-61a516878786 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:48.754793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:48.754793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:48.754793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:48.754793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:48.754793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:48.754793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:48.754793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:48.754793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:48.754793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:48.754793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:48.754793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:48.754793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:48.754793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:48.754793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:48.754793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:48.755762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:48.755762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:48.755762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:48.755762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:48.755762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:48.755762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:48.755762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:48.755762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:48.755762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:48.755762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:48.755762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:48.755762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:48.755762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:48.755762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:48.755762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:48.755762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:48.755762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:48.756606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:48.756606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:48.756606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:48.756606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 188/382] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:48.756835 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f490445-a369-4648-86fe-61a516878786 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:48.818928 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d427938-5d69-4122-b9b0-f8fbb0ece47e None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:48.852033 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:48.853823 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ec3a2-ba6c-4fab-9b7a-0045d04b8c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:48.854421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ec3a2-ba6c-4fab-9b7a-0045d04b8c4d None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.854696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ec3a2-ba6c-4fab-9b7a-0045d04b8c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.854990 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ec3a2-ba6c-4fab-9b7a-0045d04b8c4d None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.855083 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f490445-a369-4648-86fe-61a516878786 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:48.855654 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ec3a2-ba6c-4fab-9b7a-0045d04b8c4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:48.855951 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ec3a2-ba6c-4fab-9b7a-0045d04b8c4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:48.857339 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ec3a2-ba6c-4fab-9b7a-0045d04b8c4d None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:48.869285 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 195/383] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:48.870140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ec3a2-ba6c-4fab-9b7a-0045d04b8c4d None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:48.887142 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:48.889950 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c392505-0dc8-4d91-a997-cc6517c4544d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:48.890753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c392505-0dc8-4d91-a997-cc6517c4544d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.891032 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c392505-0dc8-4d91-a997-cc6517c4544d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.891300 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c392505-0dc8-4d91-a997-cc6517c4544d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.901223 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c392505-0dc8-4d91-a997-cc6517c4544d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:48.906606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-1c392505-0dc8-4d91-a997-cc6517c4544d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:48.906606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:48.906606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:48.906606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:48.906606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:48.906606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:48.906606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:48.906606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:48.906606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:48.906606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:48.906606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:48.906606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:48.906606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:48.906606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:48.906606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:48.906606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:48.907683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:48.907683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:48.907683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:48.907683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:48.907683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:48.907683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:48.907683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:48.907683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:48.907683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:48.907683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:48.907683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:48.907683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:48.907683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:48.907683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:48.907683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:48.907683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:48.908880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:48.908880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:48.908880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:48.908880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:48.908880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:48.908880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:48.908880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:48.908880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:48.908880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:48.908880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:48.908880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:48.908880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:48.908880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 189/384] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:48.908880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a89f43-3dbe-4d06-8ca1-92a67ca31035 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.909593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a89f43-3dbe-4d06-8ca1-92a67ca31035 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.909593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a89f43-3dbe-4d06-8ca1-92a67ca31035 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.916340 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 190/385] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:48.916340 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a89f43-3dbe-4d06-8ca1-92a67ca31035 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:48.974571 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ec3a2-ba6c-4fab-9b7a-0045d04b8c4d None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:49.008648 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd103d-0c1e-412d-a39a-42252300e95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:49.009247 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd103d-0c1e-412d-a39a-42252300e95f None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:49.009529 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd103d-0c1e-412d-a39a-42252300e95f None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:49.009807 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd103d-0c1e-412d-a39a-42252300e95f None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:49.010446 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd103d-0c1e-412d-a39a-42252300e95f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:49.010750 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd103d-0c1e-412d-a39a-42252300e95f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:49.012170 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd103d-0c1e-412d-a39a-42252300e95f None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:49.013986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a89f43-3dbe-4d06-8ca1-92a67ca31035 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:49.023504 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 196/386] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:49.024545 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd103d-0c1e-412d-a39a-42252300e95f None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:49.051130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cb29f-6dbc-43cf-9832-5dfda0f98811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:49.051746 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cb29f-6dbc-43cf-9832-5dfda0f98811 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:49.052018 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cb29f-6dbc-43cf-9832-5dfda0f98811 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:49.052283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cb29f-6dbc-43cf-9832-5dfda0f98811 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:49.052906 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cb29f-6dbc-43cf-9832-5dfda0f98811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:49.053196 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cb29f-6dbc-43cf-9832-5dfda0f98811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:49.054551 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cb29f-6dbc-43cf-9832-5dfda0f98811 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:49.066338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 191/387] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:49.067101 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cb29f-6dbc-43cf-9832-5dfda0f98811 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:49.089720 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:49.101572 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:49.128037 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd103d-0c1e-412d-a39a-42252300e95f None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:49.160792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197e34b-0b1f-45a4-ae68-9fb44549c526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:49.161733 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197e34b-0b1f-45a4-ae68-9fb44549c526 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:49.162016 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197e34b-0b1f-45a4-ae68-9fb44549c526 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:49.162289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197e34b-0b1f-45a4-ae68-9fb44549c526 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:49.169592 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cb29f-6dbc-43cf-9832-5dfda0f98811 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:49.170047 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197e34b-0b1f-45a4-ae68-9fb44549c526 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:49.171548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197e34b-0b1f-45a4-ae68-9fb44549c526 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:49.184710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-a197e34b-0b1f-45a4-ae68-9fb44549c526 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 24 13:00:49.184710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:49.184710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:49.184710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:49.184710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:49.184710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:49.184710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:49.184710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:49.184710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:49.184710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:49.184710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:49.184710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:49.184710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:49.184710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:49.184710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:49.184710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:49.185731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:49.185731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:49.185731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:49.185731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:49.185731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:49.185731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:49.185731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:49.185731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:49.185731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:49.185731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:49.185731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:49.185731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:49.185731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:49.185731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:49.185731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:49.185731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:49.185731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:49.185731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:49.186644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:49.186644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:49.186644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:49.186644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:49.186644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:49.186644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:49.186644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:49.186644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:49.186644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 24 13:00:49.186644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:49.186644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 197/388] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:49.187488 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf667e-e740-4c88-a069-cd9b46d234c2 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:49.187488 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf667e-e740-4c88-a069-cd9b46d234c2 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:49.187488 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf667e-e740-4c88-a069-cd9b46d234c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:49.205705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-8caf667e-e740-4c88-a069-cd9b46d234c2 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:49.206881 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-8caf667e-e740-4c88-a069-cd9b46d234c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:49.210883 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77afd0d-b6ba-427f-8501-3ad6d93c7b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:49.212287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77afd0d-b6ba-427f-8501-3ad6d93c7b21 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:49.212560 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77afd0d-b6ba-427f-8501-3ad6d93c7b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:49.212834 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77afd0d-b6ba-427f-8501-3ad6d93c7b21 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:49.213492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77afd0d-b6ba-427f-8501-3ad6d93c7b21 None admin] RBAC: Adding query filter params (name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:49.213795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77afd0d-b6ba-427f-8501-3ad6d93c7b21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:49.215176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77afd0d-b6ba-427f-8501-3ad6d93c7b21 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:49.223600 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 192/389] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 24 13:00:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:49.224390 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77afd0d-b6ba-427f-8501-3ad6d93c7b21 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:49.274361 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 198/390] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:49.275304 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf667e-e740-4c88-a069-cd9b46d234c2 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:49.325901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:49.341431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:49.347373 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77afd0d-b6ba-427f-8501-3ad6d93c7b21 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:49.380149 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf667e-e740-4c88-a069-cd9b46d234c2 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:49.386072 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e74ae-73eb-423d-979a-43a9d8d4b0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:49.386699 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e74ae-73eb-423d-979a-43a9d8d4b0bc None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:49.386980 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e74ae-73eb-423d-979a-43a9d8d4b0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:49.387254 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e74ae-73eb-423d-979a-43a9d8d4b0bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:49.395575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e74ae-73eb-423d-979a-43a9d8d4b0bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:49.397023 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e74ae-73eb-423d-979a-43a9d8d4b0bc None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:49.408778 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-236e74ae-73eb-423d-979a-43a9d8d4b0bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:49.408778 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:49.408778 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:49.408778 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:49.408778 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:49.408778 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:49.408778 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:49.408778 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:49.408778 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:49.408778 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:49.408778 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:49.408778 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:49.408778 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:49.408778 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:49.408778 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:49.409766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:49.409766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:49.409766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:49.409766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:49.409766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:49.409766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:49.409766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:49.409766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:49.409766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:49.409766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:49.409766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:49.409766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:49.409766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:49.409766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:49.409766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:49.409766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:49.409766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:49.410653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:49.410653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:49.410653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:49.410653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:49.410653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:49.410653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:49.410653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:49.410653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:49.410653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 193/391] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:49.411121 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e74ae-73eb-423d-979a-43a9d8d4b0bc None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:49.419863 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ea996-de81-4e19-8a50-f300eeca8b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:49.420503 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ea996-de81-4e19-8a50-f300eeca8b70 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:49.420779 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ea996-de81-4e19-8a50-f300eeca8b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:49.421051 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ea996-de81-4e19-8a50-f300eeca8b70 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:49.428244 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ea996-de81-4e19-8a50-f300eeca8b70 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:49.429694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ea996-de81-4e19-8a50-f300eeca8b70 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:49.442385 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-3e6ea996-de81-4e19-8a50-f300eeca8b70 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 24 13:00:49.442385 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:49.442385 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:49.442385 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:49.442385 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:49.442385 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:49.442385 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:49.442385 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:49.442385 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:49.442385 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:49.442385 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:49.442385 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:49.442385 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:49.442385 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:49.442385 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:49.442385 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:49.443476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:49.443476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:49.443476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:49.443476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:49.443476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:49.443476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:49.443476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:49.443476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:49.443476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:49.443476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:49.443476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:49.443476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:49.443476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:49.443476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:49.443476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:49.443476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:49.443476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:49.443476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:49.450223 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:49.450223 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:49.450223 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:49.450223 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:49.450223 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:49.450223 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:49.450223 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:49.450223 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:49.450223 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 24 13:00:49.450223 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:49.450223 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 199/392] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:49.450223 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ea996-de81-4e19-8a50-f300eeca8b70 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:49.530579 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e74ae-73eb-423d-979a-43a9d8d4b0bc None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:49.552769 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ea996-de81-4e19-8a50-f300eeca8b70 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:49.569160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece78fe8-4bf3-41dd-9abb-301e0c919d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:49.569764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece78fe8-4bf3-41dd-9abb-301e0c919d79 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:49.570040 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece78fe8-4bf3-41dd-9abb-301e0c919d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:49.570320 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece78fe8-4bf3-41dd-9abb-301e0c919d79 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:49.571684 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece78fe8-4bf3-41dd-9abb-301e0c919d79 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:49.571988 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece78fe8-4bf3-41dd-9abb-301e0c919d79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:49.573437 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece78fe8-4bf3-41dd-9abb-301e0c919d79 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:49.577519 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:49.588469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ef8db-30a1-41f9-8376-d468db9e731e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:49.589096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ef8db-30a1-41f9-8376-d468db9e731e None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:49.589375 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ef8db-30a1-41f9-8376-d468db9e731e None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:49.589648 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ef8db-30a1-41f9-8376-d468db9e731e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:49.600197 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ef8db-30a1-41f9-8376-d468db9e731e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:49.601666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ef8db-30a1-41f9-8376-d468db9e731e None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:49.610367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:49.616566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-aa2ef8db-30a1-41f9-8376-d468db9e731e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:49.616566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:49.616566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:49.616566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:49.616566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:49.616566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:49.616566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:49.616566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:49.616566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:49.616566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:49.616566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:49.616566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:49.616566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:49.616566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:49.616566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:49.616566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:49.617991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:49.617991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:49.617991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:49.617991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:49.617991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:49.617991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:49.617991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:49.617991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:49.617991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:49.617991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:49.617991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:49.617991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:49.617991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:49.617991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:49.617991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:49.617991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:49.617991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:49.618991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:49.618991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:49.618991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:49.618991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 200/393] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:49.619648 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ef8db-30a1-41f9-8376-d468db9e731e None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:49.620164 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 194/394] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Oct 24 13:00:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:49.621507 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece78fe8-4bf3-41dd-9abb-301e0c919d79 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:49.719321 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece78fe8-4bf3-41dd-9abb-301e0c919d79 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:49.723976 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ef8db-30a1-41f9-8376-d468db9e731e None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:49.752646 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2aa844-c87c-4b1c-b8e5-6928eb9eb2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:49.753238 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2aa844-c87c-4b1c-b8e5-6928eb9eb2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:49.753519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2aa844-c87c-4b1c-b8e5-6928eb9eb2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:49.753782 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2aa844-c87c-4b1c-b8e5-6928eb9eb2e4 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:49.754493 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2aa844-c87c-4b1c-b8e5-6928eb9eb2e4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:49.754793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2aa844-c87c-4b1c-b8e5-6928eb9eb2e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:49.756264 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2aa844-c87c-4b1c-b8e5-6928eb9eb2e4 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:49.758922 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06814840-5043-4919-a46c-f80bd8929346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:49.759552 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06814840-5043-4919-a46c-f80bd8929346 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:49.759833 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06814840-5043-4919-a46c-f80bd8929346 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:49.760113 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06814840-5043-4919-a46c-f80bd8929346 None admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:49.760799 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06814840-5043-4919-a46c-f80bd8929346 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:49.761105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06814840-5043-4919-a46c-f80bd8929346 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:49.762531 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06814840-5043-4919-a46c-f80bd8929346 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:49.772973 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 195/395] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Oct 24 13:00:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:49.773797 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2aa844-c87c-4b1c-b8e5-6928eb9eb2e4 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:49.785953 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 201/396] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:49.785953 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06814840-5043-4919-a46c-f80bd8929346 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:49.818859 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:49.831366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:49.873898 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2aa844-c87c-4b1c-b8e5-6928eb9eb2e4 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:49.883473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06814840-5043-4919-a46c-f80bd8929346 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:49.906497 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd2db0-bfd7-496b-9b00-dd9d4b49080d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:49.907142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd2db0-bfd7-496b-9b00-dd9d4b49080d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:49.907499 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd2db0-bfd7-496b-9b00-dd9d4b49080d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:49.907767 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd2db0-bfd7-496b-9b00-dd9d4b49080d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:49.917645 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babc297-9b7f-494e-a49f-e58550b4e931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:49.918207 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd2db0-bfd7-496b-9b00-dd9d4b49080d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:49.918425 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babc297-9b7f-494e-a49f-e58550b4e931 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:49.918771 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babc297-9b7f-494e-a49f-e58550b4e931 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:49.919108 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babc297-9b7f-494e-a49f-e58550b4e931 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:49.919703 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd2db0-bfd7-496b-9b00-dd9d4b49080d None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:49.929363 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babc297-9b7f-494e-a49f-e58550b4e931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:49.931412 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babc297-9b7f-494e-a49f-e58550b4e931 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:49.934307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-1ffd2db0-bfd7-496b-9b00-dd9d4b49080d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:49.934307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:49.934307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:49.934307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:49.934307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:49.934307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:49.934307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:49.934307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:49.934307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:49.934307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:49.934307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:49.934307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:49.934307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:49.934307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:49.934307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:49.934307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:49.935325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:49.935325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:49.935325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:49.935325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:49.935325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:49.935325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:49.935325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:49.935325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:49.935325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:49.935325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:49.935325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:49.935325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:49.935325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:49.935325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:49.935325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:49.935325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:49.935325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:49.936341 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:49.936341 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:49.936341 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:49.936341 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 196/397] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:49.936566 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd2db0-bfd7-496b-9b00-dd9d4b49080d None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:49.946637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-0babc297-9b7f-494e-a49f-e58550b4e931 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:49.946637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:49.946637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:49.946637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:49.946637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:49.946637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:49.946637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:49.946637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:49.946637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:49.946637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:49.946637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:49.946637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:49.946637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:49.946637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:49.946637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:49.946637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:49.947759 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:49.947759 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:49.947759 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:49.947759 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:49.947759 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:49.947759 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:49.947759 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:49.947759 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:49.947759 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:49.947759 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:49.947759 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:49.947759 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:49.947759 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:49.947759 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:49.947759 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:49.947759 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:49.947759 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:49.949050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:49.949050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:49.949050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:49.949050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 202/398] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:49.949050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babc297-9b7f-494e-a49f-e58550b4e931 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:50.034980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:50.038231 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd2db0-bfd7-496b-9b00-dd9d4b49080d None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:50.047613 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babc297-9b7f-494e-a49f-e58550b4e931 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:50.048768 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:50.072686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84956084-750e-4a7e-927a-587ca3c3e550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:50.073282 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84956084-750e-4a7e-927a-587ca3c3e550 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:50.073560 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84956084-750e-4a7e-927a-587ca3c3e550 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:50.074093 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84956084-750e-4a7e-927a-587ca3c3e550 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:50.074732 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84956084-750e-4a7e-927a-587ca3c3e550 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:50.075031 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84956084-750e-4a7e-927a-587ca3c3e550 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:50.076438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84956084-750e-4a7e-927a-587ca3c3e550 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:50.079915 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031a194-b51e-4bfa-9606-704b83bf1b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:50.080528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031a194-b51e-4bfa-9606-704b83bf1b99 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:50.080800 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031a194-b51e-4bfa-9606-704b83bf1b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:50.081065 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031a194-b51e-4bfa-9606-704b83bf1b99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:50.088698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 197/399] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:50.088698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84956084-750e-4a7e-927a-587ca3c3e550 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:50.095098 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031a194-b51e-4bfa-9606-704b83bf1b99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:50.096617 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031a194-b51e-4bfa-9606-704b83bf1b99 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:50.111496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-a031a194-b51e-4bfa-9606-704b83bf1b99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:50.111496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:50.111496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:50.111496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:50.111496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:50.111496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:50.111496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:50.111496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:50.111496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:50.111496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:50.111496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:50.111496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:50.111496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:50.111496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:50.111496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:50.111496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:50.112437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:50.112437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:50.112437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:50.112437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:50.112437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:50.112437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:50.112437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:50.112437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:50.112437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:50.112437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:50.112437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:50.112437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:50.112437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:50.112437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:50.112437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:50.112437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:50.112437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:50.113300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:50.113300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:50.113300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:50.113300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 203/400] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:50.113520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031a194-b51e-4bfa-9606-704b83bf1b99 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:50.190041 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84956084-750e-4a7e-927a-587ca3c3e550 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:50.213884 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031a194-b51e-4bfa-9606-704b83bf1b99 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:50.225144 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d0df8-1a2c-489a-8615-265cd309d96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:50.225790 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d0df8-1a2c-489a-8615-265cd309d96e None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:50.226065 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d0df8-1a2c-489a-8615-265cd309d96e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:50.226337 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d0df8-1a2c-489a-8615-265cd309d96e None admin] PATH_INFO: `/v3/projects/f230a12ca6234faabf984e4a58a0d2e8/users/4f6b27c7d052437a949a371169fb48ff/roles/ce7268982b3046a08a5a58a49d928fc6` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:50.240584 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d0df8-1a2c-489a-8615-265cd309d96e None admin] RBAC: Authorizing `identity:create_grant(project_id=f230a12ca6234faabf984e4a58a0d2e8, user_id=4f6b27c7d052437a949a371169fb48ff, role_id=ce7268982b3046a08a5a58a49d928fc6)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:50.242058 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d0df8-1a2c-489a-8615-265cd309d96e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:50.248084 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca6f48-543e-417d-bcf7-4996e669c8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:50.248755 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca6f48-543e-417d-bcf7-4996e669c8fb None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:50.249105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca6f48-543e-417d-bcf7-4996e669c8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:50.249396 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca6f48-543e-417d-bcf7-4996e669c8fb None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:50.250112 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca6f48-543e-417d-bcf7-4996e669c8fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:50.250424 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca6f48-543e-417d-bcf7-4996e669c8fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:50.251857 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca6f48-543e-417d-bcf7-4996e669c8fb None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:50.256274 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 198/401] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 13:00:50 2022] PUT /identity/v3/projects/f230a12ca6234faabf984e4a58a0d2e8/users/4f6b27c7d052437a949a371169fb48ff/roles/ce7268982b3046a08a5a58a49d928fc6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:50.261772 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:50.263370 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d0df8-1a2c-489a-8615-265cd309d96e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:50.269922 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 204/402] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:50.269922 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca6f48-543e-417d-bcf7-4996e669c8fb None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:50.288295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:50.381815 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d0df8-1a2c-489a-8615-265cd309d96e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:50.393945 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca6f48-543e-417d-bcf7-4996e669c8fb None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:50.420352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a29182-9fa1-4295-b7c4-8746e82c0a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:50.420988 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a29182-9fa1-4295-b7c4-8746e82c0a2f None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:50.421225 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a29182-9fa1-4295-b7c4-8746e82c0a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:50.421493 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a29182-9fa1-4295-b7c4-8746e82c0a2f None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:50.422252 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a29182-9fa1-4295-b7c4-8746e82c0a2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:50.422428 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a29182-9fa1-4295-b7c4-8746e82c0a2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:50.423846 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a29182-9fa1-4295-b7c4-8746e82c0a2f None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:50.437723 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 199/403] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:50.438078 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e47f87-6188-47b2-a15f-60d2bc1b027b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:50.438717 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e47f87-6188-47b2-a15f-60d2bc1b027b None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:50.438995 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e47f87-6188-47b2-a15f-60d2bc1b027b None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:50.439263 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e47f87-6188-47b2-a15f-60d2bc1b027b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:50.439832 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a29182-9fa1-4295-b7c4-8746e82c0a2f None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:50.451065 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e47f87-6188-47b2-a15f-60d2bc1b027b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:50.452642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e47f87-6188-47b2-a15f-60d2bc1b027b None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:50.469705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-f1e47f87-6188-47b2-a15f-60d2bc1b027b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 13:00:50.469705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:50.469705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:50.469705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:50.469705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:50.469705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:50.469705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:50.469705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:50.469705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:50.469705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:50.469705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:50.469705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:50.469705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:50.469705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:50.469705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:50.469705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:50.470619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:50.470619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:50.470619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:50.470619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:50.470619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:50.470619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:50.470619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:50.470619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:50.470619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:50.470619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:50.470619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:50.470619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:50.470619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:50.470619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:50.470619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:50.470619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:50.470619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:50.470619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:50.471832 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:50.471832 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:50.471832 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:50.471832 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:50.471832 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:50.471832 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:50.471832 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:50.471832 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:50.471832 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 13:00:50.471832 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:50.471832 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 205/404] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:50.471832 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e47f87-6188-47b2-a15f-60d2bc1b027b None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:50.529995 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:50.545097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:50.558373 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a29182-9fa1-4295-b7c4-8746e82c0a2f None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:50.590460 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e47f87-6188-47b2-a15f-60d2bc1b027b None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:50.596959 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83f8c6-8262-4179-b7af-952b9ccdd6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:50.597562 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83f8c6-8262-4179-b7af-952b9ccdd6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:50.597838 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83f8c6-8262-4179-b7af-952b9ccdd6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:50.598102 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83f8c6-8262-4179-b7af-952b9ccdd6d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:50.598733 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83f8c6-8262-4179-b7af-952b9ccdd6d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:50.599028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83f8c6-8262-4179-b7af-952b9ccdd6d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:50.600475 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83f8c6-8262-4179-b7af-952b9ccdd6d2 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:50.613296 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 200/405] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:50.614121 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83f8c6-8262-4179-b7af-952b9ccdd6d2 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:50.631444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5180453-7258-4fff-8419-afe6f9acd5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:50.632048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5180453-7258-4fff-8419-afe6f9acd5ec None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:50.632321 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5180453-7258-4fff-8419-afe6f9acd5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:50.632585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5180453-7258-4fff-8419-afe6f9acd5ec None admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:50.633272 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5180453-7258-4fff-8419-afe6f9acd5ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:50.634777 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5180453-7258-4fff-8419-afe6f9acd5ec None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:50.658296 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 206/406] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 24 13:00:50 2022] POST /identity/v3/users => generated 247 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:00:50.660422 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5180453-7258-4fff-8419-afe6f9acd5ec None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:50.753429 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83f8c6-8262-4179-b7af-952b9ccdd6d2 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:50.795562 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3cd17-7a3a-45f4-868f-1fe12894c71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:50.796139 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3cd17-7a3a-45f4-868f-1fe12894c71d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:50.796432 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3cd17-7a3a-45f4-868f-1fe12894c71d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:50.796957 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3cd17-7a3a-45f4-868f-1fe12894c71d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:50.803272 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5180453-7258-4fff-8419-afe6f9acd5ec None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:50.808499 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3cd17-7a3a-45f4-868f-1fe12894c71d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:50.810019 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3cd17-7a3a-45f4-868f-1fe12894c71d None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:50.813467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:50.825425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-4fb3cd17-7a3a-45f4-868f-1fe12894c71d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:50.825425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:50.825425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:50.825425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:50.825425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:50.825425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:50.825425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:50.825425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:50.825425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:50.825425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:50.825425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:50.825425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:50.825425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:50.825425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:50.825425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:50.826345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:50.826345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:50.826345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:50.826345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:50.826345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:50.826345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:50.826345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:50.826345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:50.826345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:50.826345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:50.826345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:50.826345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:50.826345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:50.826345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:50.826345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:50.826345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:50.826345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:50.827199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:50.827199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:50.827199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:50.827199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:50.827199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:50.827199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:50.827199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:50.827199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:50.827199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 201/407] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:50.828251 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3cd17-7a3a-45f4-868f-1fe12894c71d None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:50.835158 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:50.861890 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3e852-e65f-4bf3-b222-9525ab7e6998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:50.862827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3e852-e65f-4bf3-b222-9525ab7e6998 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:50.863103 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3e852-e65f-4bf3-b222-9525ab7e6998 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:50.863450 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3e852-e65f-4bf3-b222-9525ab7e6998 None admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:50.864183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3e852-e65f-4bf3-b222-9525ab7e6998 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:50.864485 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3e852-e65f-4bf3-b222-9525ab7e6998 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:50.865911 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3e852-e65f-4bf3-b222-9525ab7e6998 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:50.886542 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 207/408] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Oct 24 13:00:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:50.888102 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3e852-e65f-4bf3-b222-9525ab7e6998 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:50.951971 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3cd17-7a3a-45f4-868f-1fe12894c71d None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:50.991383 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b81678-40d1-45eb-bd05-24fa3fbdae95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:50.992094 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b81678-40d1-45eb-bd05-24fa3fbdae95 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:50.992982 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b81678-40d1-45eb-bd05-24fa3fbdae95 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:50.993333 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b81678-40d1-45eb-bd05-24fa3fbdae95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:51.000971 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b81678-40d1-45eb-bd05-24fa3fbdae95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:51.002510 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b81678-40d1-45eb-bd05-24fa3fbdae95 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:51.015729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-d8b81678-40d1-45eb-bd05-24fa3fbdae95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:51.015729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:51.015729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:51.015729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:51.015729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:51.015729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:51.015729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:51.015729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:51.015729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:51.015729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:51.015729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:51.015729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:51.015729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:51.015729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:51.015729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:51.016625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:51.016625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:51.016625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:51.016625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:51.016625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:51.016625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:51.016625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:51.016625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:51.016625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:51.016625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:51.016625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:51.016625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:51.016625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:51.016625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:51.016625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:51.016625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:51.016625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:51.017470 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:51.017470 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:51.017470 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:51.017470 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:51.017470 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:51.017470 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:51.017470 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:51.017470 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:51.019261 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3e852-e65f-4bf3-b222-9525ab7e6998 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:51.022474 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 202/409] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:51.022727 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b81678-40d1-45eb-bd05-24fa3fbdae95 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:51.063017 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d60e7-10f6-4985-a410-6b42f1b1b08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:51.063958 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d60e7-10f6-4985-a410-6b42f1b1b08b None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:51.064434 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d60e7-10f6-4985-a410-6b42f1b1b08b None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:51.064869 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d60e7-10f6-4985-a410-6b42f1b1b08b None admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:51.065729 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d60e7-10f6-4985-a410-6b42f1b1b08b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:51.066197 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d60e7-10f6-4985-a410-6b42f1b1b08b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:51.068234 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d60e7-10f6-4985-a410-6b42f1b1b08b None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:51.088950 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 208/410] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:51.089937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d60e7-10f6-4985-a410-6b42f1b1b08b None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:51.091751 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:51.129329 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:51.146062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b81678-40d1-45eb-bd05-24fa3fbdae95 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:51.193126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16faf539-57dd-4988-8ead-6b6b703b517b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:51.194439 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faf539-57dd-4988-8ead-6b6b703b517b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:51.195128 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faf539-57dd-4988-8ead-6b6b703b517b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:51.196153 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faf539-57dd-4988-8ead-6b6b703b517b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:51.207100 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d60e7-10f6-4985-a410-6b42f1b1b08b None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:51.211071 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16faf539-57dd-4988-8ead-6b6b703b517b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:51.213554 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16faf539-57dd-4988-8ead-6b6b703b517b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:51.233361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-16faf539-57dd-4988-8ead-6b6b703b517b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:51.233361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:51.233361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:51.233361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:51.233361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:51.233361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:51.233361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:51.233361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:51.233361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:51.233361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:51.233361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:51.233361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:51.233361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:51.233361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:51.233361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:51.233361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:51.234508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:51.234508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:51.234508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:51.234508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:51.234508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:51.234508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:51.234508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:51.234508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:51.234508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:51.234508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:51.234508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:51.234508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:51.234508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:51.234508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:51.234508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:51.234508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:51.234508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:51.235562 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:51.235562 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:51.235562 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:51.237496 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 203/411] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:51.238641 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16faf539-57dd-4988-8ead-6b6b703b517b None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:51.249016 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15fa93-cfc8-4e19-b7f5-7a2b85f9979e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:51.249755 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15fa93-cfc8-4e19-b7f5-7a2b85f9979e None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:51.250356 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15fa93-cfc8-4e19-b7f5-7a2b85f9979e None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:51.250620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15fa93-cfc8-4e19-b7f5-7a2b85f9979e None admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:51.251414 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a15fa93-cfc8-4e19-b7f5-7a2b85f9979e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:51.251843 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a15fa93-cfc8-4e19-b7f5-7a2b85f9979e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:51.253471 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a15fa93-cfc8-4e19-b7f5-7a2b85f9979e None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:51.272704 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 209/412] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:51.273893 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15fa93-cfc8-4e19-b7f5-7a2b85f9979e None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:51.364118 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16faf539-57dd-4988-8ead-6b6b703b517b None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:51.374135 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:51.382306 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:51.385282 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15fa93-cfc8-4e19-b7f5-7a2b85f9979e None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:51.409702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df221c-4425-4cf4-979b-6fddb205f873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:51.410783 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df221c-4425-4cf4-979b-6fddb205f873 None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:51.411216 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df221c-4425-4cf4-979b-6fddb205f873 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:51.411943 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df221c-4425-4cf4-979b-6fddb205f873 None admin] PATH_INFO: `/v3/projects/f230a12ca6234faabf984e4a58a0d2e8/users/dd0866de4d4e46d5b26719faf385d7a5/roles/ce7268982b3046a08a5a58a49d928fc6` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:51.423102 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fe0f2-6fd9-4b6c-8437-2f52a385f9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:51.423618 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fe0f2-6fd9-4b6c-8437-2f52a385f9e2 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:51.424032 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fe0f2-6fd9-4b6c-8437-2f52a385f9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:51.424393 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fe0f2-6fd9-4b6c-8437-2f52a385f9e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:51.425144 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fe0f2-6fd9-4b6c-8437-2f52a385f9e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:51.425536 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fe0f2-6fd9-4b6c-8437-2f52a385f9e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:51.427092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fe0f2-6fd9-4b6c-8437-2f52a385f9e2 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:51.431574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df221c-4425-4cf4-979b-6fddb205f873 None admin] RBAC: Authorizing `identity:create_grant(project_id=f230a12ca6234faabf984e4a58a0d2e8, user_id=dd0866de4d4e46d5b26719faf385d7a5, role_id=ce7268982b3046a08a5a58a49d928fc6)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:51.433180 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df221c-4425-4cf4-979b-6fddb205f873 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:51.445845 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 210/413] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:51.445845 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fe0f2-6fd9-4b6c-8437-2f52a385f9e2 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:51.456500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 204/414] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 13:00:51 2022] PUT /identity/v3/projects/f230a12ca6234faabf984e4a58a0d2e8/users/dd0866de4d4e46d5b26719faf385d7a5/roles/ce7268982b3046a08a5a58a49d928fc6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:51.462728 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df221c-4425-4cf4-979b-6fddb205f873 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:51.640318 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df221c-4425-4cf4-979b-6fddb205f873 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:51.690852 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22935c50-9db6-42cd-a58d-d939c506a1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:51.691888 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22935c50-9db6-42cd-a58d-d939c506a1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:51.692162 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22935c50-9db6-42cd-a58d-d939c506a1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:51.692428 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22935c50-9db6-42cd-a58d-d939c506a1b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:51.704543 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22935c50-9db6-42cd-a58d-d939c506a1b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:51.707691 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22935c50-9db6-42cd-a58d-d939c506a1b8 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:51.708474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fe0f2-6fd9-4b6c-8437-2f52a385f9e2 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:51.727984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-22935c50-9db6-42cd-a58d-d939c506a1b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:51.727984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:51.727984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:51.727984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:51.727984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:51.727984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:51.727984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:51.727984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:51.727984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:51.727984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:51.727984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:51.727984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:51.727984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:51.727984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:51.727984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:51.728903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:51.728903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:51.728903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:51.728903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:51.728903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:51.728903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:51.728903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:51.728903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:51.728903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:51.728903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:51.728903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:51.728903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:51.728903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:51.728903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:51.728903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:51.728903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:51.728903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:51.729753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:51.729753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:51.729753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:51.729753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:51.729753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:51.729753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:51.729753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:51.729753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:51.732166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 205/415] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:51.740368 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22935c50-9db6-42cd-a58d-d939c506a1b8 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:51.758940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c8455-e89f-49fa-ac06-f9025ee1b20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:51.759711 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c8455-e89f-49fa-ac06-f9025ee1b20f None admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:51.760205 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c8455-e89f-49fa-ac06-f9025ee1b20f None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:51.760547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c8455-e89f-49fa-ac06-f9025ee1b20f None admin] PATH_INFO: `/v3/projects/f230a12ca6234faabf984e4a58a0d2e8/users/0f2295659f2e467d8d798bf93f731330/roles/ce7268982b3046a08a5a58a49d928fc6` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:51.766884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:51.781352 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c8455-e89f-49fa-ac06-f9025ee1b20f None admin] RBAC: Authorizing `identity:create_grant(project_id=f230a12ca6234faabf984e4a58a0d2e8, user_id=0f2295659f2e467d8d798bf93f731330, role_id=ce7268982b3046a08a5a58a49d928fc6)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:51.782897 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c8455-e89f-49fa-ac06-f9025ee1b20f None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:51.800875 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 211/416] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 13:00:51 2022] PUT /identity/v3/projects/f230a12ca6234faabf984e4a58a0d2e8/users/0f2295659f2e467d8d798bf93f731330/roles/ce7268982b3046a08a5a58a49d928fc6 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:51.894192 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22935c50-9db6-42cd-a58d-d939c506a1b8 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:51.950119 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ff8df-5d7c-4e26-b1ef-85d2df26807a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:51.950750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ff8df-5d7c-4e26-b1ef-85d2df26807a None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:51.951032 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ff8df-5d7c-4e26-b1ef-85d2df26807a None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:51.951302 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ff8df-5d7c-4e26-b1ef-85d2df26807a None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:51.952035 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ff8df-5d7c-4e26-b1ef-85d2df26807a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:51.952340 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ff8df-5d7c-4e26-b1ef-85d2df26807a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:51.953871 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ff8df-5d7c-4e26-b1ef-85d2df26807a None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:51.980097 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 206/417] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:51.986322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c8455-e89f-49fa-ac06-f9025ee1b20f None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:51.996386 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:52.112455 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c8455-e89f-49fa-ac06-f9025ee1b20f None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:52.150929 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72589581-21fc-4a92-917f-550cb2fc2265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:52.151561 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72589581-21fc-4a92-917f-550cb2fc2265 None admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:52.151842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72589581-21fc-4a92-917f-550cb2fc2265 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:52.152115 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72589581-21fc-4a92-917f-550cb2fc2265 None admin] PATH_INFO: `/v3/projects/f230a12ca6234faabf984e4a58a0d2e8/users/171146d5235b4af8aff6f502e478f2df/roles/ce7268982b3046a08a5a58a49d928fc6` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:52.167634 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72589581-21fc-4a92-917f-550cb2fc2265 None admin] RBAC: Authorizing `identity:create_grant(project_id=f230a12ca6234faabf984e4a58a0d2e8, user_id=171146d5235b4af8aff6f502e478f2df, role_id=ce7268982b3046a08a5a58a49d928fc6)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:52.169092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72589581-21fc-4a92-917f-550cb2fc2265 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:52.187578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 212/418] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 13:00:51 2022] PUT /identity/v3/projects/f230a12ca6234faabf984e4a58a0d2e8/users/171146d5235b4af8aff6f502e478f2df/roles/ce7268982b3046a08a5a58a49d928fc6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:52.728732 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8db54-afb0-4d4f-a3dc-55b3dd4fa152 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:52.729113 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8db54-afb0-4d4f-a3dc-55b3dd4fa152 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:52.729292 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8db54-afb0-4d4f-a3dc-55b3dd4fa152 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:52.730642 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 207/419] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:52.736145 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052d8ce-d7ff-4c39-ab0f-0e03aa0b650d None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:52.736432 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052d8ce-d7ff-4c39-ab0f-0e03aa0b650d None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:52.736701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052d8ce-d7ff-4c39-ab0f-0e03aa0b650d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:52.774928 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-2052d8ce-d7ff-4c39-ab0f-0e03aa0b650d None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:52.776131 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-2052d8ce-d7ff-4c39-ab0f-0e03aa0b650d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:52.847255 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:52.874335 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 213/420] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:00:53.050462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efdc92-c0e4-40af-a88d-6775909996de None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:53.051486 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efdc92-c0e4-40af-a88d-6775909996de None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:53.051970 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efdc92-c0e4-40af-a88d-6775909996de None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:53.053733 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 208/421] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:53.059712 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca456611-12fc-4a55-b644-5b4378a7917a None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:53.060143 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca456611-12fc-4a55-b644-5b4378a7917a None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:53.060315 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca456611-12fc-4a55-b644-5b4378a7917a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:53.088465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-ca456611-12fc-4a55-b644-5b4378a7917a None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:53.089654 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-ca456611-12fc-4a55-b644-5b4378a7917a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:53.160600 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 214/422] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:53.224363 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efdc92-c0e4-40af-a88d-6775909996de None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:53.309008 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:53.329696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efdc92-c0e4-40af-a88d-6775909996de None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:53.363670 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555683d-82a9-4161-8612-a7624b6296ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:53.364303 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555683d-82a9-4161-8612-a7624b6296ec None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:53.364581 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555683d-82a9-4161-8612-a7624b6296ec None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:53.364910 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555683d-82a9-4161-8612-a7624b6296ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:53.376832 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555683d-82a9-4161-8612-a7624b6296ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:53.381845 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-9555683d-82a9-4161-8612-a7624b6296ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:53.381845 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:53.381845 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:53.381845 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:53.381845 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:53.381845 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:53.381845 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:53.381845 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:53.381845 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:53.381845 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:53.381845 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:53.381845 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:53.381845 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:53.381845 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:53.381845 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:53.381845 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:53.382750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:53.382750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:53.382750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:53.382750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:53.382750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:53.382750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:53.382750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:53.382750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:53.382750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:53.382750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:53.382750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:53.382750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:53.382750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:53.382750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:53.382750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:53.382750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:53.384956 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:53.384956 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:53.384956 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:53.384956 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:53.384956 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:53.384956 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:53.384956 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:53.384956 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:53.384956 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:53.384956 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:53.384956 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:53.384956 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:53.384956 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 209/423] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:53.389635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca456611-12fc-4a55-b644-5b4378a7917a None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:53.519838 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca456611-12fc-4a55-b644-5b4378a7917a None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:53.538406 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:53.559890 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c10e27-da56-4935-a288-1e3bcb3238d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:53.560500 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c10e27-da56-4935-a288-1e3bcb3238d5 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:53.560778 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c10e27-da56-4935-a288-1e3bcb3238d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:53.561052 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c10e27-da56-4935-a288-1e3bcb3238d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:53.561773 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c10e27-da56-4935-a288-1e3bcb3238d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:53.562072 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c10e27-da56-4935-a288-1e3bcb3238d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:53.563555 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c10e27-da56-4935-a288-1e3bcb3238d5 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:53.573047 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 215/424] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 24 13:00:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:53.579164 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555683d-82a9-4161-8612-a7624b6296ec None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:53.590554 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c10e27-da56-4935-a288-1e3bcb3238d5 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:53.706446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555683d-82a9-4161-8612-a7624b6296ec None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:53.749408 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49122c4-4822-4119-b2bf-cd62ca9a78f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:53.750087 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49122c4-4822-4119-b2bf-cd62ca9a78f7 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:53.750365 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49122c4-4822-4119-b2bf-cd62ca9a78f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:53.750678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49122c4-4822-4119-b2bf-cd62ca9a78f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:53.762543 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49122c4-4822-4119-b2bf-cd62ca9a78f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:53.764048 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49122c4-4822-4119-b2bf-cd62ca9a78f7 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:53.781061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-d49122c4-4822-4119-b2bf-cd62ca9a78f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:53.781061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:53.781061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:53.781061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:53.781061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:53.781061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:53.781061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:53.781061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:53.781061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:53.781061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:53.781061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:53.781061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:53.781061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:53.781061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:53.781061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:53.781061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:53.782160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:53.782160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:53.782160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:53.782160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:53.782160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:53.782160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:53.782160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:53.782160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:53.782160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:53.782160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:53.782160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:53.782160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:53.782160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:53.782160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:53.782160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:53.782160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:53.782160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:53.783216 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:53.783216 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:53.783216 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:53.784950 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:53.785781 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 210/425] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:53.791495 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49122c4-4822-4119-b2bf-cd62ca9a78f7 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:53.881555 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c10e27-da56-4935-a288-1e3bcb3238d5 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:53.909995 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49122c4-4822-4119-b2bf-cd62ca9a78f7 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:53.952764 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d397c9-a435-4dea-9fcc-dfdb739fa6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:53.953404 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d397c9-a435-4dea-9fcc-dfdb739fa6d9 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:53.953682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d397c9-a435-4dea-9fcc-dfdb739fa6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:53.953954 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d397c9-a435-4dea-9fcc-dfdb739fa6d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:53.974584 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d397c9-a435-4dea-9fcc-dfdb739fa6d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:53.981258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-64d397c9-a435-4dea-9fcc-dfdb739fa6d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:53.981258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:53.981258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:53.981258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:53.981258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:53.981258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:53.981258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:53.981258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:53.981258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:53.981258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:53.981258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:53.981258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:53.981258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:53.981258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:53.981258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:53.981258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:53.982183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:53.982183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:53.982183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:53.982183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:53.982183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:53.982183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:53.982183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:53.982183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:53.982183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:53.982183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:53.982183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:53.982183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:53.982183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:53.982183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:53.982183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:53.982183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:53.983044 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:53.983044 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:53.983044 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:53.983044 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:53.983044 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:53.983044 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:53.983044 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:53.983044 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:53.983044 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:53.983044 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:53.983044 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:53.983044 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:53.983044 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 216/426] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:53.989222 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c3d5d-cf3e-4d48-bbce-ba6fa4c27896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:53.989838 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c3d5d-cf3e-4d48-bbce-ba6fa4c27896 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:53.990118 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c3d5d-cf3e-4d48-bbce-ba6fa4c27896 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:53.990391 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c3d5d-cf3e-4d48-bbce-ba6fa4c27896 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:53.991040 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c3d5d-cf3e-4d48-bbce-ba6fa4c27896 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:53.991339 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c3d5d-cf3e-4d48-bbce-ba6fa4c27896 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:53.992341 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d397c9-a435-4dea-9fcc-dfdb739fa6d9 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:53.992912 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c3d5d-cf3e-4d48-bbce-ba6fa4c27896 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:54.015756 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 211/427] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:54.020325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c3d5d-cf3e-4d48-bbce-ba6fa4c27896 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:54.046504 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:54.118929 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d397c9-a435-4dea-9fcc-dfdb739fa6d9 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:54.157781 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997707ab-ad48-42cc-b536-5b7a8fcca703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:54.158759 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997707ab-ad48-42cc-b536-5b7a8fcca703 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:54.159259 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997707ab-ad48-42cc-b536-5b7a8fcca703 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:54.159748 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997707ab-ad48-42cc-b536-5b7a8fcca703 None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:54.160995 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997707ab-ad48-42cc-b536-5b7a8fcca703 None admin] RBAC: Adding query filter params (name=service) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:54.161493 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997707ab-ad48-42cc-b536-5b7a8fcca703 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:54.163111 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997707ab-ad48-42cc-b536-5b7a8fcca703 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:54.173269 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 217/428] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 24 13:00:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:54.176900 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:54.178952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997707ab-ad48-42cc-b536-5b7a8fcca703 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:54.282086 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c3d5d-cf3e-4d48-bbce-ba6fa4c27896 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:54.346147 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b9d6b-dc38-487c-9b97-daecf35175cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:54.347118 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b9d6b-dc38-487c-9b97-daecf35175cb None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:54.347614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b9d6b-dc38-487c-9b97-daecf35175cb None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:54.348080 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b9d6b-dc38-487c-9b97-daecf35175cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:54.362285 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b9d6b-dc38-487c-9b97-daecf35175cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:54.365869 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b9d6b-dc38-487c-9b97-daecf35175cb None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:54.390841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-614b9d6b-dc38-487c-9b97-daecf35175cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:00:54.390841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:54.390841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:54.390841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:54.390841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:54.390841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:54.390841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:54.390841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:54.390841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:54.390841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:54.390841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:54.390841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:54.390841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:54.390841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:54.390841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:54.390841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:54.391851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:54.391851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:54.391851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:54.391851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:54.391851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:54.391851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:54.391851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:54.391851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:54.391851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:54.391851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:54.391851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:54.391851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:54.391851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:54.391851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:54.391851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:54.391851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:54.391851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:54.391851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:54.392802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:54.392802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:54.392802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:54.392802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:54.392802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:54.392802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:54.392802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:54.392802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:54.392802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:00:54.392802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:54.396302 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 212/429] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Oct 24 13:00:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:54.398000 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74868c3-59c3-4a54-a0cc-9ae7931c052e None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:54.398535 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74868c3-59c3-4a54-a0cc-9ae7931c052e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:54.399229 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74868c3-59c3-4a54-a0cc-9ae7931c052e None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:54.401892 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 213/430] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:54.403769 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:54.406428 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74868c3-59c3-4a54-a0cc-9ae7931c052e None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:54.412103 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997707ab-ad48-42cc-b536-5b7a8fcca703 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:54.449629 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e83684-bb5d-496f-b63b-8eef79af6b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:54.450252 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e83684-bb5d-496f-b63b-8eef79af6b78 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:54.450533 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e83684-bb5d-496f-b63b-8eef79af6b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:54.450852 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e83684-bb5d-496f-b63b-8eef79af6b78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:54.462571 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e83684-bb5d-496f-b63b-8eef79af6b78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:54.464101 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e83684-bb5d-496f-b63b-8eef79af6b78 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:54.479967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-b2e83684-bb5d-496f-b63b-8eef79af6b78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:54.479967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:54.479967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:54.479967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:54.479967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:54.479967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:54.479967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:54.479967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:54.479967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:54.479967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:54.479967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:54.479967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:54.479967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:54.479967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:54.479967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:54.479967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:54.480940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:54.480940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:54.480940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:54.480940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:54.480940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:54.480940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:54.480940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:54.480940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:54.480940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:54.480940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:54.480940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:54.480940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:54.480940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:54.480940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:54.480940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:54.480940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:54.480940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:54.481794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:54.481794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:54.481794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:54.485736 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 218/431] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:54.486989 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a167d36-32ca-4fe3-8509-b349a4c2110d None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:54.487274 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a167d36-32ca-4fe3-8509-b349a4c2110d None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:54.487892 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a167d36-32ca-4fe3-8509-b349a4c2110d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:54.506954 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-1a167d36-32ca-4fe3-8509-b349a4c2110d None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:54.508192 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-1a167d36-32ca-4fe3-8509-b349a4c2110d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:54.539299 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74868c3-59c3-4a54-a0cc-9ae7931c052e None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:54.556426 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:54.579133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75dbb4-ef6a-4a7c-96f6-1bc4bfb716ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:54.579767 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75dbb4-ef6a-4a7c-96f6-1bc4bfb716ed None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:54.580044 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75dbb4-ef6a-4a7c-96f6-1bc4bfb716ed None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:54.580317 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75dbb4-ef6a-4a7c-96f6-1bc4bfb716ed None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:54.581047 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75dbb4-ef6a-4a7c-96f6-1bc4bfb716ed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:54.581348 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75dbb4-ef6a-4a7c-96f6-1bc4bfb716ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:54.582851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75dbb4-ef6a-4a7c-96f6-1bc4bfb716ed None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:54.589066 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 219/432] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:54.589736 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a167d36-32ca-4fe3-8509-b349a4c2110d None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:54.614056 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 214/433] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Oct 24 13:00:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:54.615236 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab8e85-a359-4e7b-8a83-197cc77e9e8c None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:54.615549 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab8e85-a359-4e7b-8a83-197cc77e9e8c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:54.615822 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab8e85-a359-4e7b-8a83-197cc77e9e8c None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:54.622038 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 215/434] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:54.622650 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab8e85-a359-4e7b-8a83-197cc77e9e8c None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:54.698180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:54.725315 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a167d36-32ca-4fe3-8509-b349a4c2110d None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:54.739182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab8e85-a359-4e7b-8a83-197cc77e9e8c None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:54.773289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052372b0-0c91-449f-9b44-e78b46f314cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:54.774443 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052372b0-0c91-449f-9b44-e78b46f314cc None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:54.774996 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052372b0-0c91-449f-9b44-e78b46f314cc None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:54.775547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052372b0-0c91-449f-9b44-e78b46f314cc None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:54.776100 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16a3d5-f544-4a4c-9856-52a0b8f7e9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:54.776572 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052372b0-0c91-449f-9b44-e78b46f314cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:54.776813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16a3d5-f544-4a4c-9856-52a0b8f7e9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:54.777157 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16a3d5-f544-4a4c-9856-52a0b8f7e9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:54.777417 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052372b0-0c91-449f-9b44-e78b46f314cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:54.777557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16a3d5-f544-4a4c-9856-52a0b8f7e9b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:54.779211 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052372b0-0c91-449f-9b44-e78b46f314cc None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:54.795106 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 220/435] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:54.796913 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7cbac-bd2b-4702-b438-f4014a97716b None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:54.797749 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7cbac-bd2b-4702-b438-f4014a97716b None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:54.798202 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7cbac-bd2b-4702-b438-f4014a97716b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:54.822477 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-f9c7cbac-bd2b-4702-b438-f4014a97716b None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:54.823700 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:54.823837 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f9c7cbac-bd2b-4702-b438-f4014a97716b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:54.860810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16a3d5-f544-4a4c-9856-52a0b8f7e9b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:54.862428 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16a3d5-f544-4a4c-9856-52a0b8f7e9b1 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:54.909882 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 221/436] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:54.910758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7cbac-bd2b-4702-b438-f4014a97716b None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:54.989497 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:54.996741 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 216/437] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:00:54.997879 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16a3d5-f544-4a4c-9856-52a0b8f7e9b1 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:55.028779 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7cbac-bd2b-4702-b438-f4014a97716b None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:55.065779 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19a85f-3f4d-4d1f-9154-8f0bcb65c801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:55.066409 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19a85f-3f4d-4d1f-9154-8f0bcb65c801 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:55.066683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19a85f-3f4d-4d1f-9154-8f0bcb65c801 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:55.067008 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19a85f-3f4d-4d1f-9154-8f0bcb65c801 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:55.074304 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19a85f-3f4d-4d1f-9154-8f0bcb65c801 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:55.075788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19a85f-3f4d-4d1f-9154-8f0bcb65c801 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:55.075906 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:55.088289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-aa19a85f-3f4d-4d1f-9154-8f0bcb65c801 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 24 13:00:55.088289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:55.088289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:55.088289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:55.088289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:55.088289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:55.088289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:55.088289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:55.088289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:55.088289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:55.088289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:55.088289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:55.088289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:55.088289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:55.088289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:55.088289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:55.089233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:55.089233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:55.089233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:55.089233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:55.089233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:55.089233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:55.089233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:55.089233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:55.089233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:55.089233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:55.089233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:55.089233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:55.089233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:55.089233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:55.089233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:55.089233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:55.089233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:55.089233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:55.090213 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:55.090213 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:55.090213 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:55.090213 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:55.090213 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:55.090213 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:55.090213 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:55.090213 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:55.090213 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 24 13:00:55.090213 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:55.090213 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 222/438] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 24 13:00:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:55.090213 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19a85f-3f4d-4d1f-9154-8f0bcb65c801 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:55.112276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16a3d5-f544-4a4c-9856-52a0b8f7e9b1 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:55.147867 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404dcf8-dd0a-48c6-ae9c-97ac9cceb610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:55.148495 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404dcf8-dd0a-48c6-ae9c-97ac9cceb610 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:55.148818 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404dcf8-dd0a-48c6-ae9c-97ac9cceb610 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:55.149129 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404dcf8-dd0a-48c6-ae9c-97ac9cceb610 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:55.160760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404dcf8-dd0a-48c6-ae9c-97ac9cceb610 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:55.166257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-f404dcf8-dd0a-48c6-ae9c-97ac9cceb610 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:55.166257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:55.166257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:55.166257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:55.166257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:55.166257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:55.166257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:55.166257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:55.166257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:55.166257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:55.166257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:55.166257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:55.166257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:55.166257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:55.166257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:55.166257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:55.167161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:55.167161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:55.167161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:55.167161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:55.167161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:55.167161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:55.167161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:55.167161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:55.167161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:55.167161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:55.167161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:55.167161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:55.167161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:55.167161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:55.167161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:55.167161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:55.168317 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:55.168317 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:55.168317 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:55.168317 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:55.168317 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:55.168317 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:55.168317 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:55.168317 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:55.168317 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:55.168317 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:55.168317 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:55.168317 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:55.168317 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 217/439] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:55.172482 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dce58f-0d14-4efa-8808-a8a651569c87 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:55.172768 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dce58f-0d14-4efa-8808-a8a651569c87 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:55.173043 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dce58f-0d14-4efa-8808-a8a651569c87 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:55.177501 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 218/440] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:55.178048 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dce58f-0d14-4efa-8808-a8a651569c87 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:55.199576 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19a85f-3f4d-4d1f-9154-8f0bcb65c801 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:55.229532 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:55.235617 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1764cbc-3881-49b3-9ea5-fcf44f5eb080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:55.236242 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1764cbc-3881-49b3-9ea5-fcf44f5eb080 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:55.236522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1764cbc-3881-49b3-9ea5-fcf44f5eb080 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:55.236793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1764cbc-3881-49b3-9ea5-fcf44f5eb080 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:55.247122 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1764cbc-3881-49b3-9ea5-fcf44f5eb080 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:55.248628 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1764cbc-3881-49b3-9ea5-fcf44f5eb080 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:55.263121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-b1764cbc-3881-49b3-9ea5-fcf44f5eb080 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:55.263121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:55.263121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:55.263121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:55.263121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:55.263121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:55.263121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:55.263121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:55.263121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:55.263121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:55.263121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:55.263121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:55.263121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:55.263121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:55.263121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:55.263121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:55.264104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:55.264104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:55.264104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:55.264104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:55.264104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:55.264104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:55.264104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:55.264104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:55.264104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:55.264104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:55.264104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:55.264104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:55.264104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:55.264104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:55.264104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:55.264104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:55.264104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:55.269962 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:55.269962 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:55.269962 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:55.269962 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 223/441] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:55.269962 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1764cbc-3881-49b3-9ea5-fcf44f5eb080 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:55.286158 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dce58f-0d14-4efa-8808-a8a651569c87 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:55.315241 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:55.320672 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423d108-6f21-498f-b3f7-0989ea90b156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:55.321866 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423d108-6f21-498f-b3f7-0989ea90b156 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:55.322158 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423d108-6f21-498f-b3f7-0989ea90b156 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:55.322432 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423d108-6f21-498f-b3f7-0989ea90b156 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:55.323147 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423d108-6f21-498f-b3f7-0989ea90b156 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:55.323477 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423d108-6f21-498f-b3f7-0989ea90b156 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:55.325154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423d108-6f21-498f-b3f7-0989ea90b156 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:55.341838 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 219/442] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Oct 24 13:00:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:55.342640 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423d108-6f21-498f-b3f7-0989ea90b156 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:55.363644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1764cbc-3881-49b3-9ea5-fcf44f5eb080 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:55.396963 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87670d-2552-4f07-871f-2cd2033d1845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:55.397579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87670d-2552-4f07-871f-2cd2033d1845 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:55.397974 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87670d-2552-4f07-871f-2cd2033d1845 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:55.398122 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87670d-2552-4f07-871f-2cd2033d1845 None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:55.398763 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87670d-2552-4f07-871f-2cd2033d1845 None admin] RBAC: Adding query filter params (name=service) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:55.399055 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87670d-2552-4f07-871f-2cd2033d1845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:55.400469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87670d-2552-4f07-871f-2cd2033d1845 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:55.408093 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 224/443] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 24 13:00:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:55.409240 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944ddf8-a551-43e1-867e-03b1de38fcb7 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:55.409516 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944ddf8-a551-43e1-867e-03b1de38fcb7 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:55.409783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944ddf8-a551-43e1-867e-03b1de38fcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:55.427774 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-3944ddf8-a551-43e1-867e-03b1de38fcb7 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:55.428939 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-3944ddf8-a551-43e1-867e-03b1de38fcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:55.445805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423d108-6f21-498f-b3f7-0989ea90b156 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:55.468120 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:55.480280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d151a-070b-4ba0-affe-5951f3fbb8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:55.480904 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d151a-070b-4ba0-affe-5951f3fbb8fe None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:55.481183 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d151a-070b-4ba0-affe-5951f3fbb8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:55.481454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d151a-070b-4ba0-affe-5951f3fbb8fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:55.492459 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d151a-070b-4ba0-affe-5951f3fbb8fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:55.494882 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 225/444] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:55.495723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944ddf8-a551-43e1-867e-03b1de38fcb7 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:55.497917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-312d151a-070b-4ba0-affe-5951f3fbb8fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:55.497917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:55.497917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:55.497917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:55.497917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:55.497917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:55.497917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:55.497917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:55.497917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:55.497917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:55.497917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:55.497917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:55.497917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:55.497917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:55.497917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:55.497917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:55.498774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:55.498774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:55.498774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:55.498774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:55.498774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:55.498774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:55.498774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:55.498774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:55.498774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:55.498774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:55.498774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:55.498774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:55.498774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:55.498774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:55.498774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:55.498774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:55.499630 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:55.499630 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:55.499630 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:55.499630 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:55.499630 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:55.499630 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:55.499630 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:55.499630 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:55.499630 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:55.499630 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:55.499630 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:55.499630 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:55.499630 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 220/445] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:55.500710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d151a-070b-4ba0-affe-5951f3fbb8fe None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:55.552384 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:55.603649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d151a-070b-4ba0-affe-5951f3fbb8fe None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:55.609099 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944ddf8-a551-43e1-867e-03b1de38fcb7 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:55.639187 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641111d7-67c7-44dd-b9a8-f65deb33d386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:55.639844 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641111d7-67c7-44dd-b9a8-f65deb33d386 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:55.640218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641111d7-67c7-44dd-b9a8-f65deb33d386 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:55.640397 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641111d7-67c7-44dd-b9a8-f65deb33d386 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:55.649015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62373f75-d89e-480e-af3b-c09090b07b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:55.649822 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62373f75-d89e-480e-af3b-c09090b07b96 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:55.650094 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62373f75-d89e-480e-af3b-c09090b07b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:55.650360 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62373f75-d89e-480e-af3b-c09090b07b96 None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:55.651030 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62373f75-d89e-480e-af3b-c09090b07b96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:55.651273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62373f75-d89e-480e-af3b-c09090b07b96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:55.651697 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641111d7-67c7-44dd-b9a8-f65deb33d386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:55.652667 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62373f75-d89e-480e-af3b-c09090b07b96 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:55.653151 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641111d7-67c7-44dd-b9a8-f65deb33d386 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:55.669006 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 226/446] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:55.669006 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62373f75-d89e-480e-af3b-c09090b07b96 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:55.669217 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-641111d7-67c7-44dd-b9a8-f65deb33d386 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:55.669217 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:55.669217 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:55.669217 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:55.669217 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:55.669217 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:55.669217 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:55.669217 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:55.669217 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:55.669217 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:55.669217 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:55.669217 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:55.669217 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:55.669217 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:55.669217 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:55.669217 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:55.670152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:55.670152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:55.670152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:55.670152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:55.670152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:55.670152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:55.670152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:55.670152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:55.670152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:55.670152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:55.670152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:55.670152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:55.670152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:55.670152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:55.670152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:55.670152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:55.670152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:55.671001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:55.671001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:55.671001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:55.671001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 221/447] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:55.671001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641111d7-67c7-44dd-b9a8-f65deb33d386 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:55.711775 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:55.775469 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641111d7-67c7-44dd-b9a8-f65deb33d386 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:55.776989 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:55.783213 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62373f75-d89e-480e-af3b-c09090b07b96 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:55.811681 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24209365-1ec4-497a-9288-5aebc994ca3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:55.812278 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24209365-1ec4-497a-9288-5aebc994ca3a None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:55.812555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24209365-1ec4-497a-9288-5aebc994ca3a None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:55.812824 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24209365-1ec4-497a-9288-5aebc994ca3a None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:55.813477 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24209365-1ec4-497a-9288-5aebc994ca3a None admin] RBAC: Adding query filter params (name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:55.813774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24209365-1ec4-497a-9288-5aebc994ca3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:55.815168 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24209365-1ec4-497a-9288-5aebc994ca3a None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:55.817247 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4fa56-50a2-45b7-a714-4c6c736b6497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:55.817860 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4fa56-50a2-45b7-a714-4c6c736b6497 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:55.818134 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4fa56-50a2-45b7-a714-4c6c736b6497 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:55.818401 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4fa56-50a2-45b7-a714-4c6c736b6497 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:55.823250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 222/448] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 24 13:00:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:55.824315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24209365-1ec4-497a-9288-5aebc994ca3a None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:55.829883 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4fa56-50a2-45b7-a714-4c6c736b6497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:55.831336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4fa56-50a2-45b7-a714-4c6c736b6497 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:55.845328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-a1c4fa56-50a2-45b7-a714-4c6c736b6497 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:55.845328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:55.845328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:55.845328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:55.845328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:55.845328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:55.845328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:55.845328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:55.845328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:55.845328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:55.845328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:55.845328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:55.845328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:55.845328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:55.845328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:55.845328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:55.846210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:55.846210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:55.846210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:55.846210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:55.846210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:55.846210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:55.846210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:55.846210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:55.846210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:55.846210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:55.846210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:55.846210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:55.846210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:55.846210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:55.846210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:55.846210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:55.846210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:55.847052 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:55.847052 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:55.847052 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:55.847052 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 227/449] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:55.847275 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4fa56-50a2-45b7-a714-4c6c736b6497 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:55.924111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24209365-1ec4-497a-9288-5aebc994ca3a None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:55.931610 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:55.946576 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4fa56-50a2-45b7-a714-4c6c736b6497 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:55.958312 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc869179-9116-4d68-873b-eb7e244ed1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:55.958937 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc869179-9116-4d68-873b-eb7e244ed1fb None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:55.959219 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc869179-9116-4d68-873b-eb7e244ed1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:55.959533 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc869179-9116-4d68-873b-eb7e244ed1fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:55.966443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc869179-9116-4d68-873b-eb7e244ed1fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:55.967871 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc869179-9116-4d68-873b-eb7e244ed1fb None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:55.979515 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-cc869179-9116-4d68-873b-eb7e244ed1fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:55.979515 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:55.979515 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:55.979515 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:55.979515 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:55.979515 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:55.979515 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:55.979515 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:55.979515 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:55.979515 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:55.979515 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:55.979515 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:55.979515 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:55.979515 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:55.979515 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:55.980508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:55.980508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:55.980508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:55.980508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:55.980508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:55.980508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:55.980508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:55.980508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:55.980508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:55.980508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:55.980508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:55.980508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:55.980508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:55.980508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:55.980508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:55.980508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:55.980508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:55.981555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:55.981555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:55.981555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:55.981555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:55.981555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:55.981555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:55.981555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:55.981555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:55.981555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 223/450] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:55.981555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc869179-9116-4d68-873b-eb7e244ed1fb None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:55.983695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fce30-2c03-4f64-ae7e-7035d34b6e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:55.984296 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fce30-2c03-4f64-ae7e-7035d34b6e7e None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:55.984575 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fce30-2c03-4f64-ae7e-7035d34b6e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:55.984849 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fce30-2c03-4f64-ae7e-7035d34b6e7e None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:55.985518 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fce30-2c03-4f64-ae7e-7035d34b6e7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:55.985816 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fce30-2c03-4f64-ae7e-7035d34b6e7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:55.987197 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fce30-2c03-4f64-ae7e-7035d34b6e7e None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:55.999528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 228/451] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:56.000326 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fce30-2c03-4f64-ae7e-7035d34b6e7e None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:56.008019 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:56.081068 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc869179-9116-4d68-873b-eb7e244ed1fb None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:56.096583 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fce30-2c03-4f64-ae7e-7035d34b6e7e None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:56.114619 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbf3eb-7226-48e0-aaa6-1d7918a0d694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:56.115349 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbf3eb-7226-48e0-aaa6-1d7918a0d694 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:56.115731 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbf3eb-7226-48e0-aaa6-1d7918a0d694 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:56.116076 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbf3eb-7226-48e0-aaa6-1d7918a0d694 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:56.126094 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbf3eb-7226-48e0-aaa6-1d7918a0d694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:56.129862 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d58a6f-ef12-4ed5-a63f-0e67a3edbd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:56.130477 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d58a6f-ef12-4ed5-a63f-0e67a3edbd02 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:56.130754 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d58a6f-ef12-4ed5-a63f-0e67a3edbd02 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:56.131022 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d58a6f-ef12-4ed5-a63f-0e67a3edbd02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:56.131693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-18bbf3eb-7226-48e0-aaa6-1d7918a0d694 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:56.131693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:56.131693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:56.131693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:56.131693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:56.131693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:56.131693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:56.131693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:56.131693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:56.131693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:56.131693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:56.131693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:56.131693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:56.131693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:56.131693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:56.131693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:56.132775 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:56.132775 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:56.132775 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:56.132775 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:56.132775 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:56.132775 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:56.132775 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:56.132775 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:56.132775 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:56.132775 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:56.132775 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:56.132775 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:56.132775 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:56.132775 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:56.132775 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:56.132775 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:56.133696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:56.133696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:56.133696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:56.133696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:56.133696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:56.133696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:56.133696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:56.133696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:56.133696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:56.133696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:56.133696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:56.133696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:56.133696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 224/452] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:56.133696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbf3eb-7226-48e0-aaa6-1d7918a0d694 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:56.144390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d58a6f-ef12-4ed5-a63f-0e67a3edbd02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:56.145856 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d58a6f-ef12-4ed5-a63f-0e67a3edbd02 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:56.154305 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:56.162984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-e0d58a6f-ef12-4ed5-a63f-0e67a3edbd02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:56.162984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:56.162984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:56.162984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:56.162984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:56.162984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:56.162984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:56.162984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:56.162984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:56.162984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:56.162984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:56.162984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:56.162984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:56.162984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:56.162984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:56.162984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:56.164087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:56.164087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:56.164087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:56.164087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:56.164087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:56.164087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:56.164087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:56.164087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:56.164087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:56.164087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:56.164087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:56.164087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:56.164087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:56.164087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:56.164087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:56.164087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:56.164087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:56.165737 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:56.165737 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:56.165737 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:56.165737 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 229/453] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:56.166006 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d58a6f-ef12-4ed5-a63f-0e67a3edbd02 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:56.218241 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:56.234510 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbf3eb-7226-48e0-aaa6-1d7918a0d694 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:56.266410 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579517e-171c-4814-adf2-938083f22c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:56.266811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d58a6f-ef12-4ed5-a63f-0e67a3edbd02 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:56.267243 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579517e-171c-4814-adf2-938083f22c57 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:56.267243 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579517e-171c-4814-adf2-938083f22c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:56.267559 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579517e-171c-4814-adf2-938083f22c57 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:56.268193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579517e-171c-4814-adf2-938083f22c57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:56.268482 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579517e-171c-4814-adf2-938083f22c57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:56.269855 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579517e-171c-4814-adf2-938083f22c57 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:56.281755 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 225/454] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:56.282537 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579517e-171c-4814-adf2-938083f22c57 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:56.302902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e80f7-fb39-4933-bc89-4144f21fd4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:56.303541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e80f7-fb39-4933-bc89-4144f21fd4ae None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:56.303819 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e80f7-fb39-4933-bc89-4144f21fd4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:56.304091 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e80f7-fb39-4933-bc89-4144f21fd4ae None admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:56.304774 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e80f7-fb39-4933-bc89-4144f21fd4ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:56.305087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e80f7-fb39-4933-bc89-4144f21fd4ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:56.307283 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e80f7-fb39-4933-bc89-4144f21fd4ae None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:56.318637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 230/455] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:56.319437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e80f7-fb39-4933-bc89-4144f21fd4ae None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:56.376115 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:56.382837 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579517e-171c-4814-adf2-938083f22c57 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:56.417058 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e80f7-fb39-4933-bc89-4144f21fd4ae None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:56.417213 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636e629-a7b8-41cd-87f1-ee16cdf2a64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:56.417730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636e629-a7b8-41cd-87f1-ee16cdf2a64d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:56.418003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636e629-a7b8-41cd-87f1-ee16cdf2a64d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:56.418269 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636e629-a7b8-41cd-87f1-ee16cdf2a64d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:56.424580 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636e629-a7b8-41cd-87f1-ee16cdf2a64d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:56.426009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636e629-a7b8-41cd-87f1-ee16cdf2a64d None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:56.437896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-6636e629-a7b8-41cd-87f1-ee16cdf2a64d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:56.437896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:56.437896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:56.437896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:56.437896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:56.437896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:56.437896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:56.437896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:56.437896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:56.437896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:56.437896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:56.437896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:56.437896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:56.437896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:56.437896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:56.438812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:56.438812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:56.438812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:56.438812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:56.438812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:56.438812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:56.438812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:56.438812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:56.438812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:56.438812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:56.438812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:56.438812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:56.438812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:56.438812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:56.438812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:56.438812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:56.438812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:56.439792 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:56.439792 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:56.439792 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:56.439792 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:56.439792 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:56.439792 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:56.439792 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:56.439792 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:56.439792 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 226/456] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:56.440277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636e629-a7b8-41cd-87f1-ee16cdf2a64d None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:56.447217 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:56.452131 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304e3fe-291e-4dce-a4c4-9f39ecec5de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:56.452756 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304e3fe-291e-4dce-a4c4-9f39ecec5de0 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:56.453015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304e3fe-291e-4dce-a4c4-9f39ecec5de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:56.453279 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304e3fe-291e-4dce-a4c4-9f39ecec5de0 None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:56.453923 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304e3fe-291e-4dce-a4c4-9f39ecec5de0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:56.454232 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304e3fe-291e-4dce-a4c4-9f39ecec5de0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:56.455600 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304e3fe-291e-4dce-a4c4-9f39ecec5de0 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:56.463373 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 231/457] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 24 13:00:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:56.464161 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304e3fe-291e-4dce-a4c4-9f39ecec5de0 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:56.545492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636e629-a7b8-41cd-87f1-ee16cdf2a64d None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:56.564209 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304e3fe-291e-4dce-a4c4-9f39ecec5de0 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:56.579581 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802f2d3-b940-4d63-8945-4ae02c66ee6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:56.580182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802f2d3-b940-4d63-8945-4ae02c66ee6c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:56.580462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802f2d3-b940-4d63-8945-4ae02c66ee6c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:56.580736 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802f2d3-b940-4d63-8945-4ae02c66ee6c None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:56.581370 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802f2d3-b940-4d63-8945-4ae02c66ee6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:56.581669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802f2d3-b940-4d63-8945-4ae02c66ee6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:56.583043 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802f2d3-b940-4d63-8945-4ae02c66ee6c None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:56.583469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:56.595071 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 227/458] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:56.595921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802f2d3-b940-4d63-8945-4ae02c66ee6c None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:56.597726 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da08224-2d06-4f86-a62f-d3f08bfa4f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:56.598347 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da08224-2d06-4f86-a62f-d3f08bfa4f44 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:56.598625 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da08224-2d06-4f86-a62f-d3f08bfa4f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:56.598882 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da08224-2d06-4f86-a62f-d3f08bfa4f44 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:56.607588 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da08224-2d06-4f86-a62f-d3f08bfa4f44 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:56.609364 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da08224-2d06-4f86-a62f-d3f08bfa4f44 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:56.620901 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-3da08224-2d06-4f86-a62f-d3f08bfa4f44 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 24 13:00:56.620901 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:56.620901 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:56.620901 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:56.620901 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:56.620901 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:56.620901 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:56.620901 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:56.620901 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:56.620901 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:56.620901 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:56.620901 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:56.620901 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:56.620901 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:56.620901 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:56.620901 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:56.621824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:56.621824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:56.621824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:56.621824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:56.621824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:56.621824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:56.621824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:56.621824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:56.621824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:56.621824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:56.621824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:56.621824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:56.621824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:56.621824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:56.621824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:56.621824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:56.621824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:56.621824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:56.622711 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:56.622711 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:56.622711 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:56.622711 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:56.622711 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:56.622711 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:56.622711 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:56.622711 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:56.622711 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 24 13:00:56.622711 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:56.622711 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 232/459] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:56.623290 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da08224-2d06-4f86-a62f-d3f08bfa4f44 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:56.659570 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:56.702199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802f2d3-b940-4d63-8945-4ae02c66ee6c None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:56.729417 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da08224-2d06-4f86-a62f-d3f08bfa4f44 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:56.736209 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33fbc4-c6fc-4010-ac3e-77f6d705e94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:56.736806 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33fbc4-c6fc-4010-ac3e-77f6d705e94f None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:56.737083 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33fbc4-c6fc-4010-ac3e-77f6d705e94f None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:56.737352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33fbc4-c6fc-4010-ac3e-77f6d705e94f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:56.738068 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33fbc4-c6fc-4010-ac3e-77f6d705e94f None admin] RBAC: Adding query filter params (role.id=ce7268982b3046a08a5a58a49d928fc6, scope.project.id=f230a12ca6234faabf984e4a58a0d2e8, user.id=4f6b27c7d052437a949a371169fb48ff) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:56.738380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33fbc4-c6fc-4010-ac3e-77f6d705e94f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:56.739858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33fbc4-c6fc-4010-ac3e-77f6d705e94f None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:56.745888 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 228/460] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:00:56 2022] GET /identity/v3/role_assignments?user.id=4f6b27c7d052437a949a371169fb48ff&scope.project.id=f230a12ca6234faabf984e4a58a0d2e8&role.id=ce7268982b3046a08a5a58a49d928fc6 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:56.746661 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33fbc4-c6fc-4010-ac3e-77f6d705e94f None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:56.764310 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138b779-6117-4cdc-a981-06b777762eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:56.765013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138b779-6117-4cdc-a981-06b777762eef None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:56.765194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138b779-6117-4cdc-a981-06b777762eef None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:56.765467 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138b779-6117-4cdc-a981-06b777762eef None admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:56.766179 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138b779-6117-4cdc-a981-06b777762eef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:56.766481 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138b779-6117-4cdc-a981-06b777762eef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:56.768053 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138b779-6117-4cdc-a981-06b777762eef None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:56.787729 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 233/461] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:56.787729 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138b779-6117-4cdc-a981-06b777762eef None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:56.835847 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:56.870058 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33fbc4-c6fc-4010-ac3e-77f6d705e94f None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:56.897534 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138b779-6117-4cdc-a981-06b777762eef None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:56.901089 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:56.911051 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a58439-2956-4e5f-abbe-48b8e937a241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:56.911715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a58439-2956-4e5f-abbe-48b8e937a241 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:56.911989 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a58439-2956-4e5f-abbe-48b8e937a241 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:56.912256 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a58439-2956-4e5f-abbe-48b8e937a241 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:56.924736 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a58439-2956-4e5f-abbe-48b8e937a241 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:56.926304 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a58439-2956-4e5f-abbe-48b8e937a241 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:56.937247 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7071d-c469-4f26-8ba8-6b31369cec29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:56.937884 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7071d-c469-4f26-8ba8-6b31369cec29 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:56.938164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7071d-c469-4f26-8ba8-6b31369cec29 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:56.939383 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7071d-c469-4f26-8ba8-6b31369cec29 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:56.941212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-07a58439-2956-4e5f-abbe-48b8e937a241 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:56.941212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:56.941212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:56.941212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:56.941212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:56.941212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:56.941212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:56.941212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:56.941212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:56.941212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:56.941212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:56.941212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:56.941212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:56.941212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:56.941212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:56.941212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:56.942135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:56.942135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:56.942135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:56.942135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:56.942135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:56.942135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:56.942135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:56.942135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:56.942135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:56.942135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:56.942135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:56.942135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:56.942135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:56.942135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:56.942135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:56.942135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:56.942135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:56.943343 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:56.943343 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:56.943343 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:56.943343 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 229/462] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:56.943604 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a58439-2956-4e5f-abbe-48b8e937a241 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:56.947211 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7071d-c469-4f26-8ba8-6b31369cec29 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:56.948437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7071d-c469-4f26-8ba8-6b31369cec29 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:56.962246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-0ba7071d-c469-4f26-8ba8-6b31369cec29 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 24 13:00:56.962246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:56.962246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:56.962246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:56.962246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:56.962246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:56.962246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:56.962246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:56.962246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:56.962246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:56.962246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:56.962246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:56.962246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:56.962246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:56.962246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:56.962246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:56.963585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:56.963585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:56.963585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:56.963585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:56.963585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:56.963585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:56.963585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:56.963585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:56.963585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:56.963585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:56.963585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:56.963585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:56.963585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:56.963585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:56.963585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:56.963585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:56.963585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:56.963585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:56.964900 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:56.964900 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:56.964900 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:56.964900 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:56.964900 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:56.964900 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:56.964900 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:56.964900 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:56.964900 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 24 13:00:56.964900 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:56.964900 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 234/463] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:56.964900 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7071d-c469-4f26-8ba8-6b31369cec29 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:57.063696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a58439-2956-4e5f-abbe-48b8e937a241 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:57.064038 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:57.067673 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7071d-c469-4f26-8ba8-6b31369cec29 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:57.102176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f4df1-ac19-4d0c-9f19-b7a3fe0da2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:57.102787 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f4df1-ac19-4d0c-9f19-b7a3fe0da2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:57.103230 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f4df1-ac19-4d0c-9f19-b7a3fe0da2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:57.103604 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f4df1-ac19-4d0c-9f19-b7a3fe0da2e3 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:57.104434 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f4df1-ac19-4d0c-9f19-b7a3fe0da2e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:57.104830 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f4df1-ac19-4d0c-9f19-b7a3fe0da2e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:57.105215 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923de8cb-ca84-446d-8d25-18792e77e5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:57.105870 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923de8cb-ca84-446d-8d25-18792e77e5f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:57.106146 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923de8cb-ca84-446d-8d25-18792e77e5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:57.106415 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923de8cb-ca84-446d-8d25-18792e77e5f1 None admin] PATH_INFO: `/v3/projects/f230a12ca6234faabf984e4a58a0d2e8/users/768c71ab4ab241e4bfed9f7561ae3d2d/roles/ce7268982b3046a08a5a58a49d928fc6` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:57.106709 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f4df1-ac19-4d0c-9f19-b7a3fe0da2e3 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:57.122704 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923de8cb-ca84-446d-8d25-18792e77e5f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f230a12ca6234faabf984e4a58a0d2e8, user_id=768c71ab4ab241e4bfed9f7561ae3d2d, role_id=ce7268982b3046a08a5a58a49d928fc6)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:57.124183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923de8cb-ca84-446d-8d25-18792e77e5f1 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:57.130112 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 230/464] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Oct 24 13:00:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:57.131694 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f4df1-ac19-4d0c-9f19-b7a3fe0da2e3 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:57.147453 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 235/465] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 13:00:56 2022] PUT /identity/v3/projects/f230a12ca6234faabf984e4a58a0d2e8/users/768c71ab4ab241e4bfed9f7561ae3d2d/roles/ce7268982b3046a08a5a58a49d928fc6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:57.147453 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923de8cb-ca84-446d-8d25-18792e77e5f1 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:57.190553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:57.278481 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923de8cb-ca84-446d-8d25-18792e77e5f1 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:57.288687 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f4df1-ac19-4d0c-9f19-b7a3fe0da2e3 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:57.324429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698daa6b-218a-4f70-9d40-1569990a82d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:57.325547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698daa6b-218a-4f70-9d40-1569990a82d9 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:57.326246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698daa6b-218a-4f70-9d40-1569990a82d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:57.326684 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698daa6b-218a-4f70-9d40-1569990a82d9 None admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:57.328322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698daa6b-218a-4f70-9d40-1569990a82d9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:57.328784 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698daa6b-218a-4f70-9d40-1569990a82d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:57.331406 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698daa6b-218a-4f70-9d40-1569990a82d9 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:57.335267 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4d732-d788-45a9-9012-9ea650ec5e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:57.335796 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4d732-d788-45a9-9012-9ea650ec5e28 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:57.336071 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4d732-d788-45a9-9012-9ea650ec5e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:57.336343 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4d732-d788-45a9-9012-9ea650ec5e28 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:57.337089 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4d732-d788-45a9-9012-9ea650ec5e28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:57.337459 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4d732-d788-45a9-9012-9ea650ec5e28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:57.339615 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4d732-d788-45a9-9012-9ea650ec5e28 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:57.358279 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 231/466] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:57.358279 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4d732-d788-45a9-9012-9ea650ec5e28 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:57.358521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 236/467] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Oct 24 13:00:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:57.360629 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698daa6b-218a-4f70-9d40-1569990a82d9 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:57.375506 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:57.475393 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:57.480043 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4d732-d788-45a9-9012-9ea650ec5e28 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:57.510568 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698daa6b-218a-4f70-9d40-1569990a82d9 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:57.525229 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ce1a8-f2b4-416c-9669-5f367986a914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:57.526432 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ce1a8-f2b4-416c-9669-5f367986a914 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:57.526884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ce1a8-f2b4-416c-9669-5f367986a914 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:57.527507 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ce1a8-f2b4-416c-9669-5f367986a914 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:57.549987 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6c616-40ec-4ccb-bbb6-16da7c2ac1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:57.550648 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6c616-40ec-4ccb-bbb6-16da7c2ac1ec None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:57.550999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6c616-40ec-4ccb-bbb6-16da7c2ac1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:57.551338 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6c616-40ec-4ccb-bbb6-16da7c2ac1ec None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:57.561275 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6c616-40ec-4ccb-bbb6-16da7c2ac1ec None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:57.562881 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6c616-40ec-4ccb-bbb6-16da7c2ac1ec None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:57.575510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-54f6c616-40ec-4ccb-bbb6-16da7c2ac1ec None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 13:00:57.575510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:57.575510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:57.575510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:57.575510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:57.575510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:57.575510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:57.575510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:57.575510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:57.575510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:57.575510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:57.575510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:57.575510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:57.575510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:57.575510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:57.575510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:57.576444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:57.576444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:57.576444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:57.576444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:57.576444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:57.576444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:57.576444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:57.576444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:57.576444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:57.576444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:57.576444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:57.576444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:57.576444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:57.576444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:57.576444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:57.576444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:57.576444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:57.576444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:57.577331 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:57.577331 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:57.577331 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:57.577331 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:57.577331 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:57.577331 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:57.577331 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:57.577331 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:57.577331 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 13:00:57.577331 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:57.577331 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 237/468] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:57.577877 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6c616-40ec-4ccb-bbb6-16da7c2ac1ec None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:57.617290 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ce1a8-f2b4-416c-9669-5f367986a914 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:57.618756 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ce1a8-f2b4-416c-9669-5f367986a914 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:57.695846 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:57.712130 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6c616-40ec-4ccb-bbb6-16da7c2ac1ec None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:57.742798 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:57.751827 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 232/469] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:00:57.752720 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ce1a8-f2b4-416c-9669-5f367986a914 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:57.763062 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402feef-909e-40e3-b1ac-a3c87a5a3bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:57.764652 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402feef-909e-40e3-b1ac-a3c87a5a3bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:57.765160 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402feef-909e-40e3-b1ac-a3c87a5a3bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:57.765624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402feef-909e-40e3-b1ac-a3c87a5a3bb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:57.839717 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402feef-909e-40e3-b1ac-a3c87a5a3bb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:57.841514 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402feef-909e-40e3-b1ac-a3c87a5a3bb0 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:57.861822 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ce1a8-f2b4-416c-9669-5f367986a914 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:57.899086 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fc4ab-881e-401c-b906-5a78a6b277ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:57.899665 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fc4ab-881e-401c-b906-5a78a6b277ab None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:57.899941 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fc4ab-881e-401c-b906-5a78a6b277ab None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:57.900227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fc4ab-881e-401c-b906-5a78a6b277ab None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:57.900949 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573fc4ab-881e-401c-b906-5a78a6b277ab None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:57.901254 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573fc4ab-881e-401c-b906-5a78a6b277ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:57.902711 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573fc4ab-881e-401c-b906-5a78a6b277ab None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:57.912619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:57.925823 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 233/470] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Oct 24 13:00:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:57.925823 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fc4ab-881e-401c-b906-5a78a6b277ab None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:57.957877 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 238/471] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:00:57.959052 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402feef-909e-40e3-b1ac-a3c87a5a3bb0 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:57.983385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:58.030290 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fc4ab-881e-401c-b906-5a78a6b277ab None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:58.066205 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402feef-909e-40e3-b1ac-a3c87a5a3bb0 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:58.066634 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4582d-85bb-4246-8e6e-cb469273256b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:58.067282 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4582d-85bb-4246-8e6e-cb469273256b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:58.067589 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4582d-85bb-4246-8e6e-cb469273256b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:58.067867 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4582d-85bb-4246-8e6e-cb469273256b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:58.079241 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4582d-85bb-4246-8e6e-cb469273256b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:58.080732 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4582d-85bb-4246-8e6e-cb469273256b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:58.097053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-c0f4582d-85bb-4246-8e6e-cb469273256b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:58.097053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:58.097053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:58.097053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:58.097053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:58.097053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:58.097053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:58.097053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:58.097053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:58.097053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:58.097053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:58.097053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:58.097053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:58.097053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:58.097053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:58.097053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:58.098062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:58.098062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:58.098062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:58.098062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:58.098062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:58.098062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:58.098062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:58.098062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:58.098062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:58.098062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:58.098062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:58.098062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:58.098062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:58.098062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:58.098062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:58.098062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:58.098062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:58.098915 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:58.098915 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:58.098915 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:58.103280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 234/472] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:58.104323 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4582d-85bb-4246-8e6e-cb469273256b None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:58.113497 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e4b42-26d5-44f2-a27a-96d612b50e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:58.114124 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e4b42-26d5-44f2-a27a-96d612b50e8a None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:58.114404 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e4b42-26d5-44f2-a27a-96d612b50e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:58.114675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e4b42-26d5-44f2-a27a-96d612b50e8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:58.163652 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:58.205055 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e4b42-26d5-44f2-a27a-96d612b50e8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:58.207013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e4b42-26d5-44f2-a27a-96d612b50e8a None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:58.229530 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4582d-85bb-4246-8e6e-cb469273256b None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:58.239047 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:58.266191 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17372d0c-47bc-48ad-906c-c76405fa74c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:58.266826 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17372d0c-47bc-48ad-906c-c76405fa74c1 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:58.267106 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17372d0c-47bc-48ad-906c-c76405fa74c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:58.267381 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17372d0c-47bc-48ad-906c-c76405fa74c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:58.278564 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17372d0c-47bc-48ad-906c-c76405fa74c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:58.280054 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17372d0c-47bc-48ad-906c-c76405fa74c1 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:58.294295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-17372d0c-47bc-48ad-906c-c76405fa74c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:58.294295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:58.294295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:58.294295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:58.294295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:58.294295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:58.294295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:58.294295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:58.294295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:58.294295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:58.294295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:58.294295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:58.294295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:58.294295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:58.294295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:58.294295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:58.295686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:58.295686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:58.295686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:58.295686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:58.295686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:58.295686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:58.295686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:58.295686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:58.295686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:58.295686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:58.295686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:58.295686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:58.295686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:58.295686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:58.295686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:58.295686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:58.295686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:58.296563 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:58.296563 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:58.296563 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:58.296563 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 235/473] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:58.296563 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17372d0c-47bc-48ad-906c-c76405fa74c1 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:58.330973 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 239/474] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:00:58.332710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e4b42-26d5-44f2-a27a-96d612b50e8a None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:58.398140 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17372d0c-47bc-48ad-906c-c76405fa74c1 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:58.407214 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:58.433777 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a9987-b041-4ac5-9430-fe9c74a9ea69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:58.434404 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a9987-b041-4ac5-9430-fe9c74a9ea69 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:58.434680 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a9987-b041-4ac5-9430-fe9c74a9ea69 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:58.434943 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a9987-b041-4ac5-9430-fe9c74a9ea69 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:58.435763 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a9987-b041-4ac5-9430-fe9c74a9ea69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:58.436072 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a9987-b041-4ac5-9430-fe9c74a9ea69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:58.437459 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a9987-b041-4ac5-9430-fe9c74a9ea69 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:58.447803 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e4b42-26d5-44f2-a27a-96d612b50e8a None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:58.455219 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 236/475] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:58.456076 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a9987-b041-4ac5-9430-fe9c74a9ea69 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:58.478058 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:58.488964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ad1fb-9d99-4dfc-81bb-784a85a3f898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:58.489881 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ad1fb-9d99-4dfc-81bb-784a85a3f898 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:58.490392 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ad1fb-9d99-4dfc-81bb-784a85a3f898 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:58.490895 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ad1fb-9d99-4dfc-81bb-784a85a3f898 None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:58.491786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ad1fb-9d99-4dfc-81bb-784a85a3f898 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:58.492366 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ad1fb-9d99-4dfc-81bb-784a85a3f898 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:58.494702 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ad1fb-9d99-4dfc-81bb-784a85a3f898 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:58.507780 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 240/476] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:58.509629 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ad1fb-9d99-4dfc-81bb-784a85a3f898 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:58.564901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a9987-b041-4ac5-9430-fe9c74a9ea69 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:58.600171 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3a69e-5d15-4d20-9323-a3a93dd4d56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:58.600800 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3a69e-5d15-4d20-9323-a3a93dd4d56f None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:58.601321 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3a69e-5d15-4d20-9323-a3a93dd4d56f None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:58.601321 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3a69e-5d15-4d20-9323-a3a93dd4d56f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:58.611735 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3a69e-5d15-4d20-9323-a3a93dd4d56f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:58.613207 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3a69e-5d15-4d20-9323-a3a93dd4d56f None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:58.627233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ad1fb-9d99-4dfc-81bb-784a85a3f898 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:58.628664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-ede3a69e-5d15-4d20-9323-a3a93dd4d56f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:58.628664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:58.628664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:58.628664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:58.628664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:58.628664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:58.628664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:58.628664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:58.628664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:58.628664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:58.628664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:58.628664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:58.628664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:58.628664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:58.628664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:58.628664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:58.629568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:58.629568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:58.629568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:58.629568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:58.629568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:58.629568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:58.629568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:58.629568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:58.629568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:58.629568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:58.629568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:58.629568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:58.629568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:58.629568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:58.629568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:58.629568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:58.629568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:58.630419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:58.630419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:58.630419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:58.635065 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 237/477] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:58.636027 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3a69e-5d15-4d20-9323-a3a93dd4d56f None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:58.660084 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:58.670707 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5bd3e-80a1-491e-a16a-2800675c566a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:58.671636 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5bd3e-80a1-491e-a16a-2800675c566a None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:58.672106 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5bd3e-80a1-491e-a16a-2800675c566a None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:58.672602 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5bd3e-80a1-491e-a16a-2800675c566a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:58.680037 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5bd3e-80a1-491e-a16a-2800675c566a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:58.682726 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5bd3e-80a1-491e-a16a-2800675c566a None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:58.696431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-66f5bd3e-80a1-491e-a16a-2800675c566a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:58.696431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:58.696431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:58.696431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:58.696431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:58.696431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:58.696431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:58.696431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:58.696431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:58.696431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:58.696431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:58.696431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:58.696431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:58.696431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:58.696431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:58.697416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:58.697416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:58.697416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:58.697416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:58.697416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:58.697416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:58.697416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:58.697416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:58.697416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:58.697416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:58.697416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:58.697416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:58.697416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:58.697416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:58.697416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:58.697416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:58.697416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:58.698247 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:58.698247 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:58.698247 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:58.698247 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:58.698247 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:58.698247 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:58.698247 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:58.698247 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:00:58.700983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 241/478] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:58.702054 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5bd3e-80a1-491e-a16a-2800675c566a None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:58.716457 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:58.757468 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3a69e-5d15-4d20-9323-a3a93dd4d56f None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:58.800198 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505d20c-acdb-4f1a-9109-21031c4c7ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:58.801180 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505d20c-acdb-4f1a-9109-21031c4c7ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:58.801702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505d20c-acdb-4f1a-9109-21031c4c7ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:58.802193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505d20c-acdb-4f1a-9109-21031c4c7ee3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:58.811886 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505d20c-acdb-4f1a-9109-21031c4c7ee3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:58.814309 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505d20c-acdb-4f1a-9109-21031c4c7ee3 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:58.828399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-8505d20c-acdb-4f1a-9109-21031c4c7ee3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:58.828399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:58.828399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:58.828399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:58.828399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:58.828399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:58.828399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:58.828399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:58.828399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:58.828399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:58.828399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:58.828399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:58.828399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:58.828399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:58.828399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:58.829406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:58.829406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:58.829406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:58.829406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:58.829406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:58.829406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:58.829406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:58.829406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:58.829406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:58.829406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:58.829406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:58.829406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:58.829406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:58.829406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:58.829406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:58.829406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:58.829406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:58.830239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:58.830239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:58.830239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:58.830239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:58.830239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:58.830239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:58.830239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:58.830239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:58.830239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 238/479] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:58.830693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505d20c-acdb-4f1a-9109-21031c4c7ee3 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:58.839368 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5bd3e-80a1-491e-a16a-2800675c566a None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:58.875790 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ff103-b7de-4ce3-a566-ff015ae5f04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:58.876742 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ff103-b7de-4ce3-a566-ff015ae5f04b None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:58.877255 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ff103-b7de-4ce3-a566-ff015ae5f04b None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:58.877716 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ff103-b7de-4ce3-a566-ff015ae5f04b None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:58.878579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ff103-b7de-4ce3-a566-ff015ae5f04b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:58.879091 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ff103-b7de-4ce3-a566-ff015ae5f04b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:58.880704 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ff103-b7de-4ce3-a566-ff015ae5f04b None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:58.893818 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 242/480] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:58.895265 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ff103-b7de-4ce3-a566-ff015ae5f04b None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:58.944925 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505d20c-acdb-4f1a-9109-21031c4c7ee3 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:58.951491 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:58.982976 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:58.988936 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a4a49-2d72-48e9-a613-91cc4878b201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:58.989836 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a4a49-2d72-48e9-a613-91cc4878b201 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:58.989946 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a4a49-2d72-48e9-a613-91cc4878b201 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:58.990193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a4a49-2d72-48e9-a613-91cc4878b201 None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:58.990891 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a4a49-2d72-48e9-a613-91cc4878b201 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:58.991199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a4a49-2d72-48e9-a613-91cc4878b201 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:58.994165 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a4a49-2d72-48e9-a613-91cc4878b201 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:59.011795 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ff103-b7de-4ce3-a566-ff015ae5f04b None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:59.012397 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 239/481] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:59.013284 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a4a49-2d72-48e9-a613-91cc4878b201 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:59.049985 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d42f6-2c08-4eba-bb70-01354f8e67fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:59.050960 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d42f6-2c08-4eba-bb70-01354f8e67fb None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:59.051540 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d42f6-2c08-4eba-bb70-01354f8e67fb None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:59.052036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d42f6-2c08-4eba-bb70-01354f8e67fb None admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:59.052928 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d42f6-2c08-4eba-bb70-01354f8e67fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:59.053417 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d42f6-2c08-4eba-bb70-01354f8e67fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:59.055048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d42f6-2c08-4eba-bb70-01354f8e67fb None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:59.068187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 243/482] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:59.069433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d42f6-2c08-4eba-bb70-01354f8e67fb None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:59.123381 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a4a49-2d72-48e9-a613-91cc4878b201 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:59.159409 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373b590-7500-47c8-8433-94e49bf79668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:59.160061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373b590-7500-47c8-8433-94e49bf79668 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:59.160342 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373b590-7500-47c8-8433-94e49bf79668 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:59.160659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373b590-7500-47c8-8433-94e49bf79668 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:59.168764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373b590-7500-47c8-8433-94e49bf79668 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:59.170578 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373b590-7500-47c8-8433-94e49bf79668 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:59.173789 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d42f6-2c08-4eba-bb70-01354f8e67fb None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:59.182517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-8373b590-7500-47c8-8433-94e49bf79668 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:59.182517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:59.182517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:59.182517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:59.182517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:59.182517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:59.182517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:59.182517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:59.182517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:59.182517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:59.182517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:59.182517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:59.182517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:59.182517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:59.182517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:59.183401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:59.183401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:59.183401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:59.183401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:59.183401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:59.183401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:59.183401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:59.183401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:59.183401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:59.183401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:59.183401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:59.183401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:59.183401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:59.183401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:59.183401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:59.183401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:59.183401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:59.185098 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:59.185098 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:59.185098 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:59.185098 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:59.185098 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:59.185098 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:59.185098 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:59.185098 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:59.185098 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 240/483] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:59.185098 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373b590-7500-47c8-8433-94e49bf79668 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:59.186288 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:59.212884 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f55f6d-79da-4ce8-9319-72124df6b52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:59.213403 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f55f6d-79da-4ce8-9319-72124df6b52f None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:59.213785 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f55f6d-79da-4ce8-9319-72124df6b52f None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:59.213946 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f55f6d-79da-4ce8-9319-72124df6b52f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:59.214657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f55f6d-79da-4ce8-9319-72124df6b52f None admin] RBAC: Adding query filter params (role.id=ce7268982b3046a08a5a58a49d928fc6, scope.project.id=f230a12ca6234faabf984e4a58a0d2e8, user.id=dd0866de4d4e46d5b26719faf385d7a5) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:59.215012 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f55f6d-79da-4ce8-9319-72124df6b52f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:59.216507 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f55f6d-79da-4ce8-9319-72124df6b52f None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:59.222888 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 244/484] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:00:59 2022] GET /identity/v3/role_assignments?user.id=dd0866de4d4e46d5b26719faf385d7a5&scope.project.id=f230a12ca6234faabf984e4a58a0d2e8&role.id=ce7268982b3046a08a5a58a49d928fc6 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:59.224181 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a726f-3006-4cb5-95a5-c680c5aa32c5 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:59.224467 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a726f-3006-4cb5-95a5-c680c5aa32c5 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:59.224738 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a726f-3006-4cb5-95a5-c680c5aa32c5 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:59.226086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 245/485] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:59.231830 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a726f-3006-4cb5-95a5-c680c5aa32c5 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:59.265655 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:59.318775 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373b590-7500-47c8-8433-94e49bf79668 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:59.365903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cccd6e1-f478-4068-b75b-10c3519c12f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:59.366949 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccd6e1-f478-4068-b75b-10c3519c12f9 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:59.367545 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccd6e1-f478-4068-b75b-10c3519c12f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:59.367844 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccd6e1-f478-4068-b75b-10c3519c12f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:59.368595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cccd6e1-f478-4068-b75b-10c3519c12f9 None admin] RBAC: Adding query filter params (role.id=ce7268982b3046a08a5a58a49d928fc6, scope.project.id=f230a12ca6234faabf984e4a58a0d2e8, user.id=0f2295659f2e467d8d798bf93f731330) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:59.368898 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cccd6e1-f478-4068-b75b-10c3519c12f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:59.370593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cccd6e1-f478-4068-b75b-10c3519c12f9 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:59.375136 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a726f-3006-4cb5-95a5-c680c5aa32c5 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:59.377973 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 241/486] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:00:59 2022] GET /identity/v3/role_assignments?user.id=0f2295659f2e467d8d798bf93f731330&scope.project.id=f230a12ca6234faabf984e4a58a0d2e8&role.id=ce7268982b3046a08a5a58a49d928fc6 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:59.379499 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dcffb-2777-4676-8d6d-93e995e8cf44 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:59.379786 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dcffb-2777-4676-8d6d-93e995e8cf44 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:59.380053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dcffb-2777-4676-8d6d-93e995e8cf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:59.400264 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-a16dcffb-2777-4676-8d6d-93e995e8cf44 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:59.402261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a16dcffb-2777-4676-8d6d-93e995e8cf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:59.419597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b133043-bad8-4dd2-a766-2fb8d0af998d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:59.421186 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b133043-bad8-4dd2-a766-2fb8d0af998d None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:59.421740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b133043-bad8-4dd2-a766-2fb8d0af998d None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:59.422250 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b133043-bad8-4dd2-a766-2fb8d0af998d None admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:59.423507 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b133043-bad8-4dd2-a766-2fb8d0af998d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:59.424489 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b133043-bad8-4dd2-a766-2fb8d0af998d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:59.426228 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b133043-bad8-4dd2-a766-2fb8d0af998d None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:59.444388 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 246/487] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:59.453805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b133043-bad8-4dd2-a766-2fb8d0af998d None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:59.491241 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 242/488] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:59.493384 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac04b95-5dca-4bf2-b994-99859d4fd8bc None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:59.493809 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac04b95-5dca-4bf2-b994-99859d4fd8bc None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:59.494498 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac04b95-5dca-4bf2-b994-99859d4fd8bc None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:59.497740 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 243/489] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:00:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:59.504344 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:59.506340 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d7f6e-834a-4887-bc10-933177aa848b None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:59.506851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d7f6e-834a-4887-bc10-933177aa848b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:59.507304 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d7f6e-834a-4887-bc10-933177aa848b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:59.531486 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-2f1d7f6e-834a-4887-bc10-933177aa848b None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:59.533558 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2f1d7f6e-834a-4887-bc10-933177aa848b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:59.604720 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:59.606604 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b133043-bad8-4dd2-a766-2fb8d0af998d None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:59.641811 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 244/490] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:00:59.656204 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b8f4c-9f0f-4065-99b2-d77ad9c9e9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:59.657049 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b8f4c-9f0f-4065-99b2-d77ad9c9e9f5 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:59.657468 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b8f4c-9f0f-4065-99b2-d77ad9c9e9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:59.657899 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b8f4c-9f0f-4065-99b2-d77ad9c9e9f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:59.658755 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b8f4c-9f0f-4065-99b2-d77ad9c9e9f5 None admin] RBAC: Adding query filter params (role.id=ce7268982b3046a08a5a58a49d928fc6, scope.project.id=f230a12ca6234faabf984e4a58a0d2e8, user.id=171146d5235b4af8aff6f502e478f2df) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:59.659209 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b8f4c-9f0f-4065-99b2-d77ad9c9e9f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:59.660713 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b8f4c-9f0f-4065-99b2-d77ad9c9e9f5 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:59.667670 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 247/491] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:00:59 2022] GET /identity/v3/role_assignments?user.id=171146d5235b4af8aff6f502e478f2df&scope.project.id=f230a12ca6234faabf984e4a58a0d2e8&role.id=ce7268982b3046a08a5a58a49d928fc6 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:59.781852 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d7f6e-834a-4887-bc10-933177aa848b None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:59.915117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d7f6e-834a-4887-bc10-933177aa848b None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:59.952052 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cbcfe-587c-491d-9790-9d35a0a9ba97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:59.952925 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cbcfe-587c-491d-9790-9d35a0a9ba97 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:59.953365 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cbcfe-587c-491d-9790-9d35a0a9ba97 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:59.953771 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cbcfe-587c-491d-9790-9d35a0a9ba97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:59.964811 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3cbcfe-587c-491d-9790-9d35a0a9ba97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:59.969977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-dc3cbcfe-587c-491d-9790-9d35a0a9ba97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:00:59.969977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:59.969977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:59.969977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:59.969977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:59.969977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:59.969977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:59.969977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:59.969977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:59.969977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:59.969977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:59.969977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:59.969977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:59.969977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:59.969977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:59.969977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:59.971045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:59.971045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:59.971045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:59.971045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:59.971045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:59.971045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:59.971045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:59.971045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:59.971045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:59.971045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:59.971045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:59.971045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:59.971045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:59.971045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:59.971045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:59.971045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:59.972088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:59.972088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:59.972088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:59.972088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:59.972088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:59.972088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:59.972088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:59.972088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:59.972088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:59.972088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:59.972088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:00:59.972088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:00:59.972775 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b8f4c-9f0f-4065-99b2-d77ad9c9e9f5 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:59.978926 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 245/492] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 24 13:00:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:59.980266 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cbcfe-587c-491d-9790-9d35a0a9ba97 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:00.025960 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:00.100753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cbcfe-587c-491d-9790-9d35a0a9ba97 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:00.141340 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d622d-b0b1-42a7-bdb4-dc380f31fc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:00.141962 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d622d-b0b1-42a7-bdb4-dc380f31fc0d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:00.142248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d622d-b0b1-42a7-bdb4-dc380f31fc0d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:00.142530 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d622d-b0b1-42a7-bdb4-dc380f31fc0d None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:00.143200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d622d-b0b1-42a7-bdb4-dc380f31fc0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:00.143542 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d622d-b0b1-42a7-bdb4-dc380f31fc0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:00.145228 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d622d-b0b1-42a7-bdb4-dc380f31fc0d None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:00.147999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:00.163411 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 246/493] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:00.167141 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b8f4c-9f0f-4065-99b2-d77ad9c9e9f5 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:00.168754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d622d-b0b1-42a7-bdb4-dc380f31fc0d None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:00.220803 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a6c8b-9f9e-421b-94a2-8497dc467964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:00.221445 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a6c8b-9f9e-421b-94a2-8497dc467964 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:00.221726 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a6c8b-9f9e-421b-94a2-8497dc467964 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:00.221998 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a6c8b-9f9e-421b-94a2-8497dc467964 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:00.246141 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a6c8b-9f9e-421b-94a2-8497dc467964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:01:00.253150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-427a6c8b-9f9e-421b-94a2-8497dc467964 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:01:00.253150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:00.253150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:00.253150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:00.253150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:00.253150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:00.253150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:00.253150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:00.253150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:00.253150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:00.253150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:00.253150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:00.253150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:01:00.253150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:01:00.253150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:01:00.253150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:01:00.254465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:01:00.254465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:01:00.254465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:01:00.254465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:01:00.254465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:00.254465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:00.254465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:00.254465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:00.254465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:00.254465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:00.254465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:00.254465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:00.254465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:00.254465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:00.254465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:00.254465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:00.255474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:00.255474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:00.255474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:00.255474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:00.255474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:01:00.255474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:01:00.255474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:01:00.255474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:01:00.255474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:01:00.255474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:01:00.255474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:01:00.255474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:00.255474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 248/494] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:00.261772 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a6c8b-9f9e-421b-94a2-8497dc467964 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:00.349314 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:00.356621 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d622d-b0b1-42a7-bdb4-dc380f31fc0d None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:00.435179 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399a83e-3201-4de2-99fe-cc3e42e7ef17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:00.435863 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399a83e-3201-4de2-99fe-cc3e42e7ef17 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:00.436159 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399a83e-3201-4de2-99fe-cc3e42e7ef17 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:00.436418 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399a83e-3201-4de2-99fe-cc3e42e7ef17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:00.451568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399a83e-3201-4de2-99fe-cc3e42e7ef17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:00.453203 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399a83e-3201-4de2-99fe-cc3e42e7ef17 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:00.466693 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a6c8b-9f9e-421b-94a2-8497dc467964 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:00.471440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-b399a83e-3201-4de2-99fe-cc3e42e7ef17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:00.471440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:00.471440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:00.471440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:00.471440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:00.471440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:00.471440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:00.471440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:00.471440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:00.471440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:00.471440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:00.471440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:00.471440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:00.471440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:00.471440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:00.471440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:00.472350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:00.472350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:00.472350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:00.472350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:00.472350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:00.472350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:00.472350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:00.472350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:00.472350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:00.472350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:00.472350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:00.472350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:00.472350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:00.472350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:00.472350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:00.472350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:00.472350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:00.473226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:00.473226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:00.473226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:00.475706 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 247/495] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:00.478219 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399a83e-3201-4de2-99fe-cc3e42e7ef17 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:00.564113 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332e348-2fc2-4c18-a27c-20d22c86d72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:00.564729 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332e348-2fc2-4c18-a27c-20d22c86d72a None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:00.565053 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332e348-2fc2-4c18-a27c-20d22c86d72a None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:00.565272 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332e348-2fc2-4c18-a27c-20d22c86d72a None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:00.565933 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332e348-2fc2-4c18-a27c-20d22c86d72a None admin] RBAC: Adding query filter params (name=service) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:00.566232 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332e348-2fc2-4c18-a27c-20d22c86d72a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:00.567636 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332e348-2fc2-4c18-a27c-20d22c86d72a None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:00.577598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 249/496] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 24 13:01:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:00.583113 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332e348-2fc2-4c18-a27c-20d22c86d72a None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:00.591164 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399a83e-3201-4de2-99fe-cc3e42e7ef17 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:00.610654 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:00.632935 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c475a-e399-489c-8a9b-8b14306fcaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:00.634352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c475a-e399-489c-8a9b-8b14306fcaf4 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:00.634786 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c475a-e399-489c-8a9b-8b14306fcaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:00.635064 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c475a-e399-489c-8a9b-8b14306fcaf4 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:00.635758 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c475a-e399-489c-8a9b-8b14306fcaf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:00.636160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c475a-e399-489c-8a9b-8b14306fcaf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:00.637656 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c475a-e399-489c-8a9b-8b14306fcaf4 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:00.651413 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 248/497] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:00.656883 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c475a-e399-489c-8a9b-8b14306fcaf4 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:00.671512 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:00.748489 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332e348-2fc2-4c18-a27c-20d22c86d72a None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:00.802304 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea5dc3-2ef1-4d3a-954b-68d566db47ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:00.802990 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea5dc3-2ef1-4d3a-954b-68d566db47ce None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:00.803273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea5dc3-2ef1-4d3a-954b-68d566db47ce None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:00.803574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea5dc3-2ef1-4d3a-954b-68d566db47ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:00.817527 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea5dc3-2ef1-4d3a-954b-68d566db47ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:00.819006 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea5dc3-2ef1-4d3a-954b-68d566db47ce None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:00.843330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-99ea5dc3-2ef1-4d3a-954b-68d566db47ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:00.843330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:00.843330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:00.843330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:00.843330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:00.843330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:00.843330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:00.843330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:00.843330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:00.843330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:00.843330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:00.843330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:00.843330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:00.843330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:00.843330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:00.843330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:00.844429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:00.844429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:00.844429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:00.844429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:00.844429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:00.844429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:00.844429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:00.844429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:00.844429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:00.844429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:00.844429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:00.844429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:00.844429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:00.844429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:00.844429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:00.844429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:00.844429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:00.845306 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:00.845306 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:00.845306 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:00.845306 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 250/498] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:01:00.849916 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea5dc3-2ef1-4d3a-954b-68d566db47ce None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:00.874793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c475a-e399-489c-8a9b-8b14306fcaf4 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:00.959404 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:00.959615 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622895e-f125-4fe9-b4c6-fa94f1d98870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:00.960267 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622895e-f125-4fe9-b4c6-fa94f1d98870 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:00.960454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622895e-f125-4fe9-b4c6-fa94f1d98870 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:00.960686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622895e-f125-4fe9-b4c6-fa94f1d98870 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:00.978810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622895e-f125-4fe9-b4c6-fa94f1d98870 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:00.980690 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622895e-f125-4fe9-b4c6-fa94f1d98870 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:01.003889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-a622895e-f125-4fe9-b4c6-fa94f1d98870 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:01:01.003889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:01.003889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:01.003889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:01.003889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:01.003889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:01.003889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:01.003889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:01.003889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:01.003889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:01.003889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:01.003889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:01.003889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:01:01.003889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:01:01.003889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:01:01.003889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:01:01.005096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:01.005096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:01.005096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:01:01.005096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:01.005096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:01:01.005096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:01.005096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:01.005096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:01.005096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:01.005096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:01.005096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:01.005096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:01.005096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:01.005096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:01.005096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:01.005096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:01.005096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:01.005096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:01.006437 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:01.006437 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:01.006437 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:01:01.006437 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:01:01.006437 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:01:01.006437 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:01:01.006437 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:01:01.006437 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:01:01.006437 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:01:01.006437 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:01.006437 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 249/499] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Oct 24 13:01:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:01.011605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622895e-f125-4fe9-b4c6-fa94f1d98870 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:01.030699 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea5dc3-2ef1-4d3a-954b-68d566db47ce None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:01.089783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10380f-4f54-485b-935c-cde5ba1231ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:01.090812 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10380f-4f54-485b-935c-cde5ba1231ab None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:01.091397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10380f-4f54-485b-935c-cde5ba1231ab None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:01.091896 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10380f-4f54-485b-935c-cde5ba1231ab None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:01.092843 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10380f-4f54-485b-935c-cde5ba1231ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:01.093359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10380f-4f54-485b-935c-cde5ba1231ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:01.095030 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:01.096165 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10380f-4f54-485b-935c-cde5ba1231ab None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:01.125973 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 251/500] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:01.129358 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10380f-4f54-485b-935c-cde5ba1231ab None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:01.168138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622895e-f125-4fe9-b4c6-fa94f1d98870 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:01.233808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc6796-97c8-4a0c-9d0b-684fa2ae37e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:01.234757 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc6796-97c8-4a0c-9d0b-684fa2ae37e0 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:01.236191 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc6796-97c8-4a0c-9d0b-684fa2ae37e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:01.239657 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc6796-97c8-4a0c-9d0b-684fa2ae37e0 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:01.240616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc6796-97c8-4a0c-9d0b-684fa2ae37e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:01.241173 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc6796-97c8-4a0c-9d0b-684fa2ae37e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:01.243511 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc6796-97c8-4a0c-9d0b-684fa2ae37e0 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:01.286946 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 250/501] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Oct 24 13:01:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:01.293538 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc6796-97c8-4a0c-9d0b-684fa2ae37e0 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:01.300045 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10380f-4f54-485b-935c-cde5ba1231ab None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:01.333894 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:01.341697 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbb2b8-4c4b-40ec-9284-158b61df192d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:01.342705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbb2b8-4c4b-40ec-9284-158b61df192d None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:01.343201 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbb2b8-4c4b-40ec-9284-158b61df192d None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:01.343767 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbb2b8-4c4b-40ec-9284-158b61df192d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:01.352943 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbb2b8-4c4b-40ec-9284-158b61df192d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:01.355324 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbb2b8-4c4b-40ec-9284-158b61df192d None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:01.369695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-a8cbb2b8-4c4b-40ec-9284-158b61df192d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 24 13:01:01.369695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:01.369695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:01.369695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:01.369695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:01.369695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:01.369695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:01.369695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:01.369695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:01.369695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:01.369695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:01.369695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:01.369695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:01:01.369695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:01:01.369695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:01:01.369695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:01:01.370788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:01.370788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:01.370788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:01:01.370788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:01.370788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:01:01.370788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:01.370788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:01.370788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:01.370788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:01.370788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:01.370788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:01.370788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:01.370788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:01.370788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:01.370788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:01.370788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:01.370788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:01.370788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:01.371758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:01.371758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:01.371758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:01:01.371758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:01:01.371758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:01:01.371758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:01:01.371758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:01:01.371758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:01:01.371758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 24 13:01:01.371758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:01.374521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 252/502] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 24 13:01:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:01.379829 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbb2b8-4c4b-40ec-9284-158b61df192d None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:01.505460 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbb2b8-4c4b-40ec-9284-158b61df192d None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:01.556090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc6796-97c8-4a0c-9d0b-684fa2ae37e0 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:01.574666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a20e90-28b8-4ad4-97ae-b3972936f35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:01.576066 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a20e90-28b8-4ad4-97ae-b3972936f35d None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:01.576340 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a20e90-28b8-4ad4-97ae-b3972936f35d None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:01.576606 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a20e90-28b8-4ad4-97ae-b3972936f35d None admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:01.577329 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a20e90-28b8-4ad4-97ae-b3972936f35d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:01.577626 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a20e90-28b8-4ad4-97ae-b3972936f35d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:01.579064 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a20e90-28b8-4ad4-97ae-b3972936f35d None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:01.609403 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:01.615955 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 253/503] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Oct 24 13:01:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:01.621495 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438ec7a-4f0c-4133-8c71-e84f44c0249f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:01.622120 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438ec7a-4f0c-4133-8c71-e84f44c0249f None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:01.622393 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438ec7a-4f0c-4133-8c71-e84f44c0249f None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:01.622661 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438ec7a-4f0c-4133-8c71-e84f44c0249f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:01.624065 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a20e90-28b8-4ad4-97ae-b3972936f35d None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:01.645961 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438ec7a-4f0c-4133-8c71-e84f44c0249f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:01.647397 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438ec7a-4f0c-4133-8c71-e84f44c0249f None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:01.680702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-2438ec7a-4f0c-4133-8c71-e84f44c0249f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:01.680702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:01.680702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:01.680702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:01.680702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:01.680702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:01.680702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:01.680702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:01.680702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:01.680702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:01.680702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:01.680702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:01.680702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:01.680702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:01.680702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:01.680702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:01.681715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:01.681715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:01.681715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:01.681715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:01.681715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:01.681715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:01.681715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:01.681715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:01.681715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:01.681715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:01.681715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:01.681715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:01.681715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:01.681715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:01.681715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:01.681715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:01.681715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:01.682606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:01.682606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:01.682606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:01.684537 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 251/504] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:01.688364 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438ec7a-4f0c-4133-8c71-e84f44c0249f None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:01.723848 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:01.828963 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a20e90-28b8-4ad4-97ae-b3972936f35d None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:01.880743 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438ec7a-4f0c-4133-8c71-e84f44c0249f None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:01.888903 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eee8fc-e3b7-4f94-88ae-bd326b985e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:01.889510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eee8fc-e3b7-4f94-88ae-bd326b985e56 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:01.889787 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eee8fc-e3b7-4f94-88ae-bd326b985e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:01.890062 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eee8fc-e3b7-4f94-88ae-bd326b985e56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:01.924070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacc666-e480-4220-9fe8-c5d5cb82c63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:01.924834 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacc666-e480-4220-9fe8-c5d5cb82c63a None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:01.925521 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacc666-e480-4220-9fe8-c5d5cb82c63a None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:01.925794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacc666-e480-4220-9fe8-c5d5cb82c63a None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:01.926714 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacc666-e480-4220-9fe8-c5d5cb82c63a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:01.927014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacc666-e480-4220-9fe8-c5d5cb82c63a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:01.929489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacc666-e480-4220-9fe8-c5d5cb82c63a None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:01.947615 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 252/505] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:01.949821 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d7fd5-2936-4847-8a7b-83c64cc9a0b0 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:01.950101 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d7fd5-2936-4847-8a7b-83c64cc9a0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:01.951005 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d7fd5-2936-4847-8a7b-83c64cc9a0b0 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:01.953144 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 253/506] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:01.954276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d7fd5-2936-4847-8a7b-83c64cc9a0b0 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:01.987773 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eee8fc-e3b7-4f94-88ae-bd326b985e56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:01.989745 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eee8fc-e3b7-4f94-88ae-bd326b985e56 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:02.008299 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:02.052301 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:02.086940 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d7fd5-2936-4847-8a7b-83c64cc9a0b0 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:02.114873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 254/507] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:01:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:01:02.116232 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367ba36-d4eb-4bcd-b839-da9f23fd318e None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:02.116518 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367ba36-d4eb-4bcd-b839-da9f23fd318e None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:02.116788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367ba36-d4eb-4bcd-b839-da9f23fd318e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:02.128435 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120e96d-f440-430e-a49b-a1fe8cd1d3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:02.129071 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120e96d-f440-430e-a49b-a1fe8cd1d3bd None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:02.129777 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120e96d-f440-430e-a49b-a1fe8cd1d3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:02.130054 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120e96d-f440-430e-a49b-a1fe8cd1d3bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:02.135930 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-c367ba36-d4eb-4bcd-b839-da9f23fd318e None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:02.137118 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-c367ba36-d4eb-4bcd-b839-da9f23fd318e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:02.137728 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120e96d-f440-430e-a49b-a1fe8cd1d3bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:02.139346 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120e96d-f440-430e-a49b-a1fe8cd1d3bd None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:02.152747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-1120e96d-f440-430e-a49b-a1fe8cd1d3bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:02.152747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:02.152747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:02.152747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:02.152747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:02.152747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:02.152747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:02.152747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:02.152747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:02.152747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:02.152747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:02.152747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:02.152747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:01:02.152747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:01:02.152747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:01:02.153659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:01:02.153659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:02.153659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:02.153659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:02.153659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:02.153659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:02.153659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:02.153659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:02.153659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:02.153659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:02.153659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:02.153659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:02.153659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:02.153659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:02.153659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:02.153659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:02.153659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:02.159533 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:01:02.159533 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:01:02.159533 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:01:02.159533 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:01:02.159533 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:01:02.159533 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:01:02.159533 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:02.159533 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:02.159533 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 254/508] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:01:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:02.159533 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f19f58-0b1b-498b-936b-9d8a9acfe7b7 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:02.159533 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f19f58-0b1b-498b-936b-9d8a9acfe7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:02.160139 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f19f58-0b1b-498b-936b-9d8a9acfe7b7 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:02.160139 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 255/509] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:02.160139 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f19f58-0b1b-498b-936b-9d8a9acfe7b7 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:02.216251 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 255/510] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:01:02.220546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367ba36-d4eb-4bcd-b839-da9f23fd318e None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:02.267354 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:02.271953 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f19f58-0b1b-498b-936b-9d8a9acfe7b7 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:02.314769 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8281a-9d3b-4652-acb8-cd311e2b9a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:02.315842 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8281a-9d3b-4652-acb8-cd311e2b9a30 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:02.316363 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8281a-9d3b-4652-acb8-cd311e2b9a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:02.316832 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8281a-9d3b-4652-acb8-cd311e2b9a30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:02.329500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8281a-9d3b-4652-acb8-cd311e2b9a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:02.329731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:02.331384 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8281a-9d3b-4652-acb8-cd311e2b9a30 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:02.347201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-c7a8281a-9d3b-4652-acb8-cd311e2b9a30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:02.347201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:02.347201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:02.347201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:02.347201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:02.347201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:02.347201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:02.347201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:02.347201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:02.347201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:02.347201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:02.347201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:02.347201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:02.347201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:02.347201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:02.347201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:02.348380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:02.348380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:02.348380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:02.348380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:02.348380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:02.348380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:02.348380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:02.348380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:02.348380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:02.348380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:02.348380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:02.348380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:02.348380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:02.348380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:02.348380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:02.348380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:02.348380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:02.349466 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:02.349466 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:02.349466 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:02.354809 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 256/511] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:02.354809 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836d354-e390-43bc-93b7-871337774660 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:02.354809 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836d354-e390-43bc-93b7-871337774660 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:02.354809 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836d354-e390-43bc-93b7-871337774660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:02.364907 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367ba36-d4eb-4bcd-b839-da9f23fd318e None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:02.372232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-e836d354-e390-43bc-93b7-871337774660 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:02.373719 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e836d354-e390-43bc-93b7-871337774660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:02.409320 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a16537-0467-4de6-864d-433129ee753b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:02.409924 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a16537-0467-4de6-864d-433129ee753b None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:02.410212 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a16537-0467-4de6-864d-433129ee753b None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:02.410453 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a16537-0467-4de6-864d-433129ee753b None admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:02.411133 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a16537-0467-4de6-864d-433129ee753b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:02.411456 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a16537-0467-4de6-864d-433129ee753b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:02.412867 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a16537-0467-4de6-864d-433129ee753b None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:02.427601 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 256/512] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 24 13:01:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:02.427601 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a16537-0467-4de6-864d-433129ee753b None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:02.450038 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 257/513] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:01:02.451511 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d8211-15c8-4d57-9efb-886cc14aa370 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:02.451965 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d8211-15c8-4d57-9efb-886cc14aa370 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:02.452418 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d8211-15c8-4d57-9efb-886cc14aa370 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:02.453822 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 258/514] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:02.454670 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d8211-15c8-4d57-9efb-886cc14aa370 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:02.535820 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a16537-0467-4de6-864d-433129ee753b None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:02.553536 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:02.576083 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d8211-15c8-4d57-9efb-886cc14aa370 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:02.577967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aca319-c8a9-4733-b4da-cf4989cdb196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:02.579351 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aca319-c8a9-4733-b4da-cf4989cdb196 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:02.579735 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aca319-c8a9-4733-b4da-cf4989cdb196 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:02.580007 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aca319-c8a9-4733-b4da-cf4989cdb196 None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:02.580643 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aca319-c8a9-4733-b4da-cf4989cdb196 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:02.580943 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aca319-c8a9-4733-b4da-cf4989cdb196 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:02.582318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aca319-c8a9-4733-b4da-cf4989cdb196 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:02.590494 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:02.596476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 257/515] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:02.597548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd10c7-1958-49ef-8585-46508ae4ffcf None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:02.597833 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd10c7-1958-49ef-8585-46508ae4ffcf None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:02.598107 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd10c7-1958-49ef-8585-46508ae4ffcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:02.616002 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-18bd10c7-1958-49ef-8585-46508ae4ffcf None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:02.617179 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-18bd10c7-1958-49ef-8585-46508ae4ffcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:02.618744 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0e580-bcb6-43f2-8b03-11e850e73a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:02.619555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0e580-bcb6-43f2-8b03-11e850e73a4b None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:02.619991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0e580-bcb6-43f2-8b03-11e850e73a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:02.620262 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0e580-bcb6-43f2-8b03-11e850e73a4b None admin] PATH_INFO: `/v3/projects/f230a12ca6234faabf984e4a58a0d2e8/users/4f6b27c7d052437a949a371169fb48ff/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:02.622908 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0e580-bcb6-43f2-8b03-11e850e73a4b None admin] RBAC: Authorizing `identity:create_grant(project_id=f230a12ca6234faabf984e4a58a0d2e8, user_id=4f6b27c7d052437a949a371169fb48ff, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:02.624386 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0e580-bcb6-43f2-8b03-11e850e73a4b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:02.643501 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 259/516] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 13:01:02 2022] PUT /identity/v3/projects/f230a12ca6234faabf984e4a58a0d2e8/users/4f6b27c7d052437a949a371169fb48ff/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:01:02.644427 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0e580-bcb6-43f2-8b03-11e850e73a4b None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:02.720876 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 258/517] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:01:02.721574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd10c7-1958-49ef-8585-46508ae4ffcf None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:02.765323 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0e580-bcb6-43f2-8b03-11e850e73a4b None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:02.806579 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650c10c-4996-4013-a75f-f67017f02a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:02.807160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650c10c-4996-4013-a75f-f67017f02a86 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:02.807464 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650c10c-4996-4013-a75f-f67017f02a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:02.807742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650c10c-4996-4013-a75f-f67017f02a86 None admin] PATH_INFO: `/v3/services/network` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:02.808345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650c10c-4996-4013-a75f-f67017f02a86 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:02.809769 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650c10c-4996-4013-a75f-f67017f02a86 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:02.822200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-8650c10c-4996-4013-a75f-f67017f02a86 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:01:02.822200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:02.822200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:01:02.822200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:01:02.822200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:01:02.822200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:01:02.822200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:01:02.822200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:02.822200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:01:02.822200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:02.822200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:02.822200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:02.822200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:02.822200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:02.822200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:02.822200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:02.822200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:02.823315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:02.823315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:02.823315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:02.823315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:02.823315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:02.823315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:02.823315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:01:02.823315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:01:02.823315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:01:02.823315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:01:02.823315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:02.823315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:02.823315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:02.823315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:02.823315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:02.823315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:02.824226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:02.824226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:02.824226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:02.824226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:02.824226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:02.824226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:02.824226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:02.824226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:02.824226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:02.824226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:02.824226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:01:02.824226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:02.824226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:01:02.824226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:02.828613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 260/518] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:01:02 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:02.829556 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650c10c-4996-4013-a75f-f67017f02a86 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:02.840816 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:02.860617 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd10c7-1958-49ef-8585-46508ae4ffcf None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:02.889280 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:02.897278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5d03c-3584-4eb7-bd15-94d5eb84f131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:02.897910 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5d03c-3584-4eb7-bd15-94d5eb84f131 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:02.898183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5d03c-3584-4eb7-bd15-94d5eb84f131 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:02.898448 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5d03c-3584-4eb7-bd15-94d5eb84f131 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:02.908328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5d03c-3584-4eb7-bd15-94d5eb84f131 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:02.910074 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5d03c-3584-4eb7-bd15-94d5eb84f131 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:02.928359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-04a5d03c-3584-4eb7-bd15-94d5eb84f131 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:02.928359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:02.928359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:02.928359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:02.928359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:02.928359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:02.928359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:02.928359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:02.928359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:02.928359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:02.928359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:02.928359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:02.928359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:01:02.928359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:01:02.928359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:01:02.929278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:01:02.929278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:02.929278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:02.929278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:02.929278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:02.929278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:02.929278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:02.929278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:02.929278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:02.929278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:02.929278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:02.929278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:02.929278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:02.929278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:02.929278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:02.929278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:02.929278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:02.930195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:01:02.930195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:01:02.930195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:01:02.930195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:01:02.930195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:01:02.930195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:01:02.930195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:02.930195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:02.930195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 259/519] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:01:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:02.930195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5d03c-3584-4eb7-bd15-94d5eb84f131 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:02.972329 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650c10c-4996-4013-a75f-f67017f02a86 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:03.012259 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87b3a5-173b-4c13-bf25-78f338232c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:03.013132 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87b3a5-173b-4c13-bf25-78f338232c52 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:03.013600 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87b3a5-173b-4c13-bf25-78f338232c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:03.013872 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87b3a5-173b-4c13-bf25-78f338232c52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:03.026438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87b3a5-173b-4c13-bf25-78f338232c52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:03.027952 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87b3a5-173b-4c13-bf25-78f338232c52 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:03.045877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-ba87b3a5-173b-4c13-bf25-78f338232c52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:03.045877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:03.045877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:03.045877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:03.045877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:03.045877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:03.045877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:03.045877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:03.045877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:03.045877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:03.045877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:03.045877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:03.045877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:03.045877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:03.045877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:03.045877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:03.046873 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:03.046873 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:03.046873 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:03.046873 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:03.046873 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:03.046873 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:03.046873 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:03.046873 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:03.046873 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:03.046873 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:03.046873 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:03.046873 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:03.046873 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:03.046873 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:03.046873 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:03.046873 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:03.046873 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:03.048389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:03.048389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:03.048389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:03.048389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 261/520] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:03.048389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87b3a5-173b-4c13-bf25-78f338232c52 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:03.058520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5d03c-3584-4eb7-bd15-94d5eb84f131 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:03.093465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f74c1-fc38-48a2-b7f4-7d9aac2ff7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:03.094074 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f74c1-fc38-48a2-b7f4-7d9aac2ff7d9 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:03.094352 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f74c1-fc38-48a2-b7f4-7d9aac2ff7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:03.094622 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f74c1-fc38-48a2-b7f4-7d9aac2ff7d9 None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:03.095245 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f74c1-fc38-48a2-b7f4-7d9aac2ff7d9 None admin] RBAC: Adding query filter params (name=network) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:03.095580 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f74c1-fc38-48a2-b7f4-7d9aac2ff7d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:03.096950 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f74c1-fc38-48a2-b7f4-7d9aac2ff7d9 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:03.101421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 260/521] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 24 13:01:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:03.107373 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f74c1-fc38-48a2-b7f4-7d9aac2ff7d9 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:03.109594 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:03.154174 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87b3a5-173b-4c13-bf25-78f338232c52 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:03.161601 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:03.190779 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8e1ce-8b8c-43d7-998a-be632b6df3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:03.191530 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8e1ce-8b8c-43d7-998a-be632b6df3ed None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:03.191813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8e1ce-8b8c-43d7-998a-be632b6df3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:03.192206 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8e1ce-8b8c-43d7-998a-be632b6df3ed None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:03.192889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8e1ce-8b8c-43d7-998a-be632b6df3ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:03.193195 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8e1ce-8b8c-43d7-998a-be632b6df3ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:03.194746 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8e1ce-8b8c-43d7-998a-be632b6df3ed None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:03.214556 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 262/522] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 24 13:01:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:03.214556 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8e1ce-8b8c-43d7-998a-be632b6df3ed None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:03.214840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f74c1-fc38-48a2-b7f4-7d9aac2ff7d9 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:03.250359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c3660-03c8-49ec-8020-91c6ca707c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:03.251236 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c3660-03c8-49ec-8020-91c6ca707c9f None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:03.251594 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c3660-03c8-49ec-8020-91c6ca707c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:03.251895 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c3660-03c8-49ec-8020-91c6ca707c9f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:03.252428 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c3660-03c8-49ec-8020-91c6ca707c9f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:03.253781 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c3660-03c8-49ec-8020-91c6ca707c9f None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:03.266063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-7f6c3660-03c8-49ec-8020-91c6ca707c9f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:01:03.266063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:03.266063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:01:03.266063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:01:03.266063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:01:03.266063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:01:03.266063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:01:03.266063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:03.266063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:01:03.266063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:03.266063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:03.266063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:03.266063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:03.266063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:03.266063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:03.266063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:03.266063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:03.267092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:03.267092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:03.267092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:03.267092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:03.267092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:03.267092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:03.267092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:01:03.267092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:01:03.267092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:01:03.267092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:01:03.267092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:03.267092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:03.267092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:03.267092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:03.267092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:03.267092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:03.267983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:03.267983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:03.267983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:03.267983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:03.267983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:03.267983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:03.267983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:03.267983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:03.267983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:03.267983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:03.267983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:01:03.267983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:03.267983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:01:03.267983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:03.267983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 261/523] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Oct 24 13:01:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:03.269348 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c3660-03c8-49ec-8020-91c6ca707c9f None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:03.332989 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8e1ce-8b8c-43d7-998a-be632b6df3ed None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:03.353484 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:03.370436 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa4f5d-c1ec-4186-97ad-e50f348cc0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:03.371123 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa4f5d-c1ec-4186-97ad-e50f348cc0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:03.371402 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa4f5d-c1ec-4186-97ad-e50f348cc0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:03.371716 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa4f5d-c1ec-4186-97ad-e50f348cc0b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:03.372350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa4f5d-c1ec-4186-97ad-e50f348cc0b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:03.372636 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa4f5d-c1ec-4186-97ad-e50f348cc0b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:03.374006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa4f5d-c1ec-4186-97ad-e50f348cc0b9 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:03.382047 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c3660-03c8-49ec-8020-91c6ca707c9f None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:03.385967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 263/524] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:03.386764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa4f5d-c1ec-4186-97ad-e50f348cc0b9 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:03.404335 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:03.422949 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c86a3-0331-46a6-8f28-e8e575de2632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:03.423522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c86a3-0331-46a6-8f28-e8e575de2632 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:03.423799 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c86a3-0331-46a6-8f28-e8e575de2632 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:03.424066 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c86a3-0331-46a6-8f28-e8e575de2632 None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:03.424712 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c86a3-0331-46a6-8f28-e8e575de2632 None admin] RBAC: Adding query filter params (type=network) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:03.425008 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c86a3-0331-46a6-8f28-e8e575de2632 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:03.426395 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c86a3-0331-46a6-8f28-e8e575de2632 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:03.443467 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 262/525] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 24 13:01:03 2022] GET /identity/v3/services?type=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:03.443467 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c86a3-0331-46a6-8f28-e8e575de2632 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:03.531976 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa4f5d-c1ec-4186-97ad-e50f348cc0b9 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:03.576667 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a128c-94b8-4138-b888-dfb8bb8f92a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:03.577356 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a128c-94b8-4138-b888-dfb8bb8f92a3 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:03.577593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a128c-94b8-4138-b888-dfb8bb8f92a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:03.577829 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a128c-94b8-4138-b888-dfb8bb8f92a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:03.578553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a128c-94b8-4138-b888-dfb8bb8f92a3 None admin] RBAC: Adding query filter params (role.id=ce7268982b3046a08a5a58a49d928fc6, scope.project.id=f230a12ca6234faabf984e4a58a0d2e8, user.id=768c71ab4ab241e4bfed9f7561ae3d2d) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:03.578855 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a128c-94b8-4138-b888-dfb8bb8f92a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:03.579690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c86a3-0331-46a6-8f28-e8e575de2632 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:03.580345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a128c-94b8-4138-b888-dfb8bb8f92a3 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:03.591152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 264/526] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:01:03 2022] GET /identity/v3/role_assignments?user.id=768c71ab4ab241e4bfed9f7561ae3d2d&scope.project.id=f230a12ca6234faabf984e4a58a0d2e8&role.id=ce7268982b3046a08a5a58a49d928fc6 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:03.592363 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a128c-94b8-4138-b888-dfb8bb8f92a3 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:03.641952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f381f3-d16f-456c-a427-6faff9702a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:03.642565 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f381f3-d16f-456c-a427-6faff9702a08 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:03.642842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f381f3-d16f-456c-a427-6faff9702a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:03.643108 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f381f3-d16f-456c-a427-6faff9702a08 None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:03.644347 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f381f3-d16f-456c-a427-6faff9702a08 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:03.644347 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f381f3-d16f-456c-a427-6faff9702a08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:03.645471 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f381f3-d16f-456c-a427-6faff9702a08 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:03.651725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 263/527] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Oct 24 13:01:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:03.658354 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f381f3-d16f-456c-a427-6faff9702a08 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:03.673703 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:03.712695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:03.723034 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a128c-94b8-4138-b888-dfb8bb8f92a3 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:03.761938 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d9caf-e729-40b5-80ed-3229f10d7063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:03.762659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d9caf-e729-40b5-80ed-3229f10d7063 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:03.763009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d9caf-e729-40b5-80ed-3229f10d7063 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:03.763374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d9caf-e729-40b5-80ed-3229f10d7063 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:03.764264 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d9caf-e729-40b5-80ed-3229f10d7063 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:03.765770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d9caf-e729-40b5-80ed-3229f10d7063 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:03.777896 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f381f3-d16f-456c-a427-6faff9702a08 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:03.801327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 265/528] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 24 13:01:03 2022] POST /identity/v3/users => generated 254 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:01:03.818383 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207d837-756e-4167-be3e-64e9d1b42476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:03.819464 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207d837-756e-4167-be3e-64e9d1b42476 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:03.819940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207d837-756e-4167-be3e-64e9d1b42476 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:03.820434 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207d837-756e-4167-be3e-64e9d1b42476 None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:03.822383 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207d837-756e-4167-be3e-64e9d1b42476 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:03.822941 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207d837-756e-4167-be3e-64e9d1b42476 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:03.824860 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207d837-756e-4167-be3e-64e9d1b42476 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:03.831019 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 264/529] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Oct 24 13:01:03 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:05.227916 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa39a2-5279-4d49-a2c3-2cad8e2de30f None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:05.228560 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa39a2-5279-4d49-a2c3-2cad8e2de30f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:05.228560 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa39a2-5279-4d49-a2c3-2cad8e2de30f None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:05.229882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 266/530] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:01:05.244846 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f460f63-d85f-45c6-b210-83ab020569f9 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:05.245291 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f460f63-d85f-45c6-b210-83ab020569f9 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:05.245369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f460f63-d85f-45c6-b210-83ab020569f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:05.267567 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-6f460f63-d85f-45c6-b210-83ab020569f9 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:05.268731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-6f460f63-d85f-45c6-b210-83ab020569f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:05.367295 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 265/531] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:01:05.717111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa39a2-5279-4d49-a2c3-2cad8e2de30f None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:05.848166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:05.855217 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa39a2-5279-4d49-a2c3-2cad8e2de30f None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:05.906508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7d7fb-8f4e-44b3-947f-93da78d774fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:05.907143 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7d7fb-8f4e-44b3-947f-93da78d774fa None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:05.907437 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7d7fb-8f4e-44b3-947f-93da78d774fa None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:05.907710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7d7fb-8f4e-44b3-947f-93da78d774fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:05.928298 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7d7fb-8f4e-44b3-947f-93da78d774fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:01:05.933693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-71e7d7fb-8f4e-44b3-947f-93da78d774fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:01:05.933693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:05.933693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:05.933693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:05.933693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:05.933693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:05.933693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:05.933693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:05.933693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:05.933693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:05.933693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:05.933693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:05.933693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:01:05.933693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:01:05.933693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:01:05.933693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:01:05.934666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:01:05.934666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:01:05.934666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:01:05.934666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:01:05.934666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:05.934666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:05.934666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:05.934666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:05.934666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:05.934666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:05.934666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:05.934666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:05.934666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:05.934666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:05.934666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:05.934666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:05.935557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:05.935557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:05.935557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:05.935557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:05.935557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:01:05.935557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:01:05.935557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:01:05.935557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:01:05.935557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:01:05.935557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:01:05.935557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:01:05.935557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:05.936211 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 267/532] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 24 13:01:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:05.944543 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f460f63-d85f-45c6-b210-83ab020569f9 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:06.013209 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:06.103173 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb26e7-2f08-4e1f-9105-d0b74e5a1f81 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:06.103496 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb26e7-2f08-4e1f-9105-d0b74e5a1f81 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:06.103697 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb26e7-2f08-4e1f-9105-d0b74e5a1f81 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:06.105754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 268/533] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:01:06.111251 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5829a6-8f13-4547-bbdc-4eda941151ef None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:06.111721 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5829a6-8f13-4547-bbdc-4eda941151ef None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:06.111994 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5829a6-8f13-4547-bbdc-4eda941151ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:06.118214 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f460f63-d85f-45c6-b210-83ab020569f9 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:06.153416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-ab5829a6-8f13-4547-bbdc-4eda941151ef None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:06.154579 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ab5829a6-8f13-4547-bbdc-4eda941151ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:06.174706 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b59df2-113a-4662-9af3-41622c2fc44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:06.175318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b59df2-113a-4662-9af3-41622c2fc44f None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:06.175611 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b59df2-113a-4662-9af3-41622c2fc44f None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:06.175874 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b59df2-113a-4662-9af3-41622c2fc44f None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:06.176530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b59df2-113a-4662-9af3-41622c2fc44f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:06.176823 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b59df2-113a-4662-9af3-41622c2fc44f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:06.178345 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b59df2-113a-4662-9af3-41622c2fc44f None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:06.194103 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 266/534] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:01:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:06.200283 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b59df2-113a-4662-9af3-41622c2fc44f None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:06.296680 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 269/535] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:01:06.343878 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:06.347243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b59df2-113a-4662-9af3-41622c2fc44f None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:06.398386 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a81f5-eb2e-451a-9417-b144fcd7cb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:06.399195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a81f5-eb2e-451a-9417-b144fcd7cb19 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:06.399587 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a81f5-eb2e-451a-9417-b144fcd7cb19 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:06.399853 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a81f5-eb2e-451a-9417-b144fcd7cb19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:06.416077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a81f5-eb2e-451a-9417-b144fcd7cb19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:06.417594 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a81f5-eb2e-451a-9417-b144fcd7cb19 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:06.433092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-4d6a81f5-eb2e-451a-9417-b144fcd7cb19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:06.433092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:06.433092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:06.433092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:06.433092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:06.433092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:06.433092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:06.433092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:06.433092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:06.433092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:06.433092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:06.433092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:06.433092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:06.433092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:06.433092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:06.433092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:06.434077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:06.434077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:06.434077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:06.434077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:06.434077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:06.434077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:06.434077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:06.434077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:06.434077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:06.434077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:06.434077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:06.434077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:06.434077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:06.434077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:06.434077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:06.434077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:06.434077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:06.434970 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:06.434970 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:06.434970 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:06.434970 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 267/536] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:01:06.440845 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5829a6-8f13-4547-bbdc-4eda941151ef None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:06.571531 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06d186-f49c-40e9-863a-915d9916318c None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:06.571859 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06d186-f49c-40e9-863a-915d9916318c None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:06.572099 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06d186-f49c-40e9-863a-915d9916318c None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:06.573697 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 268/537] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:06.578918 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaedbb-fc7b-4672-8c5e-a01ab9fb96f0 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:06.579201 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaedbb-fc7b-4672-8c5e-a01ab9fb96f0 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:06.579503 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaedbb-fc7b-4672-8c5e-a01ab9fb96f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:06.586654 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:06.599688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5829a6-8f13-4547-bbdc-4eda941151ef None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:06.616857 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-d4aaedbb-fc7b-4672-8c5e-a01ab9fb96f0 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:06.618062 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d4aaedbb-fc7b-4672-8c5e-a01ab9fb96f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:06.639642 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e7b14-987d-4cef-946c-6258f70c55e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:06.640707 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e7b14-987d-4cef-946c-6258f70c55e9 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:06.640992 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e7b14-987d-4cef-946c-6258f70c55e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:06.641266 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e7b14-987d-4cef-946c-6258f70c55e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:06.642067 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e7b14-987d-4cef-946c-6258f70c55e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:06.642370 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e7b14-987d-4cef-946c-6258f70c55e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:06.643768 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e7b14-987d-4cef-946c-6258f70c55e9 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:06.655809 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 270/538] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:06.656940 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a72e9-4721-404a-bef5-4d70282301c4 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:06.657225 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a72e9-4721-404a-bef5-4d70282301c4 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:06.657496 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a72e9-4721-404a-bef5-4d70282301c4 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:06.658685 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 271/539] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:06.659709 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfe9bb-e406-4759-8255-e95c3dd65cdd None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:06.659990 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfe9bb-e406-4759-8255-e95c3dd65cdd None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:06.660264 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfe9bb-e406-4759-8255-e95c3dd65cdd None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:06.661560 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 272/540] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:06.662096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfe9bb-e406-4759-8255-e95c3dd65cdd None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:06.691786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 269/541] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:01:06.692625 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aaedbb-fc7b-4672-8c5e-a01ab9fb96f0 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:06.769201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfe9bb-e406-4759-8255-e95c3dd65cdd None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:06.786225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:06.805402 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6f166-aa4d-4be9-a907-401512189a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:06.806005 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6f166-aa4d-4be9-a907-401512189a8d None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:06.806285 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6f166-aa4d-4be9-a907-401512189a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:06.806447 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aaedbb-fc7b-4672-8c5e-a01ab9fb96f0 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:06.806545 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6f166-aa4d-4be9-a907-401512189a8d None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:06.807188 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6f166-aa4d-4be9-a907-401512189a8d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:06.808598 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6f166-aa4d-4be9-a907-401512189a8d None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:06.825239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 273/542] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 24 13:01:06 2022] POST /identity/v3/services => generated 240 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:01:06.826323 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb9f0e-ea7f-4726-8f59-e6773ebf354e None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:06.826607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb9f0e-ea7f-4726-8f59-e6773ebf354e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:06.826884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb9f0e-ea7f-4726-8f59-e6773ebf354e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:06.847623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-bddb9f0e-ea7f-4726-8f59-e6773ebf354e None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:06.848933 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-bddb9f0e-ea7f-4726-8f59-e6773ebf354e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:06.851355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:06.872756 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83860be6-c71d-4a2c-bd58-c83bd4734194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:06.874169 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83860be6-c71d-4a2c-bd58-c83bd4734194 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:06.874646 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83860be6-c71d-4a2c-bd58-c83bd4734194 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:06.875120 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83860be6-c71d-4a2c-bd58-c83bd4734194 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:06.886256 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83860be6-c71d-4a2c-bd58-c83bd4734194 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:06.889109 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83860be6-c71d-4a2c-bd58-c83bd4734194 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:06.906570 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-83860be6-c71d-4a2c-bd58-c83bd4734194 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:01:06.906570 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:06.906570 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:06.906570 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:06.906570 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:06.906570 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:06.906570 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:06.906570 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:06.906570 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:06.906570 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:06.906570 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:06.906570 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:06.906570 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:01:06.906570 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:01:06.906570 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:01:06.906570 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:01:06.907591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:06.907591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:06.907591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:01:06.907591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:06.907591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:01:06.907591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:06.907591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:06.907591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:06.907591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:06.907591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:06.907591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:06.907591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:06.907591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:06.907591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:06.907591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:06.907591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:06.907591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:06.907591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:06.908532 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:06.908532 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:06.908532 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:01:06.908532 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:01:06.908532 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:01:06.908532 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:01:06.908532 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:01:06.908532 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:01:06.908532 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:01:06.908532 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:06.909062 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 270/543] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Oct 24 13:01:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:06.910364 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f705d-eac5-4cf8-b1a1-d97daca80734 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:06.910647 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f705d-eac5-4cf8-b1a1-d97daca80734 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:06.910917 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f705d-eac5-4cf8-b1a1-d97daca80734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:06.933127 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-6e9f705d-eac5-4cf8-b1a1-d97daca80734 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:06.934374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-6e9f705d-eac5-4cf8-b1a1-d97daca80734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:06.943000 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 274/544] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:06 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:01:06.944757 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb9f0e-ea7f-4726-8f59-e6773ebf354e None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:07.027251 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 271/545] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:06 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:01:07.028399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f705d-eac5-4cf8-b1a1-d97daca80734 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:07.076228 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb9f0e-ea7f-4726-8f59-e6773ebf354e None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:07.112001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:07.126058 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc63362-f7ec-4da3-ac7d-9afea69981b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:07.127120 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc63362-f7ec-4da3-ac7d-9afea69981b8 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:07.127406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc63362-f7ec-4da3-ac7d-9afea69981b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:07.127988 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc63362-f7ec-4da3-ac7d-9afea69981b8 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:07.128730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc63362-f7ec-4da3-ac7d-9afea69981b8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:07.129299 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc63362-f7ec-4da3-ac7d-9afea69981b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:07.131241 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc63362-f7ec-4da3-ac7d-9afea69981b8 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:07.142872 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:07.151360 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f705d-eac5-4cf8-b1a1-d97daca80734 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:07.159073 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 275/546] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Oct 24 13:01:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:07.164468 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc63362-f7ec-4da3-ac7d-9afea69981b8 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:07.196534 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330204d-7110-43d8-88c8-55b21d90d7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:07.197239 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330204d-7110-43d8-88c8-55b21d90d7e3 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:07.197428 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330204d-7110-43d8-88c8-55b21d90d7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:07.197685 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330204d-7110-43d8-88c8-55b21d90d7e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:07.208993 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4330204d-7110-43d8-88c8-55b21d90d7e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:01:07.214547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-4330204d-7110-43d8-88c8-55b21d90d7e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:01:07.214547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:07.214547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:07.214547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:07.214547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:07.214547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:07.214547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:07.214547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:07.214547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:07.214547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:07.214547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:07.214547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:07.214547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:01:07.214547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:01:07.214547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:01:07.214547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:01:07.215521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:01:07.215521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:01:07.215521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:01:07.215521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:01:07.215521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:07.215521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:07.215521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:07.215521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:07.215521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:07.215521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:07.215521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:07.215521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:07.215521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:07.215521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:07.215521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:07.215521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:07.216363 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:07.216363 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:07.216363 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:07.216363 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:07.216363 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:01:07.216363 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:01:07.216363 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:01:07.216363 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:01:07.216363 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:01:07.216363 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:01:07.216363 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:01:07.216363 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:07.219382 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 272/547] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 24 13:01:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:07.224062 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330204d-7110-43d8-88c8-55b21d90d7e3 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:07.284812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc63362-f7ec-4da3-ac7d-9afea69981b8 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:07.327355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee16bc0-59fd-45f9-8ef8-841ca453e977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:07.329008 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee16bc0-59fd-45f9-8ef8-841ca453e977 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:07.329494 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee16bc0-59fd-45f9-8ef8-841ca453e977 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:07.329995 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee16bc0-59fd-45f9-8ef8-841ca453e977 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:07.333320 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330204d-7110-43d8-88c8-55b21d90d7e3 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:07.362137 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:07.371895 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee384112-5c7b-4ab0-8184-6ccc8141ac73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:07.372508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee384112-5c7b-4ab0-8184-6ccc8141ac73 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:07.372786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee384112-5c7b-4ab0-8184-6ccc8141ac73 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:07.373053 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee384112-5c7b-4ab0-8184-6ccc8141ac73 None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:07.374068 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee384112-5c7b-4ab0-8184-6ccc8141ac73 None admin] RBAC: Adding query filter params (name=service) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:07.374366 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee384112-5c7b-4ab0-8184-6ccc8141ac73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:07.376098 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee384112-5c7b-4ab0-8184-6ccc8141ac73 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:07.389442 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 273/548] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 24 13:01:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:07.389442 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee384112-5c7b-4ab0-8184-6ccc8141ac73 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:07.400497 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:07.407929 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee16bc0-59fd-45f9-8ef8-841ca453e977 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:07.409887 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee16bc0-59fd-45f9-8ef8-841ca453e977 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:07.490043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee384112-5c7b-4ab0-8184-6ccc8141ac73 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:07.520463 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 276/549] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:01:07 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 24 13:01:07.521440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee16bc0-59fd-45f9-8ef8-841ca453e977 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:07.525407 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b3187-9aed-4307-afc5-c8ff9c756589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:07.526294 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b3187-9aed-4307-afc5-c8ff9c756589 None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:07.526575 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b3187-9aed-4307-afc5-c8ff9c756589 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:07.526851 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b3187-9aed-4307-afc5-c8ff9c756589 None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:07.527525 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b3187-9aed-4307-afc5-c8ff9c756589 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:07.528922 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b3187-9aed-4307-afc5-c8ff9c756589 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:07.552254 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 274/550] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 24 13:01:07 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:01:07.553320 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b3187-9aed-4307-afc5-c8ff9c756589 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:07.635852 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:07.651646 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:07.660512 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee16bc0-59fd-45f9-8ef8-841ca453e977 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:07.715202 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b3187-9aed-4307-afc5-c8ff9c756589 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:07.716230 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d9785-3642-494f-8209-80df17370a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:07.717449 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d9785-3642-494f-8209-80df17370a3b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:07.718977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d9785-3642-494f-8209-80df17370a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:07.719513 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d9785-3642-494f-8209-80df17370a3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:07.737854 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d9785-3642-494f-8209-80df17370a3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:01:07.743305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-754d9785-3642-494f-8209-80df17370a3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:01:07.743305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:07.743305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:07.743305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:07.743305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:07.743305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:07.743305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:07.743305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:07.743305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:07.743305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:07.743305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:07.743305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:07.743305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:01:07.743305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:01:07.743305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:01:07.743305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:01:07.744355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:01:07.744355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:01:07.744355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:01:07.744355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:01:07.744355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:07.744355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:07.744355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:07.744355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:07.744355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:07.744355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:07.744355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:07.744355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:07.744355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:07.744355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:07.744355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:07.744355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:07.745239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:07.745239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:07.745239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:07.745239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:07.745239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:01:07.745239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:01:07.745239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:01:07.745239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:01:07.745239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:01:07.745239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:01:07.745239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:01:07.745239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:07.747955 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 277/551] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 24 13:01:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:07.748898 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d9785-3642-494f-8209-80df17370a3b None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:07.764004 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9b567-e4ac-42fd-a540-8847c05d2e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:07.764494 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9b567-e4ac-42fd-a540-8847c05d2e29 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:07.764630 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9b567-e4ac-42fd-a540-8847c05d2e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:07.764956 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9b567-e4ac-42fd-a540-8847c05d2e29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:07.781535 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9b567-e4ac-42fd-a540-8847c05d2e29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:07.782839 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9b567-e4ac-42fd-a540-8847c05d2e29 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:07.798026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-3ca9b567-e4ac-42fd-a540-8847c05d2e29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:07.798026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:07.798026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:07.798026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:07.798026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:07.798026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:07.798026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:07.798026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:07.798026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:07.798026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:07.798026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:07.798026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:07.798026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:07.798026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:07.798026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:07.798026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:07.799031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:07.799031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:07.799031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:07.799031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:07.799031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:07.799031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:07.799031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:07.799031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:07.799031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:07.799031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:07.799031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:07.799031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:07.799031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:07.799031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:07.799031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:07.799031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:07.799031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:07.800326 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:07.800326 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:07.800326 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:07.800326 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 275/552] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:07.800853 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9b567-e4ac-42fd-a540-8847c05d2e29 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:07.869561 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d9785-3642-494f-8209-80df17370a3b None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:07.909925 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bce4ca-2771-42f9-bc77-78df41c2f6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:07.910580 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bce4ca-2771-42f9-bc77-78df41c2f6c5 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:07.910799 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bce4ca-2771-42f9-bc77-78df41c2f6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:07.911066 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bce4ca-2771-42f9-bc77-78df41c2f6c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:07.912757 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:07.918084 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9b567-e4ac-42fd-a540-8847c05d2e29 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:07.924020 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bce4ca-2771-42f9-bc77-78df41c2f6c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:07.925476 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bce4ca-2771-42f9-bc77-78df41c2f6c5 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:07.943374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-f7bce4ca-2771-42f9-bc77-78df41c2f6c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:07.943374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:07.943374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:07.943374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:07.943374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:07.943374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:07.943374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:07.943374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:07.943374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:07.943374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:07.943374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:07.943374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:07.943374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:07.943374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:07.943374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:07.943374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:07.944446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:07.944446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:07.944446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:07.944446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:07.944446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:07.944446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:07.944446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:07.944446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:07.944446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:07.944446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:07.944446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:07.944446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:07.944446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:07.944446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:07.944446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:07.944446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:07.944446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:07.945903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:07.945903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:07.945903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:07.947503 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 278/553] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:07.948533 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bce4ca-2771-42f9-bc77-78df41c2f6c5 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:07.960063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace88e35-2a98-45aa-9340-01edc33dfb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:07.961591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace88e35-2a98-45aa-9340-01edc33dfb50 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:07.962072 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace88e35-2a98-45aa-9340-01edc33dfb50 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:07.962614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace88e35-2a98-45aa-9340-01edc33dfb50 None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:07.963654 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace88e35-2a98-45aa-9340-01edc33dfb50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:07.964204 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace88e35-2a98-45aa-9340-01edc33dfb50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:07.965845 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace88e35-2a98-45aa-9340-01edc33dfb50 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:07.975567 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 276/554] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:01:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:07.976895 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace88e35-2a98-45aa-9340-01edc33dfb50 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:07.999032 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:08.079263 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bce4ca-2771-42f9-bc77-78df41c2f6c5 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:08.084446 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace88e35-2a98-45aa-9340-01edc33dfb50 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:08.118365 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6c818-eae3-4df5-a7e5-6fbdb5a8f55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:08.119178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6c818-eae3-4df5-a7e5-6fbdb5a8f55e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:08.119553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6c818-eae3-4df5-a7e5-6fbdb5a8f55e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:08.119893 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6c818-eae3-4df5-a7e5-6fbdb5a8f55e None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:08.120604 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6c818-eae3-4df5-a7e5-6fbdb5a8f55e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:08.120904 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6c818-eae3-4df5-a7e5-6fbdb5a8f55e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:08.122380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6c818-eae3-4df5-a7e5-6fbdb5a8f55e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:08.122650 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03adc7-c7bf-4bdf-9f5d-b4f2a5a8136f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:08.123516 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03adc7-c7bf-4bdf-9f5d-b4f2a5a8136f None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:08.124252 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03adc7-c7bf-4bdf-9f5d-b4f2a5a8136f None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:08.124754 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03adc7-c7bf-4bdf-9f5d-b4f2a5a8136f None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:08.125469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03adc7-c7bf-4bdf-9f5d-b4f2a5a8136f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:08.125841 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03adc7-c7bf-4bdf-9f5d-b4f2a5a8136f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:08.127273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03adc7-c7bf-4bdf-9f5d-b4f2a5a8136f None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:08.137443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 279/555] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:08.138405 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6c818-eae3-4df5-a7e5-6fbdb5a8f55e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:08.147041 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 277/556] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:08.148028 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03adc7-c7bf-4bdf-9f5d-b4f2a5a8136f None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:08.170564 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:08.223927 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:08.254442 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03adc7-c7bf-4bdf-9f5d-b4f2a5a8136f None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:08.259150 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6c818-eae3-4df5-a7e5-6fbdb5a8f55e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:08.291334 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506d95f-8851-4524-ba22-0eefce6cdc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:08.292090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506d95f-8851-4524-ba22-0eefce6cdc3c None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:08.292437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506d95f-8851-4524-ba22-0eefce6cdc3c None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:08.292776 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506d95f-8851-4524-ba22-0eefce6cdc3c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:08.299159 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456a46b-a672-4aea-bc4f-7689d59fb3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:08.300085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456a46b-a672-4aea-bc4f-7689d59fb3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:08.300365 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506d95f-8851-4524-ba22-0eefce6cdc3c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:08.300802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456a46b-a672-4aea-bc4f-7689d59fb3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:08.301266 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456a46b-a672-4aea-bc4f-7689d59fb3a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:08.301913 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506d95f-8851-4524-ba22-0eefce6cdc3c None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:08.314922 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456a46b-a672-4aea-bc4f-7689d59fb3a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:08.315672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-9506d95f-8851-4524-ba22-0eefce6cdc3c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 13:01:08.315672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:08.315672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:08.315672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:08.315672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:08.315672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:08.315672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:08.315672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:08.315672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:08.315672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:08.315672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:08.315672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:08.315672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:01:08.315672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:01:08.315672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:01:08.315672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:01:08.316590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:08.316590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:08.316590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:01:08.316590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:08.316590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:01:08.316590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:08.316590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:08.316590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:08.316590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:08.316590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:08.316590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:08.316590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:08.316590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:08.316590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:08.316590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:08.316590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:08.316590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:08.316590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:08.318090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:08.318090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:08.318090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:01:08.318090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:01:08.318090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:01:08.318090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:01:08.318090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:01:08.318090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:01:08.318090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 13:01:08.318090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:08.319933 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456a46b-a672-4aea-bc4f-7689d59fb3a7 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:08.322025 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 278/557] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Oct 24 13:01:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:08.322962 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506d95f-8851-4524-ba22-0eefce6cdc3c None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:08.337280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-2456a46b-a672-4aea-bc4f-7689d59fb3a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:08.337280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:08.337280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:08.337280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:08.337280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:08.337280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:08.337280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:08.337280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:08.337280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:08.337280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:08.337280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:08.337280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:08.337280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:08.337280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:08.337280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:08.337280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:08.338607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:08.338607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:08.338607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:08.338607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:08.338607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:08.338607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:08.338607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:08.338607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:08.338607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:08.338607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:08.338607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:08.338607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:08.338607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:08.338607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:08.338607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:08.338607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:08.338607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:08.339626 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:08.339626 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:08.339626 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:08.348830 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 280/558] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:08.348830 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456a46b-a672-4aea-bc4f-7689d59fb3a7 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:08.427042 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:08.449617 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506d95f-8851-4524-ba22-0eefce6cdc3c None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:08.475258 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456a46b-a672-4aea-bc4f-7689d59fb3a7 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:08.493551 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba097d-a6cb-46de-a35c-df100e5a14ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:08.494642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba097d-a6cb-46de-a35c-df100e5a14ec None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:08.495391 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba097d-a6cb-46de-a35c-df100e5a14ec None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:08.495910 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba097d-a6cb-46de-a35c-df100e5a14ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:08.497797 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:08.504815 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba097d-a6cb-46de-a35c-df100e5a14ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:08.506871 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba097d-a6cb-46de-a35c-df100e5a14ec None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:08.514531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86635fd9-4651-4e92-b595-140ba6d76911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:08.515371 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86635fd9-4651-4e92-b595-140ba6d76911 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:08.515835 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86635fd9-4651-4e92-b595-140ba6d76911 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:08.516251 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86635fd9-4651-4e92-b595-140ba6d76911 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:08.517113 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86635fd9-4651-4e92-b595-140ba6d76911 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:08.517559 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86635fd9-4651-4e92-b595-140ba6d76911 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:08.519125 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86635fd9-4651-4e92-b595-140ba6d76911 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:08.520258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-9fba097d-a6cb-46de-a35c-df100e5a14ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:08.520258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:08.520258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:08.520258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:08.520258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:08.520258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:08.520258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:08.520258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:08.520258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:08.520258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:08.520258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:08.520258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:08.520258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:01:08.520258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:01:08.520258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:01:08.521307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:01:08.521307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:08.521307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:08.521307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:08.521307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:08.521307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:08.521307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:08.521307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:08.521307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:08.521307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:08.521307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:08.521307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:08.521307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:08.521307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:08.521307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:08.521307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:08.521307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:08.522404 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:01:08.522404 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:01:08.522404 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:01:08.522404 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:01:08.522404 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:01:08.522404 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:01:08.522404 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:08.522404 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:08.527892 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 279/559] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:01:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:08.527892 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba097d-a6cb-46de-a35c-df100e5a14ec None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:08.550623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 281/560] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Oct 24 13:01:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:08.554587 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86635fd9-4651-4e92-b595-140ba6d76911 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:08.642235 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba097d-a6cb-46de-a35c-df100e5a14ec None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:08.671303 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86635fd9-4651-4e92-b595-140ba6d76911 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:08.680703 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787e6f6-9f83-433e-a0c5-189549d7ec1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:08.681540 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787e6f6-9f83-433e-a0c5-189549d7ec1d None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:08.682011 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787e6f6-9f83-433e-a0c5-189549d7ec1d None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:08.682511 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787e6f6-9f83-433e-a0c5-189549d7ec1d None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:08.683323 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787e6f6-9f83-433e-a0c5-189549d7ec1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:08.683915 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787e6f6-9f83-433e-a0c5-189549d7ec1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:08.685466 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787e6f6-9f83-433e-a0c5-189549d7ec1d None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:08.696084 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:08.703821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 280/561] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:08.704899 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787e6f6-9f83-433e-a0c5-189549d7ec1d None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:08.709087 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b3b76-ce3b-4b56-aad0-0199eb592256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:08.709765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b3b76-ce3b-4b56-aad0-0199eb592256 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:08.710109 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b3b76-ce3b-4b56-aad0-0199eb592256 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:08.710446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b3b76-ce3b-4b56-aad0-0199eb592256 None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:08.711649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b3b76-ce3b-4b56-aad0-0199eb592256 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:08.712025 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b3b76-ce3b-4b56-aad0-0199eb592256 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:08.714369 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b3b76-ce3b-4b56-aad0-0199eb592256 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:08.732787 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 282/562] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 24 13:01:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:08.732787 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b3b76-ce3b-4b56-aad0-0199eb592256 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:08.775370 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:08.826025 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787e6f6-9f83-433e-a0c5-189549d7ec1d None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:08.843462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b3b76-ce3b-4b56-aad0-0199eb592256 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:08.863520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab143e3-17a4-450b-b825-0f37c074a4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:08.864483 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab143e3-17a4-450b-b825-0f37c074a4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:08.865069 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab143e3-17a4-450b-b825-0f37c074a4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:08.865545 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab143e3-17a4-450b-b825-0f37c074a4f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:08.877515 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab143e3-17a4-450b-b825-0f37c074a4f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:08.879280 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab143e3-17a4-450b-b825-0f37c074a4f2 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:08.879392 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c830fd9-bee5-424c-b5ed-cfa04e13b0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:08.879974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c830fd9-bee5-424c-b5ed-cfa04e13b0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:08.880249 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c830fd9-bee5-424c-b5ed-cfa04e13b0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:08.880514 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c830fd9-bee5-424c-b5ed-cfa04e13b0f6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:08.890729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c830fd9-bee5-424c-b5ed-cfa04e13b0f6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:08.892458 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c830fd9-bee5-424c-b5ed-cfa04e13b0f6 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:08.897180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-2ab143e3-17a4-450b-b825-0f37c074a4f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:08.897180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:08.897180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:08.897180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:08.897180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:08.897180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:08.897180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:08.897180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:08.897180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:08.897180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:08.897180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:08.897180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:08.897180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:08.897180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:08.897180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:08.897180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:08.898089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:08.898089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:08.898089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:08.898089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:08.898089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:08.898089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:08.898089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:08.898089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:08.898089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:08.898089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:08.898089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:08.898089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:08.898089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:08.898089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:08.898089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:08.898089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:08.898089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:08.899008 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:08.899008 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:08.899008 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:08.901214 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 281/563] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:08.902198 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab143e3-17a4-450b-b825-0f37c074a4f2 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:08.904609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-3c830fd9-bee5-424c-b5ed-cfa04e13b0f6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 24 13:01:08.904609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:08.904609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:08.904609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:08.904609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:08.904609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:08.904609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:08.904609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:08.904609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:08.904609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:08.904609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:08.904609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:08.904609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:01:08.904609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:01:08.904609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:01:08.904609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:01:08.905553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:08.905553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:08.905553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:01:08.905553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:08.905553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:01:08.905553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:08.905553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:08.905553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:08.905553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:08.905553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:08.905553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:08.905553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:08.905553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:08.905553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:08.905553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:08.905553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:08.905553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:08.905553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:08.906508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:08.906508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:08.906508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:01:08.906508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:01:08.906508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:01:08.906508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:01:08.906508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:01:08.906508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:01:08.906508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 24 13:01:08.906508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:08.910783 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 283/564] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 24 13:01:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:08.911660 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c830fd9-bee5-424c-b5ed-cfa04e13b0f6 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:08.974026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:09.025998 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:09.030041 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c830fd9-bee5-424c-b5ed-cfa04e13b0f6 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:09.045918 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab143e3-17a4-450b-b825-0f37c074a4f2 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:09.066426 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f682c-a61c-455e-89e6-96d009a4abcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:09.067029 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f682c-a61c-455e-89e6-96d009a4abcd None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:09.067305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f682c-a61c-455e-89e6-96d009a4abcd None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:09.067600 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f682c-a61c-455e-89e6-96d009a4abcd None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:09.068232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f682c-a61c-455e-89e6-96d009a4abcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:09.068525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f682c-a61c-455e-89e6-96d009a4abcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:09.069990 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f682c-a61c-455e-89e6-96d009a4abcd None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:09.084143 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 284/565] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:09.085084 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f682c-a61c-455e-89e6-96d009a4abcd None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:09.094014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2938fd0-293e-4a89-9166-8ba882ddfc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:09.095400 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2938fd0-293e-4a89-9166-8ba882ddfc64 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:09.095908 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2938fd0-293e-4a89-9166-8ba882ddfc64 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:09.096377 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2938fd0-293e-4a89-9166-8ba882ddfc64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:09.097750 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2938fd0-293e-4a89-9166-8ba882ddfc64 None admin] RBAC: Adding query filter params (role.id=23ca6ecd60b2470cba913daeaf54f0f7, scope.project.id=f230a12ca6234faabf984e4a58a0d2e8, user.id=4f6b27c7d052437a949a371169fb48ff) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:09.098651 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2938fd0-293e-4a89-9166-8ba882ddfc64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:09.100841 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2938fd0-293e-4a89-9166-8ba882ddfc64 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:09.115647 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 282/566] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:01:08 2022] GET /identity/v3/role_assignments?user.id=4f6b27c7d052437a949a371169fb48ff&scope.project.id=f230a12ca6234faabf984e4a58a0d2e8&role.id=23ca6ecd60b2470cba913daeaf54f0f7 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:09.115647 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2938fd0-293e-4a89-9166-8ba882ddfc64 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:09.280328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f682c-a61c-455e-89e6-96d009a4abcd None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:09.320102 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2938fd0-293e-4a89-9166-8ba882ddfc64 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:09.339092 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3c8ba-62d7-4cb7-a670-750599f00f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:09.339913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3c8ba-62d7-4cb7-a670-750599f00f1b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:09.340169 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3c8ba-62d7-4cb7-a670-750599f00f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:09.340437 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3c8ba-62d7-4cb7-a670-750599f00f1b None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:09.341174 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3c8ba-62d7-4cb7-a670-750599f00f1b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:09.341477 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3c8ba-62d7-4cb7-a670-750599f00f1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:09.341812 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:09.344425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3c8ba-62d7-4cb7-a670-750599f00f1b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:09.365367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23cc20-39a0-4941-9c2b-5eaf9b6f1b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:09.366004 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23cc20-39a0-4941-9c2b-5eaf9b6f1b46 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:09.366281 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23cc20-39a0-4941-9c2b-5eaf9b6f1b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:09.368418 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23cc20-39a0-4941-9c2b-5eaf9b6f1b46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:09.368532 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 285/567] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Oct 24 13:01:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:09.368869 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba248454-7937-4982-8cfc-79644f7cbd75 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:09.369104 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba248454-7937-4982-8cfc-79644f7cbd75 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:09.369379 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba248454-7937-4982-8cfc-79644f7cbd75 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:09.371207 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 286/568] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:09.374318 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba248454-7937-4982-8cfc-79644f7cbd75 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:09.380876 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23cc20-39a0-4941-9c2b-5eaf9b6f1b46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:09.383521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23cc20-39a0-4941-9c2b-5eaf9b6f1b46 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:09.394130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:09.396739 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-2e23cc20-39a0-4941-9c2b-5eaf9b6f1b46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:09.396739 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:09.396739 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:09.396739 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:09.396739 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:09.396739 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:09.396739 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:09.396739 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:09.396739 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:09.396739 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:09.396739 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:09.396739 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:09.396739 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:01:09.396739 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:01:09.396739 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:01:09.397827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:01:09.397827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:09.397827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:09.397827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:09.397827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:09.397827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:09.397827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:09.397827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:09.397827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:09.397827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:09.397827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:09.397827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:09.397827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:09.397827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:09.397827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:09.397827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:09.397827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:09.398980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:01:09.398980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:01:09.398980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:01:09.398980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:01:09.398980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:01:09.398980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:01:09.398980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:09.398980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:09.403065 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 283/569] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:01:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:09.404644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091b430-690f-478e-8177-68949f63d154 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:09.404644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091b430-690f-478e-8177-68949f63d154 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:09.404926 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091b430-690f-478e-8177-68949f63d154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:09.428504 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-0091b430-690f-478e-8177-68949f63d154 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:09.430852 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-0091b430-690f-478e-8177-68949f63d154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:09.494052 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba248454-7937-4982-8cfc-79644f7cbd75 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:09.532777 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81858c13-9725-40f2-94b2-4fd1009ba601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:09.533369 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81858c13-9725-40f2-94b2-4fd1009ba601 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:09.533650 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81858c13-9725-40f2-94b2-4fd1009ba601 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:09.533916 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81858c13-9725-40f2-94b2-4fd1009ba601 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:09.538728 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 284/570] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:09.540608 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091b430-690f-478e-8177-68949f63d154 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:09.554995 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81858c13-9725-40f2-94b2-4fd1009ba601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:09.556858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81858c13-9725-40f2-94b2-4fd1009ba601 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:09.572784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-81858c13-9725-40f2-94b2-4fd1009ba601 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:09.572784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:09.572784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:09.572784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:09.572784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:09.572784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:09.572784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:09.572784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:09.572784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:09.572784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:09.572784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:09.572784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:09.572784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:09.572784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:09.572784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:09.572784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:09.574210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:09.574210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:09.574210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:09.574210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:09.574210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:09.574210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:09.574210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:09.574210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:09.574210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:09.574210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:09.574210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:09.574210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:09.574210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:09.574210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:09.574210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:09.574210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:09.574210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:09.575130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:09.575130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:09.575130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:09.578707 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 287/571] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:09.580099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81858c13-9725-40f2-94b2-4fd1009ba601 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:09.673565 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091b430-690f-478e-8177-68949f63d154 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:09.683508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:09.692634 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:09.729330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df29f81-262f-4d01-a6e6-89ca06c219b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:09.731056 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df29f81-262f-4d01-a6e6-89ca06c219b9 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:09.731723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df29f81-262f-4d01-a6e6-89ca06c219b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:09.733245 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df29f81-262f-4d01-a6e6-89ca06c219b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:09.735064 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df29f81-262f-4d01-a6e6-89ca06c219b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:09.735849 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df29f81-262f-4d01-a6e6-89ca06c219b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:09.740079 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df29f81-262f-4d01-a6e6-89ca06c219b9 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:09.756083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 285/572] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 24 13:01:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:09.764499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df29f81-262f-4d01-a6e6-89ca06c219b9 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:09.767490 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81858c13-9725-40f2-94b2-4fd1009ba601 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:09.818908 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6fb18-14bc-47d1-99f9-deeb616f3476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:09.821360 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6fb18-14bc-47d1-99f9-deeb616f3476 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:09.821674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6fb18-14bc-47d1-99f9-deeb616f3476 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:09.821955 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6fb18-14bc-47d1-99f9-deeb616f3476 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:09.822953 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6fb18-14bc-47d1-99f9-deeb616f3476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:09.823259 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6fb18-14bc-47d1-99f9-deeb616f3476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:09.824925 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6fb18-14bc-47d1-99f9-deeb616f3476 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:09.850506 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 288/573] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:09.855322 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6fb18-14bc-47d1-99f9-deeb616f3476 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:09.931057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df29f81-262f-4d01-a6e6-89ca06c219b9 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:09.960576 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6fb18-14bc-47d1-99f9-deeb616f3476 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:09.968874 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67be1e9-508c-4ff9-938a-7df6452529b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:09.969541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67be1e9-508c-4ff9-938a-7df6452529b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:09.969821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67be1e9-508c-4ff9-938a-7df6452529b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:09.970093 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67be1e9-508c-4ff9-938a-7df6452529b1 None admin] PATH_INFO: `/v3/projects/f230a12ca6234faabf984e4a58a0d2e8/users/f3254b4fddaa4f099c6c44f4c139ee5e/roles/ce7268982b3046a08a5a58a49d928fc6` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:09.984620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67be1e9-508c-4ff9-938a-7df6452529b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f230a12ca6234faabf984e4a58a0d2e8, user_id=f3254b4fddaa4f099c6c44f4c139ee5e, role_id=ce7268982b3046a08a5a58a49d928fc6)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:09.986064 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67be1e9-508c-4ff9-938a-7df6452529b1 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:09.991787 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:09.998721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 286/574] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 13:01:09 2022] PUT /identity/v3/projects/f230a12ca6234faabf984e4a58a0d2e8/users/f3254b4fddaa4f099c6c44f4c139ee5e/roles/ce7268982b3046a08a5a58a49d928fc6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:01:09.999730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67be1e9-508c-4ff9-938a-7df6452529b1 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:10.001635 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac41e3d-4b29-4e47-9de8-1b5a33642aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:10.002295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac41e3d-4b29-4e47-9de8-1b5a33642aad None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:10.002646 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac41e3d-4b29-4e47-9de8-1b5a33642aad None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:10.003025 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac41e3d-4b29-4e47-9de8-1b5a33642aad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:10.015519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac41e3d-4b29-4e47-9de8-1b5a33642aad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:10.017418 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac41e3d-4b29-4e47-9de8-1b5a33642aad None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:10.026819 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:10.034754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-3ac41e3d-4b29-4e47-9de8-1b5a33642aad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:10.034754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:10.034754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:10.034754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:10.034754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:10.034754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:10.034754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:10.034754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:10.034754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:10.034754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:10.034754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:10.034754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:10.034754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:01:10.034754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:01:10.034754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:01:10.035905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:01:10.035905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:10.035905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:10.035905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:10.035905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:10.035905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:10.035905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:10.035905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:10.035905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:10.035905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:10.035905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:10.035905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:10.035905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:10.035905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:10.035905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:10.035905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:10.035905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:10.036846 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:01:10.036846 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:01:10.036846 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:01:10.036846 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:01:10.036846 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:01:10.036846 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:01:10.036846 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:10.036846 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:10.039624 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 289/575] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:01:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:10.041513 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9ab89-ef64-49e0-a3fc-54f006f4da71 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:10.042046 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9ab89-ef64-49e0-a3fc-54f006f4da71 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:10.042467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9ab89-ef64-49e0-a3fc-54f006f4da71 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:10.048312 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 290/576] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:10.049482 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9ab89-ef64-49e0-a3fc-54f006f4da71 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:10.136600 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67be1e9-508c-4ff9-938a-7df6452529b1 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:10.176454 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68647b3-3efb-44ca-81f0-82403d697717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:10.177422 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68647b3-3efb-44ca-81f0-82403d697717 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:10.178177 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68647b3-3efb-44ca-81f0-82403d697717 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:10.178634 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68647b3-3efb-44ca-81f0-82403d697717 None admin] PATH_INFO: `/v3/services/network` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:10.179675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68647b3-3efb-44ca-81f0-82403d697717 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:10.179876 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9ab89-ef64-49e0-a3fc-54f006f4da71 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:10.181708 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68647b3-3efb-44ca-81f0-82403d697717 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:10.192054 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-c68647b3-3efb-44ca-81f0-82403d697717 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:01:10.192054 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:10.192054 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:01:10.192054 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:01:10.192054 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:01:10.192054 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:01:10.192054 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:01:10.192054 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:10.192054 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:01:10.192054 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:10.192054 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:10.192054 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:10.192054 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:10.192054 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:10.192054 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:10.192054 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:10.192054 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:10.193116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:10.193116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:10.193116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:10.193116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:10.193116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:10.193116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:10.193116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:01:10.193116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:01:10.193116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:01:10.193116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:01:10.193116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:10.193116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:10.193116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:10.193116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:10.193116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:10.193116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:10.193979 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:10.193979 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:10.193979 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:10.193979 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:10.193979 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:10.193979 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:10.193979 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:10.193979 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:10.193979 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:10.193979 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:10.193979 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:01:10.193979 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:10.193979 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:01:10.193979 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:10.202787 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 287/577] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:01:09 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:10.204554 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d80ace-c1e8-4906-8f45-72894bd61cd9 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:10.205058 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d80ace-c1e8-4906-8f45-72894bd61cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:10.205509 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d80ace-c1e8-4906-8f45-72894bd61cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:10.221559 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b11a1-8251-4636-8186-bdf974400975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:10.222188 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b11a1-8251-4636-8186-bdf974400975 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:10.222467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b11a1-8251-4636-8186-bdf974400975 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:10.222743 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b11a1-8251-4636-8186-bdf974400975 None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:10.223446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b11a1-8251-4636-8186-bdf974400975 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:10.223773 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b11a1-8251-4636-8186-bdf974400975 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:10.225219 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b11a1-8251-4636-8186-bdf974400975 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:10.225858 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-d1d80ace-c1e8-4906-8f45-72894bd61cd9 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:10.227136 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d1d80ace-c1e8-4906-8f45-72894bd61cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:10.238919 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 291/578] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 24 13:01:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:10.239555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b11a1-8251-4636-8186-bdf974400975 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:10.294534 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:10.308978 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 288/579] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:10.310539 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d80ace-c1e8-4906-8f45-72894bd61cd9 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:10.324927 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:10.351777 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b11a1-8251-4636-8186-bdf974400975 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:10.388827 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede7187-c8f3-441f-8928-f7fd295a4108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:10.389354 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede7187-c8f3-441f-8928-f7fd295a4108 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:10.389634 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede7187-c8f3-441f-8928-f7fd295a4108 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:10.389909 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede7187-c8f3-441f-8928-f7fd295a4108 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:10.390641 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede7187-c8f3-441f-8928-f7fd295a4108 None admin] RBAC: Adding query filter params (name=network) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:10.390948 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede7187-c8f3-441f-8928-f7fd295a4108 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:10.392437 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede7187-c8f3-441f-8928-f7fd295a4108 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:10.397473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 292/580] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 24 13:01:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:10.406476 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede7187-c8f3-441f-8928-f7fd295a4108 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:10.424333 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d80ace-c1e8-4906-8f45-72894bd61cd9 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:10.462134 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3cd6a-c0ca-41b3-9999-632c54985546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:10.463692 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3cd6a-c0ca-41b3-9999-632c54985546 None admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:10.464189 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3cd6a-c0ca-41b3-9999-632c54985546 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:10.464683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3cd6a-c0ca-41b3-9999-632c54985546 None admin] PATH_INFO: `/v3/projects/f230a12ca6234faabf984e4a58a0d2e8/users/768c71ab4ab241e4bfed9f7561ae3d2d/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:10.470610 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3cd6a-c0ca-41b3-9999-632c54985546 None admin] RBAC: Authorizing `identity:create_grant(project_id=f230a12ca6234faabf984e4a58a0d2e8, user_id=768c71ab4ab241e4bfed9f7561ae3d2d, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:10.472353 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3cd6a-c0ca-41b3-9999-632c54985546 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:10.500594 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 289/581] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 13:01:10 2022] PUT /identity/v3/projects/f230a12ca6234faabf984e4a58a0d2e8/users/768c71ab4ab241e4bfed9f7561ae3d2d/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:01:10.586690 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede7187-c8f3-441f-8928-f7fd295a4108 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:10.607201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:10.637606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785d250-0a11-464c-868e-374d67bed15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:10.638589 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785d250-0a11-464c-868e-374d67bed15d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:10.639165 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785d250-0a11-464c-868e-374d67bed15d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:10.639659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785d250-0a11-464c-868e-374d67bed15d None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:10.640598 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785d250-0a11-464c-868e-374d67bed15d None admin] RBAC: Adding query filter params (type=network) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:10.641098 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785d250-0a11-464c-868e-374d67bed15d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:10.642722 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785d250-0a11-464c-868e-374d67bed15d None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:10.657249 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 293/582] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 24 13:01:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:10.663280 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3cd6a-c0ca-41b3-9999-632c54985546 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:10.716100 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785d250-0a11-464c-868e-374d67bed15d None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:10.753449 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:10.783875 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3cd6a-c0ca-41b3-9999-632c54985546 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:10.819762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785d250-0a11-464c-868e-374d67bed15d None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:10.822234 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bf4f3-9c2b-4ea8-91fb-8757021ed02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:10.822947 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bf4f3-9c2b-4ea8-91fb-8757021ed02b None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:10.823224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bf4f3-9c2b-4ea8-91fb-8757021ed02b None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:10.823519 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bf4f3-9c2b-4ea8-91fb-8757021ed02b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:10.824469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678bf4f3-9c2b-4ea8-91fb-8757021ed02b None admin] RBAC: Adding query filter params (interface=public, service_id=ed7c159335c7421cb6b72e64952cd380, region_id=RegionOne) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:10.824768 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678bf4f3-9c2b-4ea8-91fb-8757021ed02b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:10.826199 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678bf4f3-9c2b-4ea8-91fb-8757021ed02b None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:10.834550 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 290/583] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Oct 24 13:01:10 2022] GET /identity/v3/endpoints?service_id=ed7c159335c7421cb6b72e64952cd380&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:10.840731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bf4f3-9c2b-4ea8-91fb-8757021ed02b None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:10.856580 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938a086-74c8-4db7-8afc-965a1b749964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:10.857210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938a086-74c8-4db7-8afc-965a1b749964 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:10.857493 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938a086-74c8-4db7-8afc-965a1b749964 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:10.857769 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938a086-74c8-4db7-8afc-965a1b749964 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:10.858349 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938a086-74c8-4db7-8afc-965a1b749964 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:10.859756 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938a086-74c8-4db7-8afc-965a1b749964 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:10.869079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-5938a086-74c8-4db7-8afc-965a1b749964 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:01:10.869079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:10.869079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:01:10.869079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:01:10.869079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:01:10.869079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:01:10.869079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:01:10.869079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:10.869079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:01:10.869079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:10.869079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:10.869079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:10.869079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:10.869079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:10.869079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:10.869079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:10.869079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:10.870332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:10.870332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:10.870332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:10.870332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:10.870332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:10.870332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:10.870332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:01:10.870332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:01:10.870332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:01:10.870332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:01:10.870332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:10.870332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:10.870332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:10.870332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:10.870332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:10.870332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:10.871395 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:10.871395 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:10.871395 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:10.871395 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:10.871395 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:10.871395 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:10.871395 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:10.871395 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:10.871395 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:10.871395 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:10.871395 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:01:10.871395 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:10.871395 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:01:10.871395 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:10.871395 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 294/584] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Oct 24 13:01:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:01:10.876111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938a086-74c8-4db7-8afc-965a1b749964 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:10.919676 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:10.980504 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938a086-74c8-4db7-8afc-965a1b749964 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:11.017055 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e64c1-bef8-45d9-bc95-4b2c31a7bce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:11.017987 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e64c1-bef8-45d9-bc95-4b2c31a7bce8 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:11.018375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e64c1-bef8-45d9-bc95-4b2c31a7bce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:11.018745 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e64c1-bef8-45d9-bc95-4b2c31a7bce8 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:11.019538 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e64c1-bef8-45d9-bc95-4b2c31a7bce8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:11.019979 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e64c1-bef8-45d9-bc95-4b2c31a7bce8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:11.021503 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e64c1-bef8-45d9-bc95-4b2c31a7bce8 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:11.027656 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 295/585] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Oct 24 13:01:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:11.033393 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e64c1-bef8-45d9-bc95-4b2c31a7bce8 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:11.045586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bf4f3-9c2b-4ea8-91fb-8757021ed02b None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:11.122343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c43375-3114-4d39-a1fa-be6954d4ad46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:11.123001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c43375-3114-4d39-a1fa-be6954d4ad46 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:11.123285 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c43375-3114-4d39-a1fa-be6954d4ad46 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:11.123583 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c43375-3114-4d39-a1fa-be6954d4ad46 None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:11.124195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c43375-3114-4d39-a1fa-be6954d4ad46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:11.125641 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c43375-3114-4d39-a1fa-be6954d4ad46 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:11.128387 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:11.139080 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 291/586] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Oct 24 13:01:10 2022] GET /identity/v3/services => generated 772 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:11.189811 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e64c1-bef8-45d9-bc95-4b2c31a7bce8 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:11.192339 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:11.227498 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9b2a8-7055-4fcf-803f-692b08aab09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:11.228134 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9b2a8-7055-4fcf-803f-692b08aab09f None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:11.228417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9b2a8-7055-4fcf-803f-692b08aab09f None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:11.228693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9b2a8-7055-4fcf-803f-692b08aab09f None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:11.229341 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9b2a8-7055-4fcf-803f-692b08aab09f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:11.229709 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9b2a8-7055-4fcf-803f-692b08aab09f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:11.231157 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9b2a8-7055-4fcf-803f-692b08aab09f None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:11.236965 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 296/587] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Oct 24 13:01:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:11.243671 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c43375-3114-4d39-a1fa-be6954d4ad46 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:11.379893 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c43375-3114-4d39-a1fa-be6954d4ad46 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:11.421503 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674b29a-8daa-4775-bc69-8832a8f819ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:11.422117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674b29a-8daa-4775-bc69-8832a8f819ec None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:11.422651 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674b29a-8daa-4775-bc69-8832a8f819ec None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:11.422918 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674b29a-8daa-4775-bc69-8832a8f819ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:11.423660 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674b29a-8daa-4775-bc69-8832a8f819ec None admin] RBAC: Adding query filter params (interface=public, service_id=0d5e017bb462498582e4d774d62819f4, region_id=RegionOne) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:11.423964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674b29a-8daa-4775-bc69-8832a8f819ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:11.425334 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674b29a-8daa-4775-bc69-8832a8f819ec None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:11.431735 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 292/588] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Oct 24 13:01:11 2022] GET /identity/v3/endpoints?service_id=0d5e017bb462498582e4d774d62819f4&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:11.437145 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9b2a8-7055-4fcf-803f-692b08aab09f None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:11.556498 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9b2a8-7055-4fcf-803f-692b08aab09f None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:11.602348 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b035d3-1d51-4dd6-bacd-d058190a0993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:11.602965 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b035d3-1d51-4dd6-bacd-d058190a0993 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:11.603242 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b035d3-1d51-4dd6-bacd-d058190a0993 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:11.603587 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b035d3-1d51-4dd6-bacd-d058190a0993 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:11.604197 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b035d3-1d51-4dd6-bacd-d058190a0993 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:11.605581 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b035d3-1d51-4dd6-bacd-d058190a0993 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:11.611261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 297/589] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Oct 24 13:01:11 2022] GET /identity/v3/services => generated 772 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:11.803029 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94db7a-fa9c-40c6-9d15-4f2a5b4fc744 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:11.804051 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94db7a-fa9c-40c6-9d15-4f2a5b4fc744 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:11.805153 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94db7a-fa9c-40c6-9d15-4f2a5b4fc744 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:11.807258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 293/590] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:11.813314 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519e932-58d3-4449-a0f9-0919e6632432 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:11.813599 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519e932-58d3-4449-a0f9-0919e6632432 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:11.813872 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519e932-58d3-4449-a0f9-0919e6632432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:11.838565 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-7519e932-58d3-4449-a0f9-0919e6632432 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:11.839826 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7519e932-58d3-4449-a0f9-0919e6632432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:11.872560 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:11.918685 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 298/591] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:12.204138 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94db7a-fa9c-40c6-9d15-4f2a5b4fc744 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:12.294370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:12.346683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94db7a-fa9c-40c6-9d15-4f2a5b4fc744 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:12.383602 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865a811-ef0f-4cbc-a411-e0297ceca660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:12.384618 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865a811-ef0f-4cbc-a411-e0297ceca660 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:12.385104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865a811-ef0f-4cbc-a411-e0297ceca660 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:12.385412 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865a811-ef0f-4cbc-a411-e0297ceca660 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:12.385999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865a811-ef0f-4cbc-a411-e0297ceca660 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:12.387412 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865a811-ef0f-4cbc-a411-e0297ceca660 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:12.396904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-7865a811-ef0f-4cbc-a411-e0297ceca660 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:01:12.396904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:12.396904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:01:12.396904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:01:12.396904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:01:12.396904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:01:12.396904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:01:12.396904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:12.396904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:01:12.396904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:12.396904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:12.396904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:12.396904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:12.396904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:12.396904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:12.396904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:12.399039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:12.399039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:12.399039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:12.399039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:12.399039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:12.399039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:12.399039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:12.399039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:01:12.399039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:01:12.399039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:01:12.399039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:01:12.399039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:12.399039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:12.399039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:12.399039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:12.399039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:12.399039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:12.400336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:12.400336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:12.400336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:12.400336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:12.400336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:12.400336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:12.400336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:12.400336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:12.400336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:12.400336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:12.400336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:01:12.400336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:12.400336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:01:12.400336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:12.400336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 294/592] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Oct 24 13:01:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:12.408805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519e932-58d3-4449-a0f9-0919e6632432 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:12.560830 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519e932-58d3-4449-a0f9-0919e6632432 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:12.601244 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2700d-1989-4ca0-89a2-17ca5cd839a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:12.602140 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2700d-1989-4ca0-89a2-17ca5cd839a1 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:12.602678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2700d-1989-4ca0-89a2-17ca5cd839a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:12.603140 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2700d-1989-4ca0-89a2-17ca5cd839a1 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:12.603964 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2700d-1989-4ca0-89a2-17ca5cd839a1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:12.604271 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2700d-1989-4ca0-89a2-17ca5cd839a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:12.606480 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2700d-1989-4ca0-89a2-17ca5cd839a1 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:12.614236 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 299/593] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Oct 24 13:01:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:12.622122 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865a811-ef0f-4cbc-a411-e0297ceca660 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:12.747845 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865a811-ef0f-4cbc-a411-e0297ceca660 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:12.785745 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:12.801551 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd646407-11b3-4f9b-b00b-ef7130ef9128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:12.802094 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd646407-11b3-4f9b-b00b-ef7130ef9128 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:12.802376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd646407-11b3-4f9b-b00b-ef7130ef9128 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:12.802651 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd646407-11b3-4f9b-b00b-ef7130ef9128 None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:12.803293 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd646407-11b3-4f9b-b00b-ef7130ef9128 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:12.803862 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd646407-11b3-4f9b-b00b-ef7130ef9128 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:12.805627 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd646407-11b3-4f9b-b00b-ef7130ef9128 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:12.811373 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 295/594] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Oct 24 13:01:12 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:12.965090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b3f05-9aaa-4978-bdca-c9d44cc4a34e None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:12.965432 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b3f05-9aaa-4978-bdca-c9d44cc4a34e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:12.965640 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b3f05-9aaa-4978-bdca-c9d44cc4a34e None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:12.967944 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 300/595] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:12.973856 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde69ba5-3999-4895-887b-6b4c6961c80a None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:12.974175 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde69ba5-3999-4895-887b-6b4c6961c80a None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:12.974411 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde69ba5-3999-4895-887b-6b4c6961c80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:13.006888 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-fde69ba5-3999-4895-887b-6b4c6961c80a None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:13.008251 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-fde69ba5-3999-4895-887b-6b4c6961c80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:13.106653 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 296/596] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:13.426741 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b3f05-9aaa-4978-bdca-c9d44cc4a34e None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:13.456408 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:13.486702 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60b736-22b3-4f49-834f-40fa4ca03423 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:13.487041 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60b736-22b3-4f49-834f-40fa4ca03423 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:13.487250 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60b736-22b3-4f49-834f-40fa4ca03423 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:13.488882 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 297/597] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:13.494741 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9600b7-c59a-4bce-8df9-65c8301d1121 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:13.495031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9600b7-c59a-4bce-8df9-65c8301d1121 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:13.495296 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9600b7-c59a-4bce-8df9-65c8301d1121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:13.516288 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-ea9600b7-c59a-4bce-8df9-65c8301d1121 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:13.517542 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-ea9600b7-c59a-4bce-8df9-65c8301d1121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:13.593732 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b3f05-9aaa-4978-bdca-c9d44cc4a34e None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:13.638933 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 298/598] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:13.650220 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f47723-d07f-4e95-a438-d3949cc6b2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:13.650856 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f47723-d07f-4e95-a438-d3949cc6b2da None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:13.651135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f47723-d07f-4e95-a438-d3949cc6b2da None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:13.651405 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f47723-d07f-4e95-a438-d3949cc6b2da None admin] PATH_INFO: `/v3/roles/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:13.662004 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f47723-d07f-4e95-a438-d3949cc6b2da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:01:13.668130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-a9f47723-d07f-4e95-a438-d3949cc6b2da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:01:13.668130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:13.668130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:13.668130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:13.668130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:13.668130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:13.668130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:13.668130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:13.668130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:13.668130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:13.668130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:13.668130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:13.668130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:01:13.668130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:01:13.668130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:01:13.668130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:01:13.669105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:01:13.669105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:01:13.669105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:01:13.669105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:01:13.669105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:13.669105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:13.669105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:13.669105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:13.669105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:13.669105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:13.669105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:13.669105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:13.669105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:13.669105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:13.669105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:13.669105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:13.670379 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:13.670379 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:13.670379 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:13.670379 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:13.670379 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:01:13.670379 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:01:13.670379 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:01:13.670379 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:01:13.670379 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:01:13.670379 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:01:13.670379 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:01:13.670379 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:13.670379 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 301/599] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 24 13:01:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:13.675486 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9600b7-c59a-4bce-8df9-65c8301d1121 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:13.739488 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:13.817292 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9600b7-c59a-4bce-8df9-65c8301d1121 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:13.855895 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c77a3-8f58-41a9-bfe7-1e3c53350f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:13.856498 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c77a3-8f58-41a9-bfe7-1e3c53350f2e None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:13.856772 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c77a3-8f58-41a9-bfe7-1e3c53350f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:13.857041 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c77a3-8f58-41a9-bfe7-1e3c53350f2e None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:13.857697 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c77a3-8f58-41a9-bfe7-1e3c53350f2e None admin] RBAC: Adding query filter params (name=service) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:13.857995 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c77a3-8f58-41a9-bfe7-1e3c53350f2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:13.859361 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c77a3-8f58-41a9-bfe7-1e3c53350f2e None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:13.868213 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 299/600] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 24 13:01:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:13.873587 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f47723-d07f-4e95-a438-d3949cc6b2da None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:13.998920 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c77a3-8f58-41a9-bfe7-1e3c53350f2e None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:14.000676 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:14.017459 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f47723-d07f-4e95-a438-d3949cc6b2da None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:14.053617 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5621c-8d0f-46f5-9dba-1b721efd52b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:14.054866 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5621c-8d0f-46f5-9dba-1b721efd52b2 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:14.055085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5621c-8d0f-46f5-9dba-1b721efd52b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:14.055352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5621c-8d0f-46f5-9dba-1b721efd52b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:14.065750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5621c-8d0f-46f5-9dba-1b721efd52b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:14.067210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5621c-8d0f-46f5-9dba-1b721efd52b2 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:14.083154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-ddf5621c-8d0f-46f5-9dba-1b721efd52b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:14.083154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:14.083154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:14.083154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:14.083154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:14.083154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:14.083154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:14.083154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:14.083154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:14.083154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:14.083154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:14.083154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:14.083154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:14.083154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:14.083154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:14.083154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:14.084358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:14.084358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:14.084358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:14.084358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:14.084358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:14.084358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:14.084358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:14.084358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:14.084358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:14.084358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:14.084358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:14.084358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:14.084358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:14.084358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:14.084358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:14.084358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:14.084358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:14.085774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:14.085774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:14.085774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:14.085774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 302/601] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:14.086156 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285f65c-32d3-4fae-8a8a-66638e3b39f4 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:14.086433 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285f65c-32d3-4fae-8a8a-66638e3b39f4 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:14.086664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285f65c-32d3-4fae-8a8a-66638e3b39f4 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:14.087918 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 303/602] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:14.092733 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285f65c-32d3-4fae-8a8a-66638e3b39f4 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:14.143820 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c77a3-8f58-41a9-bfe7-1e3c53350f2e None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:14.158664 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:14.188738 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b48ce3-abbf-49e8-b4b0-0451e272aca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:14.189763 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b48ce3-abbf-49e8-b4b0-0451e272aca4 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:14.190047 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b48ce3-abbf-49e8-b4b0-0451e272aca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:14.190926 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b48ce3-abbf-49e8-b4b0-0451e272aca4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:14.208374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b48ce3-abbf-49e8-b4b0-0451e272aca4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:01:14.212911 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285f65c-32d3-4fae-8a8a-66638e3b39f4 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:14.215267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-79b48ce3-abbf-49e8-b4b0-0451e272aca4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:01:14.215267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:14.215267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:14.215267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:14.215267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:14.215267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:14.215267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:14.215267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:14.215267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:14.215267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:14.215267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:14.215267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:14.215267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:01:14.215267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:01:14.215267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:01:14.215267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:01:14.216318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:01:14.216318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:01:14.216318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:01:14.216318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:01:14.216318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:14.216318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:14.216318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:14.216318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:14.216318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:14.216318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:14.216318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:14.216318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:14.216318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:14.216318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:14.216318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:14.216318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:14.217164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:14.217164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:14.217164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:14.217164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:14.217164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:01:14.217164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:01:14.217164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:01:14.217164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:01:14.217164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:01:14.217164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:01:14.217164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:01:14.217164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:14.223036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 300/603] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 24 13:01:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:01:14.224671 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c3db5-9f19-4280-b233-6ec101e4f154 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:14.225392 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c3db5-9f19-4280-b233-6ec101e4f154 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:14.225691 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c3db5-9f19-4280-b233-6ec101e4f154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:14.251323 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-a48c3db5-9f19-4280-b233-6ec101e4f154 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:14.252664 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-a48c3db5-9f19-4280-b233-6ec101e4f154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:14.256405 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e5227-f70a-4e0c-bc2f-22632d43ca4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:14.257023 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e5227-f70a-4e0c-bc2f-22632d43ca4d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:14.257387 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e5227-f70a-4e0c-bc2f-22632d43ca4d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:14.258288 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e5227-f70a-4e0c-bc2f-22632d43ca4d None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:14.258896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e5227-f70a-4e0c-bc2f-22632d43ca4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:14.259212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e5227-f70a-4e0c-bc2f-22632d43ca4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:14.260728 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e5227-f70a-4e0c-bc2f-22632d43ca4d None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:14.270618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:14.278668 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 304/604] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:14.279543 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e5227-f70a-4e0c-bc2f-22632d43ca4d None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:14.335716 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 301/605] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:14.336919 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c3db5-9f19-4280-b233-6ec101e4f154 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:14.400340 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e5227-f70a-4e0c-bc2f-22632d43ca4d None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:14.440668 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920e923-ccc4-4051-8f4e-5f9e9f0dd1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:14.441278 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920e923-ccc4-4051-8f4e-5f9e9f0dd1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:14.441947 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920e923-ccc4-4051-8f4e-5f9e9f0dd1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:14.442231 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920e923-ccc4-4051-8f4e-5f9e9f0dd1a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:14.442896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920e923-ccc4-4051-8f4e-5f9e9f0dd1a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:14.443195 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920e923-ccc4-4051-8f4e-5f9e9f0dd1a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:14.445176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920e923-ccc4-4051-8f4e-5f9e9f0dd1a0 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:14.455248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 305/606] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:01:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:14.461500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920e923-ccc4-4051-8f4e-5f9e9f0dd1a0 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:14.540449 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:14.572457 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920e923-ccc4-4051-8f4e-5f9e9f0dd1a0 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:14.608031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c3db5-9f19-4280-b233-6ec101e4f154 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:14.608916 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15530654-a65d-4595-bccb-a6751d72e539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:14.609555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15530654-a65d-4595-bccb-a6751d72e539 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:14.609994 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15530654-a65d-4595-bccb-a6751d72e539 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:14.610283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15530654-a65d-4595-bccb-a6751d72e539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:14.611722 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:14.634245 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15530654-a65d-4595-bccb-a6751d72e539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:14.637025 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15530654-a65d-4595-bccb-a6751d72e539 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:14.667009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-15530654-a65d-4595-bccb-a6751d72e539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:14.667009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:14.667009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:14.667009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:14.667009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:14.667009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:14.667009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:14.667009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:14.667009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:14.667009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:14.667009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:14.667009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:14.667009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:14.667009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:14.667009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:14.667009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:14.668090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:14.668090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:14.668090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:14.668090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:14.668090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:14.668090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:14.668090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:14.668090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:14.668090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:14.668090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:14.668090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:14.668090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:14.668090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:14.668090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:14.668090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:14.668090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:14.668090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:14.669013 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:14.669013 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:14.669013 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:14.675830 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 306/607] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:01:14.680525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15530654-a65d-4595-bccb-a6751d72e539 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:14.684429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba70115-d820-43f0-9661-007d573c5316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:14.685096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba70115-d820-43f0-9661-007d573c5316 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:14.685374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba70115-d820-43f0-9661-007d573c5316 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:14.685644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba70115-d820-43f0-9661-007d573c5316 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:14.696229 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba70115-d820-43f0-9661-007d573c5316 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:14.697822 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba70115-d820-43f0-9661-007d573c5316 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:14.712791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-2ba70115-d820-43f0-9661-007d573c5316 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 13:01:14.712791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:14.712791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:14.712791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:14.712791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:14.712791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:14.712791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:14.712791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:14.712791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:14.712791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:14.712791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:14.712791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:14.712791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:01:14.712791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:01:14.712791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:01:14.712791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:01:14.714057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:14.714057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:14.714057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:01:14.714057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:14.714057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:01:14.714057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:14.714057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:14.714057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:14.714057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:14.714057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:14.714057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:14.714057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:14.714057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:14.714057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:14.714057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:14.714057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:14.714057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:14.714057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:14.715149 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:14.715149 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:14.715149 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:01:14.715149 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:01:14.715149 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:01:14.715149 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:01:14.715149 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:01:14.715149 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:01:14.715149 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 13:01:14.715149 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:14.715149 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 302/608] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Oct 24 13:01:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:14.720391 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba70115-d820-43f0-9661-007d573c5316 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:14.813542 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15530654-a65d-4595-bccb-a6751d72e539 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:14.828330 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:14.844163 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba70115-d820-43f0-9661-007d573c5316 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:14.850491 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8737b-9472-4199-a27f-d5544637d734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:14.851668 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8737b-9472-4199-a27f-d5544637d734 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:14.851950 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8737b-9472-4199-a27f-d5544637d734 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:14.852224 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8737b-9472-4199-a27f-d5544637d734 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:14.852862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8737b-9472-4199-a27f-d5544637d734 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:14.853162 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8737b-9472-4199-a27f-d5544637d734 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:14.854562 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8737b-9472-4199-a27f-d5544637d734 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:14.867106 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 307/609] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:14.872253 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8737b-9472-4199-a27f-d5544637d734 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:14.880903 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63123f3-c8df-45d6-a9d3-754ede99cdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:14.881506 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63123f3-c8df-45d6-a9d3-754ede99cdae None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:14.881785 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63123f3-c8df-45d6-a9d3-754ede99cdae None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:14.882114 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63123f3-c8df-45d6-a9d3-754ede99cdae None admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:14.883003 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63123f3-c8df-45d6-a9d3-754ede99cdae None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:14.883321 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63123f3-c8df-45d6-a9d3-754ede99cdae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:14.884807 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63123f3-c8df-45d6-a9d3-754ede99cdae None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:14.903847 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 303/610] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Oct 24 13:01:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:14.904914 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b84b6-8e73-4e8e-9edb-9de9cc62fbf7 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:14.905201 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b84b6-8e73-4e8e-9edb-9de9cc62fbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:14.905473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b84b6-8e73-4e8e-9edb-9de9cc62fbf7 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:14.910717 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 304/611] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:14.910717 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b84b6-8e73-4e8e-9edb-9de9cc62fbf7 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:14.931206 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:14.989735 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8737b-9472-4199-a27f-d5544637d734 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:15.016268 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b84b6-8e73-4e8e-9edb-9de9cc62fbf7 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:15.027189 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a565a6-60a4-4cb4-ae18-f42a3d63d3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:15.027842 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a565a6-60a4-4cb4-ae18-f42a3d63d3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:15.028119 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a565a6-60a4-4cb4-ae18-f42a3d63d3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:15.028570 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a565a6-60a4-4cb4-ae18-f42a3d63d3c2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:15.029149 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a565a6-60a4-4cb4-ae18-f42a3d63d3c2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:15.030526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a565a6-60a4-4cb4-ae18-f42a3d63d3c2 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:15.040273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-73a565a6-60a4-4cb4-ae18-f42a3d63d3c2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:01:15.040273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:15.040273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:01:15.040273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:01:15.040273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:01:15.040273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:01:15.040273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:01:15.040273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:15.040273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:01:15.040273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:15.040273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:15.040273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:15.040273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:15.040273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:15.040273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:15.040273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:15.040273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:15.041276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:15.041276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:15.041276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:15.041276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:15.041276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:15.041276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:15.041276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:01:15.041276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:01:15.041276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:01:15.041276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:01:15.041276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:15.041276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:15.041276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:15.041276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:15.041276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:15.041276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:15.042126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:15.042126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:15.042126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:15.042126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:15.042126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:15.042126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:15.042126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:15.042126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:15.042126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:15.042126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:15.042126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:01:15.042126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:15.042126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:01:15.042126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:15.042126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 308/612] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:01:14 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:15.042953 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a565a6-60a4-4cb4-ae18-f42a3d63d3c2 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:15.060577 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb857e-79ca-41aa-a937-d5e992959503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:15.061204 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb857e-79ca-41aa-a937-d5e992959503 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:15.061473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb857e-79ca-41aa-a937-d5e992959503 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:15.061734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb857e-79ca-41aa-a937-d5e992959503 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:15.069188 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb857e-79ca-41aa-a937-d5e992959503 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:15.070694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb857e-79ca-41aa-a937-d5e992959503 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:15.079521 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:15.082624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-b2eb857e-79ca-41aa-a937-d5e992959503 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 24 13:01:15.082624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:15.082624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:15.082624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:15.082624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:15.082624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:15.082624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:15.082624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:15.082624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:15.082624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:15.082624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:15.082624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:15.082624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:01:15.082624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:01:15.082624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:01:15.082624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:01:15.083607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:15.083607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:15.083607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:01:15.083607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:15.083607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:01:15.083607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:15.083607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:15.083607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:15.083607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:15.083607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:15.083607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:15.083607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:15.083607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:15.083607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:15.083607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:15.083607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:15.083607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:15.083607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:15.084538 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:15.084538 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:15.084538 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:01:15.084538 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:01:15.084538 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:01:15.084538 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:01:15.084538 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:01:15.084538 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:01:15.084538 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 24 13:01:15.084538 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:15.084538 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 305/613] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 24 13:01:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:15.086317 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de5cfc-3ae4-4649-9c91-c549db337a51 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:15.086317 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de5cfc-3ae4-4649-9c91-c549db337a51 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:15.086583 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de5cfc-3ae4-4649-9c91-c549db337a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:15.105933 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-96de5cfc-3ae4-4649-9c91-c549db337a51 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:15.107108 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-96de5cfc-3ae4-4649-9c91-c549db337a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:15.154134 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a565a6-60a4-4cb4-ae18-f42a3d63d3c2 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:15.187449 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 306/614] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:15.187449 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de5cfc-3ae4-4649-9c91-c549db337a51 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:15.198857 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:15.201002 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e98b04-e67a-4abd-81d7-db5497d50ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:15.201721 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e98b04-e67a-4abd-81d7-db5497d50ddd None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:15.202040 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e98b04-e67a-4abd-81d7-db5497d50ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:15.202350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e98b04-e67a-4abd-81d7-db5497d50ddd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:15.288683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e98b04-e67a-4abd-81d7-db5497d50ddd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:15.290961 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e98b04-e67a-4abd-81d7-db5497d50ddd None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:15.299194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de5cfc-3ae4-4649-9c91-c549db337a51 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:15.335159 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0003e-563e-4379-a3aa-a2c03890264e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:15.336412 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:15.337130 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0003e-563e-4379-a3aa-a2c03890264e None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:15.337516 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0003e-563e-4379-a3aa-a2c03890264e None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:15.337893 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0003e-563e-4379-a3aa-a2c03890264e None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:15.338717 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0003e-563e-4379-a3aa-a2c03890264e None admin] RBAC: Adding query filter params (name=network) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:15.339110 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0003e-563e-4379-a3aa-a2c03890264e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:15.340706 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0003e-563e-4379-a3aa-a2c03890264e None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:15.350877 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 307/615] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 24 13:01:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:15.352161 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0003e-563e-4379-a3aa-a2c03890264e None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:15.418017 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 309/616] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:01:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:01:15.418890 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e98b04-e67a-4abd-81d7-db5497d50ddd None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:15.443529 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:15.472110 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0003e-563e-4379-a3aa-a2c03890264e None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:15.508379 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d1649-2f8d-4053-b216-0b25550e36a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:15.508983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d1649-2f8d-4053-b216-0b25550e36a4 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:15.509257 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d1649-2f8d-4053-b216-0b25550e36a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:15.509560 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d1649-2f8d-4053-b216-0b25550e36a4 None admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:15.510237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d1649-2f8d-4053-b216-0b25550e36a4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:15.510534 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d1649-2f8d-4053-b216-0b25550e36a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:15.512020 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d1649-2f8d-4053-b216-0b25550e36a4 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:15.528531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e98b04-e67a-4abd-81d7-db5497d50ddd None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:15.532205 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 308/617] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Oct 24 13:01:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:15.532205 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d1649-2f8d-4053-b216-0b25550e36a4 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:15.564574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a2eff-7cd9-4755-b548-020ece0d64d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:15.565180 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a2eff-7cd9-4755-b548-020ece0d64d2 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:15.565460 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a2eff-7cd9-4755-b548-020ece0d64d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:15.565735 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a2eff-7cd9-4755-b548-020ece0d64d2 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:15.566360 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a2eff-7cd9-4755-b548-020ece0d64d2 None admin] RBAC: Adding query filter params (type=network) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:15.566666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a2eff-7cd9-4755-b548-020ece0d64d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:15.568062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a2eff-7cd9-4755-b548-020ece0d64d2 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:15.570420 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:15.573836 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 310/618] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 24 13:01:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:15.574964 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a2eff-7cd9-4755-b548-020ece0d64d2 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:15.639209 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d1649-2f8d-4053-b216-0b25550e36a4 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:15.668673 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:15.674099 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669ae5b-7960-4c09-9d40-8e5cad215016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:15.674498 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a2eff-7cd9-4755-b548-020ece0d64d2 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:15.674937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669ae5b-7960-4c09-9d40-8e5cad215016 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:15.675027 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669ae5b-7960-4c09-9d40-8e5cad215016 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:15.675253 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669ae5b-7960-4c09-9d40-8e5cad215016 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:15.685446 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669ae5b-7960-4c09-9d40-8e5cad215016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:15.686909 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669ae5b-7960-4c09-9d40-8e5cad215016 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:15.701723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-4669ae5b-7960-4c09-9d40-8e5cad215016 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:15.701723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:15.701723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:15.701723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:15.701723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:15.701723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:15.701723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:15.701723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:15.701723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:15.701723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:15.701723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:15.701723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:15.701723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:15.701723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:15.701723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:15.701723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:15.702873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:15.702873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:15.702873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:15.702873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:15.702873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:15.702873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:15.702873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:15.702873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:15.702873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:15.702873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:15.702873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:15.702873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:15.702873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:15.702873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:15.702873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:15.702873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:15.702873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:15.703814 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:15.703814 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:15.703814 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:15.703814 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 309/619] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:15.703814 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669ae5b-7960-4c09-9d40-8e5cad215016 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:15.712519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd6976-4183-4e25-8ffc-5ed96582c7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:15.713145 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd6976-4183-4e25-8ffc-5ed96582c7dd None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:15.713423 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd6976-4183-4e25-8ffc-5ed96582c7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:15.713698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd6976-4183-4e25-8ffc-5ed96582c7dd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:15.714271 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd6976-4183-4e25-8ffc-5ed96582c7dd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:15.715686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd6976-4183-4e25-8ffc-5ed96582c7dd None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:15.724525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-eecd6976-4183-4e25-8ffc-5ed96582c7dd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:01:15.724525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:15.724525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:01:15.724525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:01:15.724525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:01:15.724525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:01:15.724525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:01:15.724525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:15.724525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:01:15.724525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:15.724525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:15.724525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:15.724525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:15.724525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:15.724525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:15.724525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:15.724525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:15.725593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:15.725593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:15.725593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:15.725593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:15.725593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:15.725593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:15.725593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:01:15.725593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:01:15.725593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:01:15.725593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:01:15.725593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:15.725593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:15.725593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:15.725593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:15.725593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:15.725593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:15.728014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:15.728014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:15.728014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:15.728014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:15.728014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:15.728014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:15.728014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:15.728014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:15.728014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:15.728014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:15.728014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:01:15.728014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:15.728014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:01:15.728014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:15.728014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 311/620] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Oct 24 13:01:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:15.728820 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077791a-e0cd-4fd1-9cc1-54151fc8e06c None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:15.728820 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077791a-e0cd-4fd1-9cc1-54151fc8e06c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:15.728820 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077791a-e0cd-4fd1-9cc1-54151fc8e06c None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:15.729380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 312/621] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:15.729781 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077791a-e0cd-4fd1-9cc1-54151fc8e06c None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:15.791372 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:15.804330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669ae5b-7960-4c09-9d40-8e5cad215016 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:15.829646 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077791a-e0cd-4fd1-9cc1-54151fc8e06c None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:15.838013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3010df-1348-4bf0-884f-8d2ed1cf202b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:15.838611 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3010df-1348-4bf0-884f-8d2ed1cf202b None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:15.838888 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3010df-1348-4bf0-884f-8d2ed1cf202b None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:15.839152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3010df-1348-4bf0-884f-8d2ed1cf202b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:15.863549 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d2fa0-acf5-4da4-a3bc-60a6c3dcf044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:15.864143 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d2fa0-acf5-4da4-a3bc-60a6c3dcf044 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:15.864422 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d2fa0-acf5-4da4-a3bc-60a6c3dcf044 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:15.864696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d2fa0-acf5-4da4-a3bc-60a6c3dcf044 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:15.865346 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d2fa0-acf5-4da4-a3bc-60a6c3dcf044 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:15.866744 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d2fa0-acf5-4da4-a3bc-60a6c3dcf044 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:15.889768 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 313/622] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:01:15 2022] POST /identity/v3/endpoints => generated 337 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:01:15.890492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d2fa0-acf5-4da4-a3bc-60a6c3dcf044 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:15.892626 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:15.929204 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3010df-1348-4bf0-884f-8d2ed1cf202b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:15.930685 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3010df-1348-4bf0-884f-8d2ed1cf202b None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:16.019236 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d2fa0-acf5-4da4-a3bc-60a6c3dcf044 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:16.040386 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:16.048756 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 310/623] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:01:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:01:16.048756 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3010df-1348-4bf0-884f-8d2ed1cf202b None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:16.068331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b116229-4c22-4f72-9ff7-1abc090946a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:16.068807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b116229-4c22-4f72-9ff7-1abc090946a8 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:16.069081 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b116229-4c22-4f72-9ff7-1abc090946a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:16.069350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b116229-4c22-4f72-9ff7-1abc090946a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:16.071170 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b116229-4c22-4f72-9ff7-1abc090946a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:16.071170 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b116229-4c22-4f72-9ff7-1abc090946a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:16.072275 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b116229-4c22-4f72-9ff7-1abc090946a8 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:16.087255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 314/624] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:16.088940 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20abe6-7895-410b-a287-32b658eb4447 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:16.089230 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20abe6-7895-410b-a287-32b658eb4447 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:16.089504 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20abe6-7895-410b-a287-32b658eb4447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:16.111562 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-6b20abe6-7895-410b-a287-32b658eb4447 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:16.112769 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6b20abe6-7895-410b-a287-32b658eb4447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:16.151877 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:16.168268 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3010df-1348-4bf0-884f-8d2ed1cf202b None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:16.185700 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 315/625] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:16.186531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20abe6-7895-410b-a287-32b658eb4447 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:16.211950 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce28492-70d7-4f93-b044-5e7cf62df0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:16.212552 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce28492-70d7-4f93-b044-5e7cf62df0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:16.212826 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce28492-70d7-4f93-b044-5e7cf62df0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:16.213093 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce28492-70d7-4f93-b044-5e7cf62df0b0 None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:16.213708 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce28492-70d7-4f93-b044-5e7cf62df0b0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:16.214005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce28492-70d7-4f93-b044-5e7cf62df0b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:16.215382 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce28492-70d7-4f93-b044-5e7cf62df0b0 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:16.219887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 311/626] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Oct 24 13:01:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:16.220749 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce28492-70d7-4f93-b044-5e7cf62df0b0 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:16.290758 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20abe6-7895-410b-a287-32b658eb4447 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:16.298889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:16.324957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce28492-70d7-4f93-b044-5e7cf62df0b0 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:16.331098 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c30e1-8cff-461c-ab64-304180ca644b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:16.331773 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c30e1-8cff-461c-ab64-304180ca644b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:16.332449 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c30e1-8cff-461c-ab64-304180ca644b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:16.332737 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c30e1-8cff-461c-ab64-304180ca644b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:16.345150 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c30e1-8cff-461c-ab64-304180ca644b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:16.346898 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c30e1-8cff-461c-ab64-304180ca644b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:16.358563 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a320449-668e-4543-8c00-1325f36a8650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:16.359182 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a320449-668e-4543-8c00-1325f36a8650 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:16.359482 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a320449-668e-4543-8c00-1325f36a8650 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:16.359757 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a320449-668e-4543-8c00-1325f36a8650 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:16.363085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-a51c30e1-8cff-461c-ab64-304180ca644b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:16.363085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:16.363085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:16.363085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:16.363085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:16.363085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:16.363085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:16.363085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:16.363085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:16.363085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:16.363085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:16.363085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:16.363085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:16.363085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:16.363085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:16.363085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:16.364202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:16.364202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:16.364202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:16.364202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:16.364202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:16.364202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:16.364202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:16.364202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:16.364202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:16.364202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:16.364202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:16.364202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:16.364202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:16.364202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:16.364202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:16.364202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:16.364202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:16.365126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:16.365126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:16.365126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:16.365126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 316/627] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:16.365396 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c30e1-8cff-461c-ab64-304180ca644b None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:16.371625 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a320449-668e-4543-8c00-1325f36a8650 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:16.373096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a320449-668e-4543-8c00-1325f36a8650 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:16.385889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-6a320449-668e-4543-8c00-1325f36a8650 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:16.385889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:16.385889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:16.385889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:16.385889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:16.385889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:16.385889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:16.385889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:16.385889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:16.385889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:16.385889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:16.385889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:16.385889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:01:16.385889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:01:16.385889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:01:16.386794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:01:16.386794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:16.386794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:16.386794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:16.386794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:16.386794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:16.386794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:16.386794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:16.386794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:16.386794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:16.386794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:16.386794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:16.386794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:16.386794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:16.386794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:16.386794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:16.386794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:16.387740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:01:16.387740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:01:16.387740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:01:16.387740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:01:16.387740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:01:16.387740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:01:16.387740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:16.387740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:16.387740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 312/628] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:01:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:16.388253 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a320449-668e-4543-8c00-1325f36a8650 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:16.399384 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:16.481103 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c30e1-8cff-461c-ab64-304180ca644b None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:16.489523 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a320449-668e-4543-8c00-1325f36a8650 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:16.515173 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d592093-1f4b-41a3-abb4-8d5a2b69e6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:16.515797 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d592093-1f4b-41a3-abb4-8d5a2b69e6d8 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:16.516077 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d592093-1f4b-41a3-abb4-8d5a2b69e6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:16.516351 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d592093-1f4b-41a3-abb4-8d5a2b69e6d8 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:16.516972 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d592093-1f4b-41a3-abb4-8d5a2b69e6d8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:16.517272 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d592093-1f4b-41a3-abb4-8d5a2b69e6d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:16.518645 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d592093-1f4b-41a3-abb4-8d5a2b69e6d8 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:16.524079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 317/629] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Oct 24 13:01:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:16.525376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e2537-6f22-47bc-9e1c-9b7e58e0119d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:16.525921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d592093-1f4b-41a3-abb4-8d5a2b69e6d8 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:16.526039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e2537-6f22-47bc-9e1c-9b7e58e0119d None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:16.526279 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e2537-6f22-47bc-9e1c-9b7e58e0119d None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:16.526501 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e2537-6f22-47bc-9e1c-9b7e58e0119d None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:16.527133 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e2537-6f22-47bc-9e1c-9b7e58e0119d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:16.527449 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e2537-6f22-47bc-9e1c-9b7e58e0119d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:16.528823 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e2537-6f22-47bc-9e1c-9b7e58e0119d None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:16.542468 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 313/630] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:16.543267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e2537-6f22-47bc-9e1c-9b7e58e0119d None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:16.555940 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:16.609622 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:16.630726 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d592093-1f4b-41a3-abb4-8d5a2b69e6d8 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:16.642432 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e2537-6f22-47bc-9e1c-9b7e58e0119d None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:16.665766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4cde9-5bae-4b73-ac0c-4b58cdd4591a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:16.666369 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4cde9-5bae-4b73-ac0c-4b58cdd4591a None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:16.666646 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4cde9-5bae-4b73-ac0c-4b58cdd4591a None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:16.666921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4cde9-5bae-4b73-ac0c-4b58cdd4591a None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:16.667628 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4cde9-5bae-4b73-ac0c-4b58cdd4591a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:16.667933 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4cde9-5bae-4b73-ac0c-4b58cdd4591a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:16.669349 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4cde9-5bae-4b73-ac0c-4b58cdd4591a None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:16.677345 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4366973-b350-47fc-9b99-a89b4e6a39fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:16.678378 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4366973-b350-47fc-9b99-a89b4e6a39fb None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:16.678659 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4366973-b350-47fc-9b99-a89b4e6a39fb None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:16.678954 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4366973-b350-47fc-9b99-a89b4e6a39fb None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:16.679920 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4366973-b350-47fc-9b99-a89b4e6a39fb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:16.681481 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 318/631] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 24 13:01:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:16.681921 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4366973-b350-47fc-9b99-a89b4e6a39fb None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:16.682110 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4cde9-5bae-4b73-ac0c-4b58cdd4591a None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:16.696163 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 314/632] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 24 13:01:16 2022] POST /identity/v3/services => generated 269 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:01:16.696967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4366973-b350-47fc-9b99-a89b4e6a39fb None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:16.780819 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:16.802223 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4cde9-5bae-4b73-ac0c-4b58cdd4591a None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:16.813203 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4366973-b350-47fc-9b99-a89b4e6a39fb None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:16.840287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:16.841073 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130dc92-b5e5-4ba2-b241-219f9fadf962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:16.842428 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130dc92-b5e5-4ba2-b241-219f9fadf962 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:16.842708 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130dc92-b5e5-4ba2-b241-219f9fadf962 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:16.842977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130dc92-b5e5-4ba2-b241-219f9fadf962 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:16.843681 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130dc92-b5e5-4ba2-b241-219f9fadf962 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:16.845163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130dc92-b5e5-4ba2-b241-219f9fadf962 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:16.855694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93195270-94b8-477a-b403-4c2592388412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:16.856340 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93195270-94b8-477a-b403-4c2592388412 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:16.856618 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93195270-94b8-477a-b403-4c2592388412 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:16.856891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93195270-94b8-477a-b403-4c2592388412 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:16.864231 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93195270-94b8-477a-b403-4c2592388412 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:16.865694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93195270-94b8-477a-b403-4c2592388412 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:16.875447 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 319/633] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:01:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:01:16.875447 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130dc92-b5e5-4ba2-b241-219f9fadf962 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:16.890107 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-93195270-94b8-477a-b403-4c2592388412 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:16.890107 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:16.890107 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:16.890107 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:16.890107 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:16.890107 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:16.890107 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:16.890107 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:16.890107 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:16.890107 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:16.890107 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:16.890107 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:16.890107 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:01:16.890107 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:01:16.890107 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:01:16.891083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:01:16.891083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:16.891083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:16.891083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:16.891083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:16.891083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:16.891083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:16.891083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:16.891083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:16.891083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:16.891083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:16.891083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:16.891083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:16.891083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:16.891083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:16.891083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:16.891083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:16.892386 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:01:16.892386 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:01:16.892386 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:01:16.892386 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:01:16.892386 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:01:16.892386 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:01:16.892386 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:16.892386 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:16.892386 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 315/634] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:01:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:16.897647 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93195270-94b8-477a-b403-4c2592388412 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:17.020333 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130dc92-b5e5-4ba2-b241-219f9fadf962 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:17.035117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93195270-94b8-477a-b403-4c2592388412 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:17.069283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ca52b-f757-42a2-9169-b2eff2046402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:17.069934 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ca52b-f757-42a2-9169-b2eff2046402 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:17.070213 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ca52b-f757-42a2-9169-b2eff2046402 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:17.070465 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ca52b-f757-42a2-9169-b2eff2046402 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:17.071188 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ca52b-f757-42a2-9169-b2eff2046402 None admin] RBAC: Adding query filter params (role.id=ce7268982b3046a08a5a58a49d928fc6, scope.project.id=f230a12ca6234faabf984e4a58a0d2e8, user.id=f3254b4fddaa4f099c6c44f4c139ee5e) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:17.071512 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ca52b-f757-42a2-9169-b2eff2046402 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:17.072942 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ca52b-f757-42a2-9169-b2eff2046402 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:17.075265 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:17.081677 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 320/635] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:01:16 2022] GET /identity/v3/role_assignments?user.id=f3254b4fddaa4f099c6c44f4c139ee5e&scope.project.id=f230a12ca6234faabf984e4a58a0d2e8&role.id=ce7268982b3046a08a5a58a49d928fc6 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:17.087905 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319de3de-d9a4-43b4-ac9c-d83b81952792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:17.088540 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319de3de-d9a4-43b4-ac9c-d83b81952792 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:17.088818 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319de3de-d9a4-43b4-ac9c-d83b81952792 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:17.089090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319de3de-d9a4-43b4-ac9c-d83b81952792 None admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:17.089810 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319de3de-d9a4-43b4-ac9c-d83b81952792 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:17.090115 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319de3de-d9a4-43b4-ac9c-d83b81952792 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:17.091658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319de3de-d9a4-43b4-ac9c-d83b81952792 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:17.107260 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 316/636] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 24 13:01:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:17.113194 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ca52b-f757-42a2-9169-b2eff2046402 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:17.232298 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ca52b-f757-42a2-9169-b2eff2046402 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:17.276958 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae6bc3-07d1-440c-86ec-6386e2913a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:17.277560 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae6bc3-07d1-440c-86ec-6386e2913a86 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:17.277835 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae6bc3-07d1-440c-86ec-6386e2913a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:17.278106 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae6bc3-07d1-440c-86ec-6386e2913a86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:17.278818 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae6bc3-07d1-440c-86ec-6386e2913a86 None admin] RBAC: Adding query filter params (role.id=23ca6ecd60b2470cba913daeaf54f0f7, scope.project.id=f230a12ca6234faabf984e4a58a0d2e8, user.id=768c71ab4ab241e4bfed9f7561ae3d2d) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:17.279117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae6bc3-07d1-440c-86ec-6386e2913a86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:17.280572 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae6bc3-07d1-440c-86ec-6386e2913a86 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:17.286814 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 321/637] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:01:17 2022] GET /identity/v3/role_assignments?user.id=768c71ab4ab241e4bfed9f7561ae3d2d&scope.project.id=f230a12ca6234faabf984e4a58a0d2e8&role.id=23ca6ecd60b2470cba913daeaf54f0f7 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:18.990013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd28a8a-4b1f-482f-bc20-293c783b2060 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:18.990565 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd28a8a-4b1f-482f-bc20-293c783b2060 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:18.990565 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd28a8a-4b1f-482f-bc20-293c783b2060 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:18.992295 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 317/638] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:18.998043 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5883e-8020-41cd-8c27-71222fb76ebf None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:18.998494 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5883e-8020-41cd-8c27-71222fb76ebf None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:18.998571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5883e-8020-41cd-8c27-71222fb76ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:19.017946 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-13b5883e-8020-41cd-8c27-71222fb76ebf None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:19.019129 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-13b5883e-8020-41cd-8c27-71222fb76ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:19.084595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:19.097944 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 322/639] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:18 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:01:19.186634 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b63eba-eeba-41d0-a330-f4bdfeac828a None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:19.186961 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b63eba-eeba-41d0-a330-f4bdfeac828a None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:19.187180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b63eba-eeba-41d0-a330-f4bdfeac828a None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:19.188842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 318/640] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:19.193997 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffd060-d6e5-43a6-99fe-0851f0ef589f None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:19.195066 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffd060-d6e5-43a6-99fe-0851f0ef589f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:19.195543 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffd060-d6e5-43a6-99fe-0851f0ef589f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:19.214834 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-f8ffd060-d6e5-43a6-99fe-0851f0ef589f None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:19.216292 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f8ffd060-d6e5-43a6-99fe-0851f0ef589f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:19.287072 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 323/641] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:19 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:19.375104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b63eba-eeba-41d0-a330-f4bdfeac828a None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:19.418381 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114cc83-8011-4b4d-992e-032422a7ddf3 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:19.418992 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114cc83-8011-4b4d-992e-032422a7ddf3 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:19.419535 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114cc83-8011-4b4d-992e-032422a7ddf3 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:19.421453 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 324/642] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:19.428308 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:19.429723 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ab11f-ee18-4b7a-9c66-a447f2a494f1 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:19.430012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ab11f-ee18-4b7a-9c66-a447f2a494f1 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:19.430304 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ab11f-ee18-4b7a-9c66-a447f2a494f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:19.456841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-c50ab11f-ee18-4b7a-9c66-a447f2a494f1 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:19.458032 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c50ab11f-ee18-4b7a-9c66-a447f2a494f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:19.498776 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b63eba-eeba-41d0-a330-f4bdfeac828a None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:19.531678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 325/643] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:19 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:01:19.536443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5705f-3e6f-4892-8efc-5cba6d6cf9cb None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:19.536709 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5705f-3e6f-4892-8efc-5cba6d6cf9cb None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:19.536991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5705f-3e6f-4892-8efc-5cba6d6cf9cb None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:19.539836 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfaf11-837c-41d1-a70b-e8fe670e362c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:19.540849 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfaf11-837c-41d1-a70b-e8fe670e362c None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:19.541343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfaf11-837c-41d1-a70b-e8fe670e362c None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:19.541850 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfaf11-837c-41d1-a70b-e8fe670e362c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:19.543489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 326/644] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:01:19.543731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfaf11-837c-41d1-a70b-e8fe670e362c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:19.544679 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c5cac-f98e-499d-993a-778c02b81f67 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:19.544964 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c5cac-f98e-499d-993a-778c02b81f67 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:19.545239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c5cac-f98e-499d-993a-778c02b81f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:19.546291 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfaf11-837c-41d1-a70b-e8fe670e362c None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:19.559370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-fecfaf11-837c-41d1-a70b-e8fe670e362c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:01:19.559370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:19.559370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:01:19.559370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:01:19.559370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:01:19.559370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:01:19.559370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:01:19.559370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:19.559370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:01:19.559370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:19.559370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:19.559370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:19.559370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:19.559370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:19.559370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:19.559370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:19.560472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:19.560472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:19.560472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:19.560472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:19.560472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:19.560472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:19.560472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:19.560472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:01:19.560472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:01:19.560472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:01:19.560472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:01:19.560472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:19.560472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:19.560472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:19.560472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:19.560472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:19.560472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:19.561376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:19.561376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:19.561376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:19.561376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:19.561376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:19.561376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:19.561376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:19.561376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:19.561376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:19.561376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:19.561376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:01:19.561376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:19.561376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:01:19.561376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:19.563850 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-7c0c5cac-f98e-499d-993a-778c02b81f67 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:19.568865 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7c0c5cac-f98e-499d-993a-778c02b81f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:19.569163 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 319/645] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Oct 24 13:01:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:19.570732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfaf11-837c-41d1-a70b-e8fe670e362c None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:19.626704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:19.648371 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 327/646] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:19 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:19.649529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c5cac-f98e-499d-993a-778c02b81f67 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:19.681049 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfaf11-837c-41d1-a70b-e8fe670e362c None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:19.690882 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:19.719587 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773078a0-c544-42d3-bf48-91e228ef2bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:19.720194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773078a0-c544-42d3-bf48-91e228ef2bbb None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:19.720472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773078a0-c544-42d3-bf48-91e228ef2bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:19.720742 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773078a0-c544-42d3-bf48-91e228ef2bbb None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:19.721364 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773078a0-c544-42d3-bf48-91e228ef2bbb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:19.721662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773078a0-c544-42d3-bf48-91e228ef2bbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:19.723138 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773078a0-c544-42d3-bf48-91e228ef2bbb None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:19.733378 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 320/647] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Oct 24 13:01:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:19.734228 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773078a0-c544-42d3-bf48-91e228ef2bbb None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:19.765758 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c5cac-f98e-499d-993a-778c02b81f67 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:19.802871 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf3cd9-454e-4346-aff5-4f5c262723d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:19.803994 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf3cd9-454e-4346-aff5-4f5c262723d5 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:19.804909 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf3cd9-454e-4346-aff5-4f5c262723d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:19.805199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf3cd9-454e-4346-aff5-4f5c262723d5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:19.805785 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf3cd9-454e-4346-aff5-4f5c262723d5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:19.807712 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf3cd9-454e-4346-aff5-4f5c262723d5 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:19.816730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-d7bf3cd9-454e-4346-aff5-4f5c262723d5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:01:19.816730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:19.816730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:01:19.816730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:01:19.816730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:01:19.816730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:01:19.816730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:01:19.816730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:19.816730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:01:19.816730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:19.816730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:19.816730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:19.816730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:19.816730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:19.816730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:19.816730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:19.816730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:19.817742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:19.817742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:19.817742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:19.817742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:19.817742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:19.817742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:19.817742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:01:19.817742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:01:19.817742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:01:19.817742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:01:19.817742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:19.817742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:19.817742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:19.817742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:19.817742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:19.817742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:19.818595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:19.818595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:19.818595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:19.818595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:19.818595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:19.818595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:19.818595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:19.818595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:19.818595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:19.818595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:19.818595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:01:19.818595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:19.818595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:01:19.818595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:19.818595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 328/648] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 24 13:01:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:19.820332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf3cd9-454e-4346-aff5-4f5c262723d5 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:19.845369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773078a0-c544-42d3-bf48-91e228ef2bbb None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:19.868549 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:19.881322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bfe0f-7d14-430e-89fb-a350e77b9f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:19.882459 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bfe0f-7d14-430e-89fb-a350e77b9f6a None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:19.882811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bfe0f-7d14-430e-89fb-a350e77b9f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:19.883086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bfe0f-7d14-430e-89fb-a350e77b9f6a None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:19.883991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bfe0f-7d14-430e-89fb-a350e77b9f6a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:19.884288 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bfe0f-7d14-430e-89fb-a350e77b9f6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:19.885646 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bfe0f-7d14-430e-89fb-a350e77b9f6a None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:19.895020 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 321/649] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Oct 24 13:01:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:19.895020 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bfe0f-7d14-430e-89fb-a350e77b9f6a None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:19.930742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf3cd9-454e-4346-aff5-4f5c262723d5 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:19.930932 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:19.964923 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e3c94-08f6-41b8-b130-59a14ebd7f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:19.965544 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e3c94-08f6-41b8-b130-59a14ebd7f18 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:19.965822 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e3c94-08f6-41b8-b130-59a14ebd7f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:19.966096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e3c94-08f6-41b8-b130-59a14ebd7f18 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:19.982039 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e3c94-08f6-41b8-b130-59a14ebd7f18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:01:19.987328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-f53e3c94-08f6-41b8-b130-59a14ebd7f18 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 13:01:19.987328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:19.987328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:19.987328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:19.987328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:19.987328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:19.987328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:19.987328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:19.987328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:19.987328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:19.987328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:19.987328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:19.987328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:01:19.987328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:01:19.987328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:01:19.987328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:01:19.988287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:01:19.988287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:01:19.988287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:01:19.988287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:01:19.988287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:19.988287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:19.988287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:19.988287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:19.988287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:19.988287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:19.988287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:19.988287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:19.988287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:19.988287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:19.988287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:19.988287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:19.989147 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:19.989147 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:19.989147 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:19.989147 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:19.989147 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:01:19.989147 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:01:19.989147 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:01:19.989147 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:01:19.989147 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:01:19.989147 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:01:19.989147 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 13:01:19.989147 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:19.989797 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 329/650] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Oct 24 13:01:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:19.990897 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e3c94-08f6-41b8-b130-59a14ebd7f18 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:19.999238 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bfe0f-7d14-430e-89fb-a350e77b9f6a None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:20.032548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea51d2d-0ee1-4b31-ac39-6998939d1428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:20.033140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea51d2d-0ee1-4b31-ac39-6998939d1428 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:20.033407 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea51d2d-0ee1-4b31-ac39-6998939d1428 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:20.033669 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea51d2d-0ee1-4b31-ac39-6998939d1428 None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:20.034310 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea51d2d-0ee1-4b31-ac39-6998939d1428 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:20.034606 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea51d2d-0ee1-4b31-ac39-6998939d1428 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:20.035991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea51d2d-0ee1-4b31-ac39-6998939d1428 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:20.040788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 322/651] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 24 13:01:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:20.041653 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea51d2d-0ee1-4b31-ac39-6998939d1428 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:20.091064 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e3c94-08f6-41b8-b130-59a14ebd7f18 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:20.097826 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:20.127503 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa73a37-5e03-411e-b45c-0ec1d936de28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:20.128112 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa73a37-5e03-411e-b45c-0ec1d936de28 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:20.128392 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa73a37-5e03-411e-b45c-0ec1d936de28 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:20.128667 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa73a37-5e03-411e-b45c-0ec1d936de28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:20.129363 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa73a37-5e03-411e-b45c-0ec1d936de28 None admin] RBAC: Adding query filter params (interface=public, service_id=7c21cae8570b424194086e235c57646e, region_id=RegionOne) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:20.129695 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa73a37-5e03-411e-b45c-0ec1d936de28 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:20.131058 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa73a37-5e03-411e-b45c-0ec1d936de28 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:20.139080 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 330/652] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Oct 24 13:01:19 2022] GET /identity/v3/endpoints?service_id=7c21cae8570b424194086e235c57646e&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:20.139891 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa73a37-5e03-411e-b45c-0ec1d936de28 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:20.141412 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:20.144445 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea51d2d-0ee1-4b31-ac39-6998939d1428 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:20.178238 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b223f-dd6c-4d21-afbd-aba9d70b0d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:20.179476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b223f-dd6c-4d21-afbd-aba9d70b0d70 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:20.179754 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b223f-dd6c-4d21-afbd-aba9d70b0d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:20.180016 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b223f-dd6c-4d21-afbd-aba9d70b0d70 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:20.180581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b223f-dd6c-4d21-afbd-aba9d70b0d70 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:20.181941 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b223f-dd6c-4d21-afbd-aba9d70b0d70 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:20.190569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-0e1b223f-dd6c-4d21-afbd-aba9d70b0d70 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:01:20.190569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:20.190569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:01:20.190569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:01:20.190569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:01:20.190569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:01:20.190569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:01:20.190569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:20.190569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:01:20.190569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:20.190569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:20.190569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:20.190569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:20.190569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:20.190569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:20.190569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:20.190569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:20.191675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:20.191675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:20.191675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:20.191675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:20.191675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:20.191675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:20.191675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:01:20.191675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:01:20.191675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:01:20.191675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:01:20.191675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:20.191675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:20.191675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:20.191675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:20.191675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:20.191675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:20.192530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:20.192530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:20.192530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:20.192530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:20.192530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:20.192530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:20.192530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:20.192530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:20.192530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:20.192530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:20.192530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:01:20.192530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:20.192530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:01:20.192530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:20.192530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 323/653] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Oct 24 13:01:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:20.193420 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b223f-dd6c-4d21-afbd-aba9d70b0d70 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:20.244426 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa73a37-5e03-411e-b45c-0ec1d936de28 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:20.276831 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4c6ef-5e59-42d6-ad06-05e26a8daa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:20.277426 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4c6ef-5e59-42d6-ad06-05e26a8daa86 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:20.277701 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4c6ef-5e59-42d6-ad06-05e26a8daa86 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:20.277969 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4c6ef-5e59-42d6-ad06-05e26a8daa86 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:20.278614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4c6ef-5e59-42d6-ad06-05e26a8daa86 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:20.278908 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4c6ef-5e59-42d6-ad06-05e26a8daa86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:20.280287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4c6ef-5e59-42d6-ad06-05e26a8daa86 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:20.288211 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 331/654] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Oct 24 13:01:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:20.288970 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4c6ef-5e59-42d6-ad06-05e26a8daa86 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:20.290585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b223f-dd6c-4d21-afbd-aba9d70b0d70 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:20.324770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:20.327290 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f604069-5632-4c65-ad2a-e222029d75bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:20.327975 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f604069-5632-4c65-ad2a-e222029d75bb None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:20.328270 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f604069-5632-4c65-ad2a-e222029d75bb None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:20.328517 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f604069-5632-4c65-ad2a-e222029d75bb None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:20.329144 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f604069-5632-4c65-ad2a-e222029d75bb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:20.329440 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f604069-5632-4c65-ad2a-e222029d75bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:20.330827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f604069-5632-4c65-ad2a-e222029d75bb None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:20.336945 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 324/655] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 24 13:01:20 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:20.337771 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f604069-5632-4c65-ad2a-e222029d75bb None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:20.388315 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:20.427158 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4c6ef-5e59-42d6-ad06-05e26a8daa86 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:20.466212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063798a-cd04-4217-9b77-8822e50743b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:20.466830 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063798a-cd04-4217-9b77-8822e50743b6 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:20.467107 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063798a-cd04-4217-9b77-8822e50743b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:20.467376 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063798a-cd04-4217-9b77-8822e50743b6 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:20.468052 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063798a-cd04-4217-9b77-8822e50743b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:20.469438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063798a-cd04-4217-9b77-8822e50743b6 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:20.483471 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 332/656] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Oct 24 13:01:20 2022] GET /identity/v3/services => generated 1029 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:01:20.483471 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063798a-cd04-4217-9b77-8822e50743b6 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:20.492462 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f604069-5632-4c65-ad2a-e222029d75bb None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:20.531474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c7c1b-dd42-43e0-8c31-fbf158f42dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:20.532156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c7c1b-dd42-43e0-8c31-fbf158f42dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:20.532429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c7c1b-dd42-43e0-8c31-fbf158f42dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:20.532695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c7c1b-dd42-43e0-8c31-fbf158f42dc0 None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:20.533459 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c7c1b-dd42-43e0-8c31-fbf158f42dc0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:20.533753 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c7c1b-dd42-43e0-8c31-fbf158f42dc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:20.539167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c7c1b-dd42-43e0-8c31-fbf158f42dc0 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:20.547969 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 325/657] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Oct 24 13:01:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:20.549285 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c7c1b-dd42-43e0-8c31-fbf158f42dc0 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:20.612444 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:20.620895 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063798a-cd04-4217-9b77-8822e50743b6 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:20.669357 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea20f9-a422-47f6-a23b-ee92c48136e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:20.669919 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea20f9-a422-47f6-a23b-ee92c48136e3 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:20.670196 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea20f9-a422-47f6-a23b-ee92c48136e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:20.670468 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea20f9-a422-47f6-a23b-ee92c48136e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:20.675760 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:20.685928 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea20f9-a422-47f6-a23b-ee92c48136e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:20.687407 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea20f9-a422-47f6-a23b-ee92c48136e3 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:20.697551 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c7c1b-dd42-43e0-8c31-fbf158f42dc0 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:20.711375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-94ea20f9-a422-47f6-a23b-ee92c48136e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:20.711375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:20.711375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:20.711375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:20.711375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:20.711375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:20.711375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:20.711375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:20.711375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:20.711375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:20.711375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:20.711375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:20.711375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:20.711375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:20.711375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:20.711375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:20.712441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:20.712441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:20.712441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:20.712441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:20.712441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:20.712441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:20.712441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:20.712441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:20.712441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:20.712441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:20.712441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:20.712441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:20.712441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:20.712441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:20.712441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:20.712441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:20.712441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:20.713362 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:20.713362 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:20.713362 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:20.713362 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 333/658] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:20.718761 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea20f9-a422-47f6-a23b-ee92c48136e3 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:20.745387 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c0c51-26f7-41d1-b7f9-5f890df76c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:20.746528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c0c51-26f7-41d1-b7f9-5f890df76c9a None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:20.746804 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c0c51-26f7-41d1-b7f9-5f890df76c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:20.747356 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c0c51-26f7-41d1-b7f9-5f890df76c9a None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:20.748019 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c0c51-26f7-41d1-b7f9-5f890df76c9a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:20.748562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c0c51-26f7-41d1-b7f9-5f890df76c9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:20.750617 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c0c51-26f7-41d1-b7f9-5f890df76c9a None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:20.758238 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 326/659] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Oct 24 13:01:20 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:20.839175 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea20f9-a422-47f6-a23b-ee92c48136e3 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:20.878352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14a13c-08da-4b38-be09-c773058ca660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:20.878975 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14a13c-08da-4b38-be09-c773058ca660 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:20.879252 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14a13c-08da-4b38-be09-c773058ca660 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:20.879555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14a13c-08da-4b38-be09-c773058ca660 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:20.880212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14a13c-08da-4b38-be09-c773058ca660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:20.880513 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14a13c-08da-4b38-be09-c773058ca660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:20.882525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14a13c-08da-4b38-be09-c773058ca660 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:20.897376 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 334/660] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:20.902999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c0c51-26f7-41d1-b7f9-5f890df76c9a None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:21.016804 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c0c51-26f7-41d1-b7f9-5f890df76c9a None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:21.053238 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb6f3c-c340-40f2-b4d1-60a59c8ebc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:21.054399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb6f3c-c340-40f2-b4d1-60a59c8ebc32 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:21.054890 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb6f3c-c340-40f2-b4d1-60a59c8ebc32 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:21.055349 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb6f3c-c340-40f2-b4d1-60a59c8ebc32 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:21.063265 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb6f3c-c340-40f2-b4d1-60a59c8ebc32 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:21.064772 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb6f3c-c340-40f2-b4d1-60a59c8ebc32 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:21.077332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-8bdb6f3c-c340-40f2-b4d1-60a59c8ebc32 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 13:01:21.077332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:21.077332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:21.077332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:21.077332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:21.077332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:21.077332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:21.077332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:21.077332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:21.077332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:21.077332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:21.077332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:21.077332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:01:21.077332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:01:21.077332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:01:21.077332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:01:21.078328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:21.078328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:21.078328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:01:21.078328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:21.078328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:01:21.078328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:21.078328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:21.078328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:21.078328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:21.078328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:21.078328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:21.078328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:21.078328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:21.078328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:21.078328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:21.078328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:21.078328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:21.078328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:21.079292 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:21.079292 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:21.079292 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:01:21.079292 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:01:21.079292 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:01:21.079292 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:01:21.079292 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:01:21.079292 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:01:21.079292 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 13:01:21.079292 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:21.079292 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 327/661] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Oct 24 13:01:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:21.084273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14a13c-08da-4b38-be09-c773058ca660 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:21.095920 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:21.191993 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14a13c-08da-4b38-be09-c773058ca660 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:21.229583 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5947bb-04a6-4c75-8991-6095f845b5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:21.230578 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5947bb-04a6-4c75-8991-6095f845b5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:21.231060 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5947bb-04a6-4c75-8991-6095f845b5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:21.231593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5947bb-04a6-4c75-8991-6095f845b5e9 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:21.232566 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5947bb-04a6-4c75-8991-6095f845b5e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:21.233068 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5947bb-04a6-4c75-8991-6095f845b5e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:21.234850 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5947bb-04a6-4c75-8991-6095f845b5e9 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:21.253543 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 335/662] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Oct 24 13:01:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:21.260291 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb6f3c-c340-40f2-b4d1-60a59c8ebc32 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:21.282552 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:21.373540 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb6f3c-c340-40f2-b4d1-60a59c8ebc32 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:21.409606 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5fcdc6-faa4-41ed-b985-43de75f9a9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:21.410642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fcdc6-faa4-41ed-b985-43de75f9a9ed None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:21.411129 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fcdc6-faa4-41ed-b985-43de75f9a9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:21.411637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fcdc6-faa4-41ed-b985-43de75f9a9ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:21.422643 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5fcdc6-faa4-41ed-b985-43de75f9a9ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:21.424319 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5fcdc6-faa4-41ed-b985-43de75f9a9ed None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:21.440224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-9e5fcdc6-faa4-41ed-b985-43de75f9a9ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:21.440224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:21.440224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:21.440224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:21.440224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:21.440224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:21.440224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:21.440224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:21.440224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:21.440224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:21.440224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:21.440224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:21.440224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:21.440224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:21.440224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:21.440224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:21.441178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:21.441178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:21.441178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:21.441178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:21.441178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:21.441178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:21.441178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:21.441178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:21.441178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:21.441178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:21.441178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:21.441178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:21.441178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:21.441178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:21.441178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:21.441178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:21.441178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:21.442085 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:21.442085 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:21.442085 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:21.444087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 328/663] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:21.450869 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5947bb-04a6-4c75-8991-6095f845b5e9 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:21.526649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:21.565413 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5947bb-04a6-4c75-8991-6095f845b5e9 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:21.601469 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9b28c-c20c-49ce-ac88-b4bbccd94239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:21.602465 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9b28c-c20c-49ce-ac88-b4bbccd94239 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:21.602986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9b28c-c20c-49ce-ac88-b4bbccd94239 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:21.603487 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9b28c-c20c-49ce-ac88-b4bbccd94239 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:21.604320 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9b28c-c20c-49ce-ac88-b4bbccd94239 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:21.604815 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9b28c-c20c-49ce-ac88-b4bbccd94239 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:21.606378 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9b28c-c20c-49ce-ac88-b4bbccd94239 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:21.618433 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 336/664] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:21.624213 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5fcdc6-faa4-41ed-b985-43de75f9a9ed None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:21.696939 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:21.734877 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5fcdc6-faa4-41ed-b985-43de75f9a9ed None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:21.776185 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e9e4a-0012-40fa-8e44-fa1851f0842f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:21.777186 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e9e4a-0012-40fa-8e44-fa1851f0842f None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:21.777690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e9e4a-0012-40fa-8e44-fa1851f0842f None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:21.778160 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e9e4a-0012-40fa-8e44-fa1851f0842f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:21.785258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e9e4a-0012-40fa-8e44-fa1851f0842f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:21.786923 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e9e4a-0012-40fa-8e44-fa1851f0842f None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:21.799499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-503e9e4a-0012-40fa-8e44-fa1851f0842f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:21.799499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:21.799499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:21.799499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:21.799499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:21.799499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:21.799499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:21.799499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:21.799499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:21.799499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:21.799499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:21.799499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:21.799499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:01:21.799499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:01:21.799499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:01:21.800388 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:01:21.800388 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:21.800388 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:21.800388 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:21.800388 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:21.800388 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:21.800388 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:21.800388 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:21.800388 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:21.800388 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:21.800388 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:21.800388 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:21.800388 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:21.800388 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:21.800388 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:21.800388 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:21.800388 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:21.801284 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:01:21.801284 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:01:21.801284 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:01:21.801284 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:01:21.801284 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:01:21.801284 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:01:21.801284 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:21.801284 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:21.803897 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 329/665] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:01:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:21.809861 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9b28c-c20c-49ce-ac88-b4bbccd94239 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:21.914442 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9b28c-c20c-49ce-ac88-b4bbccd94239 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:21.940451 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:21.955438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cef77-6e08-475c-9039-78d341fce619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:21.955438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cef77-6e08-475c-9039-78d341fce619 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:21.955438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cef77-6e08-475c-9039-78d341fce619 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:21.955438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cef77-6e08-475c-9039-78d341fce619 None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:21.955856 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cef77-6e08-475c-9039-78d341fce619 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:21.955856 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cef77-6e08-475c-9039-78d341fce619 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:21.955856 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cef77-6e08-475c-9039-78d341fce619 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:21.968696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 337/666] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 24 13:01:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:21.974509 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e9e4a-0012-40fa-8e44-fa1851f0842f None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:22.079890 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e9e4a-0012-40fa-8e44-fa1851f0842f None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:22.110924 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:22.120779 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5c9ac-312a-4434-820b-d60b44efcf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:22.121430 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5c9ac-312a-4434-820b-d60b44efcf99 None admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:22.121705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5c9ac-312a-4434-820b-d60b44efcf99 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:22.121967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5c9ac-312a-4434-820b-d60b44efcf99 None admin] PATH_INFO: `/v3/projects/f230a12ca6234faabf984e4a58a0d2e8/users/f3254b4fddaa4f099c6c44f4c139ee5e/roles/b16a8ec40d5545828c8c459f737209de` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:22.124119 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5c9ac-312a-4434-820b-d60b44efcf99 None admin] RBAC: Authorizing `identity:create_grant(project_id=f230a12ca6234faabf984e4a58a0d2e8, user_id=f3254b4fddaa4f099c6c44f4c139ee5e, role_id=b16a8ec40d5545828c8c459f737209de)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:22.125555 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5c9ac-312a-4434-820b-d60b44efcf99 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:22.142332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 330/667] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 13:01:21 2022] PUT /identity/v3/projects/f230a12ca6234faabf984e4a58a0d2e8/users/f3254b4fddaa4f099c6c44f4c139ee5e/roles/b16a8ec40d5545828c8c459f737209de => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:01:22.739839 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c13a9e-d5e7-4bb2-9614-fe41e4b3d93b None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:22.740359 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c13a9e-d5e7-4bb2-9614-fe41e4b3d93b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:22.740359 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c13a9e-d5e7-4bb2-9614-fe41e4b3d93b None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:22.742211 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 338/668] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:22.747676 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1d730-4965-4005-9173-91cfdf8ad238 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:22.747964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1d730-4965-4005-9173-91cfdf8ad238 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:22.748241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1d730-4965-4005-9173-91cfdf8ad238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:22.767350 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-faf1d730-4965-4005-9173-91cfdf8ad238 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:22.768585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-faf1d730-4965-4005-9173-91cfdf8ad238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:22.828154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f921d8a-352a-410d-aace-a43fd6608d2a None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:22.828459 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f921d8a-352a-410d-aace-a43fd6608d2a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:22.828621 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f921d8a-352a-410d-aace-a43fd6608d2a None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:22.830167 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 339/669] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:22.836214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad667260-2769-4dac-874e-2c9e20b74050 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:22.836592 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad667260-2769-4dac-874e-2c9e20b74050 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:22.836867 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad667260-2769-4dac-874e-2c9e20b74050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:22.841895 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 331/670] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:22 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:22.855787 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-ad667260-2769-4dac-874e-2c9e20b74050 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:22.856984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ad667260-2769-4dac-874e-2c9e20b74050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:22.932172 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 340/671] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:22 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:01:23.082356 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347dc16-aece-479e-88d0-be3411e83316 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:23.082852 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347dc16-aece-479e-88d0-be3411e83316 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:23.082852 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347dc16-aece-479e-88d0-be3411e83316 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:23.084458 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 332/672] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:23.089802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62703a-d97f-4ce1-9fd1-f3006b7f71ae None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:23.090095 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62703a-d97f-4ce1-9fd1-f3006b7f71ae None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:23.090374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62703a-d97f-4ce1-9fd1-f3006b7f71ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:23.108720 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-1f62703a-d97f-4ce1-9fd1-f3006b7f71ae None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:23.109931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1f62703a-d97f-4ce1-9fd1-f3006b7f71ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:23.141386 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347dc16-aece-479e-88d0-be3411e83316 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:23.182452 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 341/673] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:23 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:23.227580 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62703a-d97f-4ce1-9fd1-f3006b7f71ae None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:23.259962 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347dc16-aece-479e-88d0-be3411e83316 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:23.278911 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:23.292367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:23.302329 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bd589-e031-4a3c-9162-51e00ae95d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:23.303208 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bd589-e031-4a3c-9162-51e00ae95d4f None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:23.304091 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bd589-e031-4a3c-9162-51e00ae95d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:23.304360 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bd589-e031-4a3c-9162-51e00ae95d4f None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:23.305564 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5bd589-e031-4a3c-9162-51e00ae95d4f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:23.307212 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5bd589-e031-4a3c-9162-51e00ae95d4f None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:23.327728 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 333/674] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 24 13:01:23 2022] POST /identity/v3/services => generated 251 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:01:23.361357 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62703a-d97f-4ce1-9fd1-f3006b7f71ae None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:23.409841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42132548-8977-42b1-92c8-5b427b891268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:23.410743 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42132548-8977-42b1-92c8-5b427b891268 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:23.411248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42132548-8977-42b1-92c8-5b427b891268 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:23.411695 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42132548-8977-42b1-92c8-5b427b891268 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:23.412486 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42132548-8977-42b1-92c8-5b427b891268 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:23.415018 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42132548-8977-42b1-92c8-5b427b891268 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:23.425227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-42132548-8977-42b1-92c8-5b427b891268 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:01:23.425227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:23.425227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:01:23.425227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:01:23.425227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:01:23.425227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:01:23.425227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:01:23.425227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:23.425227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:01:23.425227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:23.425227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:23.425227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:23.425227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:23.425227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:23.425227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:23.425227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:23.426519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:23.426519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:23.426519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:23.426519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:23.426519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:23.426519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:23.426519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:23.426519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:01:23.426519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:01:23.426519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:01:23.426519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:01:23.426519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:23.426519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:23.426519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:23.426519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:23.426519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:23.426519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:23.427729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:23.427729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:23.427729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:23.427729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:23.427729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:23.427729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:23.427729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:23.427729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:23.427729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:23.427729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:23.427729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:01:23.427729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:23.427729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:01:23.427729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:23.431316 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 342/675] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Oct 24 13:01:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:01:23.440581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bd589-e031-4a3c-9162-51e00ae95d4f None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:23.500432 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42132548-8977-42b1-92c8-5b427b891268 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:23.575698 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bd589-e031-4a3c-9162-51e00ae95d4f None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:23.613772 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424661bc-b02b-45de-8adb-09496abafdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:23.614304 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424661bc-b02b-45de-8adb-09496abafdf2 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:23.614585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424661bc-b02b-45de-8adb-09496abafdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:23.614856 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424661bc-b02b-45de-8adb-09496abafdf2 None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:23.615509 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424661bc-b02b-45de-8adb-09496abafdf2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:23.615820 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424661bc-b02b-45de-8adb-09496abafdf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:23.618037 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424661bc-b02b-45de-8adb-09496abafdf2 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:23.623645 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 334/676] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Oct 24 13:01:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:23.629217 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424661bc-b02b-45de-8adb-09496abafdf2 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:23.643882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42132548-8977-42b1-92c8-5b427b891268 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:23.652522 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:23.673921 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:23.686911 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9d614-433f-46f0-af51-4856fc68c72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:23.688090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9d614-433f-46f0-af51-4856fc68c72a None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:23.688933 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9d614-433f-46f0-af51-4856fc68c72a None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:23.689472 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9d614-433f-46f0-af51-4856fc68c72a None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:23.690641 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9d614-433f-46f0-af51-4856fc68c72a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:23.692304 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9d614-433f-46f0-af51-4856fc68c72a None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:23.714458 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 343/677] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 24 13:01:23 2022] POST /identity/v3/services => generated 241 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:01:23.743726 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424661bc-b02b-45de-8adb-09496abafdf2 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:23.792410 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b3dfa-eaf2-4f5b-b31a-644e4fbea390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:23.793094 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b3dfa-eaf2-4f5b-b31a-644e4fbea390 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:23.793372 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b3dfa-eaf2-4f5b-b31a-644e4fbea390 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:23.793643 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b3dfa-eaf2-4f5b-b31a-644e4fbea390 None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:23.794271 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b3dfa-eaf2-4f5b-b31a-644e4fbea390 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:23.794564 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b3dfa-eaf2-4f5b-b31a-644e4fbea390 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:23.796163 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b3dfa-eaf2-4f5b-b31a-644e4fbea390 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:23.802190 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 335/678] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Oct 24 13:01:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:23.809072 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9d614-433f-46f0-af51-4856fc68c72a None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:23.930160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9d614-433f-46f0-af51-4856fc68c72a None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:23.965338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adb143-f733-4ffb-86ee-ee25b85f7d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:23.965999 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adb143-f733-4ffb-86ee-ee25b85f7d34 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:23.966266 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adb143-f733-4ffb-86ee-ee25b85f7d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:23.966530 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adb143-f733-4ffb-86ee-ee25b85f7d34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:23.967194 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adb143-f733-4ffb-86ee-ee25b85f7d34 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:23.968575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adb143-f733-4ffb-86ee-ee25b85f7d34 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:23.991957 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 344/679] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:01:23 2022] POST /identity/v3/endpoints => generated 347 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:01:24.391946 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de604739-6a00-49b7-a05e-a1daacd8c561 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:24.392472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de604739-6a00-49b7-a05e-a1daacd8c561 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:24.392472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de604739-6a00-49b7-a05e-a1daacd8c561 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:24.394048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 336/680] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:24.399441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eab96c-bb53-4e71-8047-20cf051cce39 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:24.399735 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eab96c-bb53-4e71-8047-20cf051cce39 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:24.400008 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eab96c-bb53-4e71-8047-20cf051cce39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:24.418838 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b6eab96c-bb53-4e71-8047-20cf051cce39 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:24.420106 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b6eab96c-bb53-4e71-8047-20cf051cce39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:24.437881 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:24.497039 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 345/681] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:01:24.766758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de604739-6a00-49b7-a05e-a1daacd8c561 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:24.872097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de604739-6a00-49b7-a05e-a1daacd8c561 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:24.873564 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:24.907936 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ff890-1432-4ac2-af00-eebd8fc689ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:24.908557 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ff890-1432-4ac2-af00-eebd8fc689ae None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:24.908832 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ff890-1432-4ac2-af00-eebd8fc689ae None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:24.909099 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ff890-1432-4ac2-af00-eebd8fc689ae None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:24.919867 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ff890-1432-4ac2-af00-eebd8fc689ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:01:24.924690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-a16ff890-1432-4ac2-af00-eebd8fc689ae None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 13:01:24.924690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:24.924690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:24.924690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:24.924690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:24.924690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:24.924690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:24.924690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:24.924690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:24.924690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:24.924690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:24.924690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:24.924690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:01:24.924690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:01:24.924690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:01:24.924690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:01:24.925642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:01:24.925642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:01:24.925642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:01:24.925642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:01:24.925642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:24.925642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:24.925642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:24.925642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:24.925642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:24.925642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:24.925642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:24.925642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:24.925642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:24.925642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:24.925642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:24.925642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:24.926524 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:24.926524 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:24.926524 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:24.926524 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:24.926524 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:01:24.926524 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:01:24.926524 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:01:24.926524 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:01:24.926524 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:01:24.926524 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:01:24.926524 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 13:01:24.926524 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:24.926524 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 337/682] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Oct 24 13:01:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:24.932246 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eab96c-bb53-4e71-8047-20cf051cce39 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:25.033970 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eab96c-bb53-4e71-8047-20cf051cce39 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:25.069092 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56815ff-4836-4ca5-af23-74df2b206f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:25.069698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56815ff-4836-4ca5-af23-74df2b206f90 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:25.070080 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56815ff-4836-4ca5-af23-74df2b206f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:25.070352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56815ff-4836-4ca5-af23-74df2b206f90 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:25.071006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56815ff-4836-4ca5-af23-74df2b206f90 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:25.071301 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56815ff-4836-4ca5-af23-74df2b206f90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:25.072682 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56815ff-4836-4ca5-af23-74df2b206f90 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:25.081336 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 346/683] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Oct 24 13:01:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:25.092653 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ff890-1432-4ac2-af00-eebd8fc689ae None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:25.255446 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ff890-1432-4ac2-af00-eebd8fc689ae None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:25.327621 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327d4c9-41b6-4714-b972-67dc79b71cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:25.331438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327d4c9-41b6-4714-b972-67dc79b71cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:25.331438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327d4c9-41b6-4714-b972-67dc79b71cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:25.331438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327d4c9-41b6-4714-b972-67dc79b71cd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:25.357194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327d4c9-41b6-4714-b972-67dc79b71cd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:25.358669 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327d4c9-41b6-4714-b972-67dc79b71cd2 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:25.384796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-a327d4c9-41b6-4714-b972-67dc79b71cd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:25.384796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:25.384796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:25.384796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:25.384796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:25.384796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:25.384796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:25.384796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:25.384796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:25.384796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:25.384796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:25.384796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:25.384796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:25.384796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:25.384796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:25.384796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:25.385821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:25.385821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:25.385821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:25.385821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:25.385821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:25.385821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:25.385821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:25.385821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:25.385821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:25.385821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:25.385821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:25.385821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:25.385821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:25.385821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:25.385821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:25.385821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:25.385821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:25.386716 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:25.386716 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:25.386716 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:25.391712 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56815ff-4836-4ca5-af23-74df2b206f90 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:25.394340 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 338/684] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:25.423789 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:25.603528 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56815ff-4836-4ca5-af23-74df2b206f90 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:25.660268 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6804dad-c627-40d4-9d82-85696274f62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:25.661576 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6804dad-c627-40d4-9d82-85696274f62b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:25.661854 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6804dad-c627-40d4-9d82-85696274f62b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:25.662122 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6804dad-c627-40d4-9d82-85696274f62b None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:25.663299 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6804dad-c627-40d4-9d82-85696274f62b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:25.663624 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6804dad-c627-40d4-9d82-85696274f62b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:25.664981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6804dad-c627-40d4-9d82-85696274f62b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:25.690311 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 347/685] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:25.708248 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327d4c9-41b6-4714-b972-67dc79b71cd2 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:25.719706 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f512f-d027-4946-aba7-88da06beab4b None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:25.719998 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f512f-d027-4946-aba7-88da06beab4b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:25.723456 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f512f-d027-4946-aba7-88da06beab4b None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:25.724405 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 348/686] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:25.728129 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2917ce3-ad92-40c5-a1cf-f78a92296bbc None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:25.728417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2917ce3-ad92-40c5-a1cf-f78a92296bbc None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:25.728694 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2917ce3-ad92-40c5-a1cf-f78a92296bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:25.737149 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:25.761042 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d2917ce3-ad92-40c5-a1cf-f78a92296bbc None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:25.762248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d2917ce3-ad92-40c5-a1cf-f78a92296bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:25.831680 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:25.839668 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 349/687] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:25.847490 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327d4c9-41b6-4714-b972-67dc79b71cd2 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:25.884239 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68cacd-2e52-46e8-998e-94dda5a28475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:25.884789 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68cacd-2e52-46e8-998e-94dda5a28475 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:25.885059 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68cacd-2e52-46e8-998e-94dda5a28475 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:25.885333 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68cacd-2e52-46e8-998e-94dda5a28475 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:25.893280 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68cacd-2e52-46e8-998e-94dda5a28475 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:25.894817 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68cacd-2e52-46e8-998e-94dda5a28475 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:25.906586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-dd68cacd-2e52-46e8-998e-94dda5a28475 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 13:01:25.906586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:25.906586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:25.906586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:25.906586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:25.906586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:25.906586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:25.906586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:25.906586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:25.906586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:25.906586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:25.906586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:25.906586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:01:25.906586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:01:25.906586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:01:25.906586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:01:25.907811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:25.907811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:25.907811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:01:25.907811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:25.907811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:01:25.907811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:25.907811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:25.907811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:25.907811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:25.907811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:25.907811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:25.907811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:25.907811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:25.907811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:25.907811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:25.907811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:25.907811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:25.907811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:25.908811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:25.908811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:25.908811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:01:25.908811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:01:25.908811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:01:25.908811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:01:25.908811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:01:25.908811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:01:25.908811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 13:01:25.908811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:25.908811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 339/688] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Oct 24 13:01:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:25.914141 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2917ce3-ad92-40c5-a1cf-f78a92296bbc None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:26.023287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2917ce3-ad92-40c5-a1cf-f78a92296bbc None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:26.063479 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64bcdb-6c0f-44ae-ae0c-d789ff6fcd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:26.064088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64bcdb-6c0f-44ae-ae0c-d789ff6fcd6e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:26.064369 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64bcdb-6c0f-44ae-ae0c-d789ff6fcd6e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:26.064641 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64bcdb-6c0f-44ae-ae0c-d789ff6fcd6e None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:26.065365 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64bcdb-6c0f-44ae-ae0c-d789ff6fcd6e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:26.065670 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64bcdb-6c0f-44ae-ae0c-d789ff6fcd6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:26.067097 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64bcdb-6c0f-44ae-ae0c-d789ff6fcd6e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:26.085999 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 350/689] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Oct 24 13:01:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:26.091373 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68cacd-2e52-46e8-998e-94dda5a28475 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:26.117530 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64bcdb-6c0f-44ae-ae0c-d789ff6fcd6e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:26.176157 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:26.179790 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:26.204403 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68cacd-2e52-46e8-998e-94dda5a28475 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:26.228118 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64bcdb-6c0f-44ae-ae0c-d789ff6fcd6e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:26.240685 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b452cb-2074-406e-9f8e-8c66ef1ace29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:26.241566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b452cb-2074-406e-9f8e-8c66ef1ace29 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:26.242100 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b452cb-2074-406e-9f8e-8c66ef1ace29 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:26.242565 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b452cb-2074-406e-9f8e-8c66ef1ace29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:26.264849 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fdc4c8-7de3-4e21-8ba6-a32e9e86fae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:26.265502 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdc4c8-7de3-4e21-8ba6-a32e9e86fae4 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:26.265786 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdc4c8-7de3-4e21-8ba6-a32e9e86fae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:26.266060 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdc4c8-7de3-4e21-8ba6-a32e9e86fae4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:26.266652 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fdc4c8-7de3-4e21-8ba6-a32e9e86fae4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:26.268107 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fdc4c8-7de3-4e21-8ba6-a32e9e86fae4 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:26.281116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-75fdc4c8-7de3-4e21-8ba6-a32e9e86fae4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:01:26.281116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:26.281116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:01:26.281116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:01:26.281116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:01:26.281116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:01:26.281116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:01:26.281116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:26.281116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:01:26.281116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:26.281116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:26.281116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:26.281116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:26.281116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:26.281116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:26.281116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:26.281116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:26.282400 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:26.282400 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:26.282400 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:26.282400 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:26.282400 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:26.282400 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:26.282400 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:01:26.282400 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:01:26.282400 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:01:26.282400 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:01:26.282400 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:26.282400 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:26.282400 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:26.282400 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:26.282400 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:26.282400 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:26.283280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:26.283280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:26.283280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:26.283280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:26.283280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:26.283280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:26.283280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:26.283280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:26.283280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:26.283280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:26.283280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:01:26.283280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:26.283280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:01:26.283280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:26.283280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 351/690] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 24 13:01:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:01:26.284133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3110fb-7be0-4818-8414-22debca51648 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:26.284133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3110fb-7be0-4818-8414-22debca51648 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:26.284133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3110fb-7be0-4818-8414-22debca51648 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:26.285457 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 352/691] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:26.291071 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3110fb-7be0-4818-8414-22debca51648 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:26.328876 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b452cb-2074-406e-9f8e-8c66ef1ace29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:26.330332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b452cb-2074-406e-9f8e-8c66ef1ace29 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:26.400971 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3110fb-7be0-4818-8414-22debca51648 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:26.406304 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:26.424843 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:26.434811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 340/692] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:01:26 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 24 13:01:26.436086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a33cb-88be-4bed-aa93-4840a43d8d1e None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:26.436367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a33cb-88be-4bed-aa93-4840a43d8d1e None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:26.436637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a33cb-88be-4bed-aa93-4840a43d8d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:26.437177 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106f054-01f6-4403-b89b-3785db0b189a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:26.437809 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106f054-01f6-4403-b89b-3785db0b189a None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:26.438100 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106f054-01f6-4403-b89b-3785db0b189a None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:26.438366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106f054-01f6-4403-b89b-3785db0b189a None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:26.438980 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106f054-01f6-4403-b89b-3785db0b189a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:26.439324 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106f054-01f6-4403-b89b-3785db0b189a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:26.440678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106f054-01f6-4403-b89b-3785db0b189a None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:26.450719 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 353/693] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 24 13:01:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:26.450719 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73bde8-840c-4aeb-b5c1-238d56410396 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:26.450719 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73bde8-840c-4aeb-b5c1-238d56410396 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:26.450719 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73bde8-840c-4aeb-b5c1-238d56410396 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:26.450719 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 354/694] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:26.450719 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73bde8-840c-4aeb-b5c1-238d56410396 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:26.455712 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-6a0a33cb-88be-4bed-aa93-4840a43d8d1e None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:26.456883 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-6a0a33cb-88be-4bed-aa93-4840a43d8d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:26.524847 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 341/695] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:26.525679 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a33cb-88be-4bed-aa93-4840a43d8d1e None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:26.556386 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73bde8-840c-4aeb-b5c1-238d56410396 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:26.591450 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff670125-8225-4b1b-9066-23a3bedd2c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:26.592287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff670125-8225-4b1b-9066-23a3bedd2c00 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:26.592712 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff670125-8225-4b1b-9066-23a3bedd2c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:26.593163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff670125-8225-4b1b-9066-23a3bedd2c00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:26.604602 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff670125-8225-4b1b-9066-23a3bedd2c00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:26.606241 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff670125-8225-4b1b-9066-23a3bedd2c00 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:26.622163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-ff670125-8225-4b1b-9066-23a3bedd2c00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:26.622163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:26.622163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:26.622163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:26.622163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:26.622163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:26.622163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:26.622163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:26.622163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:26.622163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:26.622163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:26.622163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:26.622163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:26.622163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:26.622163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:26.622163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:26.623261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:26.623261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:26.623261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:26.623261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:26.623261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:26.623261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:26.623261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:26.623261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:26.623261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:26.623261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:26.623261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:26.623261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:26.623261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:26.623261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:26.623261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:26.623261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:26.623261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:26.624366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:26.624366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:26.624366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:26.625742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 355/696] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:26.626871 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da32051-a7ca-49f6-ab03-1e3854ca11c4 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:26.627170 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da32051-a7ca-49f6-ab03-1e3854ca11c4 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:26.627433 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da32051-a7ca-49f6-ab03-1e3854ca11c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:26.630810 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a33cb-88be-4bed-aa93-4840a43d8d1e None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:26.634128 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:26.647943 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-8da32051-a7ca-49f6-ab03-1e3854ca11c4 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:26.649130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8da32051-a7ca-49f6-ab03-1e3854ca11c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:26.667308 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9822132-6abc-4776-871f-9c59f25b98f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:26.667929 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9822132-6abc-4776-871f-9c59f25b98f9 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:26.668203 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9822132-6abc-4776-871f-9c59f25b98f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:26.668460 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9822132-6abc-4776-871f-9c59f25b98f9 None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:26.669080 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9822132-6abc-4776-871f-9c59f25b98f9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:26.669376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9822132-6abc-4776-871f-9c59f25b98f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:26.670749 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9822132-6abc-4776-871f-9c59f25b98f9 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:26.675689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 342/697] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 24 13:01:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:26.676662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9822132-6abc-4776-871f-9c59f25b98f9 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:26.687310 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:26.731550 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 356/698] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:26.732407 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da32051-a7ca-49f6-ab03-1e3854ca11c4 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:26.803007 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9822132-6abc-4776-871f-9c59f25b98f9 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:26.839501 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f965b8-9df0-4426-9a4e-d72b103f369b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:26.840102 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f965b8-9df0-4426-9a4e-d72b103f369b None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:26.840380 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f965b8-9df0-4426-9a4e-d72b103f369b None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:26.840713 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f965b8-9df0-4426-9a4e-d72b103f369b None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:26.841356 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f965b8-9df0-4426-9a4e-d72b103f369b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:26.841651 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f965b8-9df0-4426-9a4e-d72b103f369b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:26.843022 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f965b8-9df0-4426-9a4e-d72b103f369b None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:26.859456 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 343/699] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:26.859456 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f965b8-9df0-4426-9a4e-d72b103f369b None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:26.866368 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da32051-a7ca-49f6-ab03-1e3854ca11c4 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:26.889091 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:26.902843 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efb6ef-f419-4837-963e-3ddb26f88bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:26.903488 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efb6ef-f419-4837-963e-3ddb26f88bfb None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:26.903759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efb6ef-f419-4837-963e-3ddb26f88bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:26.904033 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efb6ef-f419-4837-963e-3ddb26f88bfb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:26.904730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efb6ef-f419-4837-963e-3ddb26f88bfb None admin] RBAC: Adding query filter params (interface=public, service_id=e03faa332e594229a6e5f8e891a14330, region_id=RegionOne) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:26.905037 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efb6ef-f419-4837-963e-3ddb26f88bfb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:26.906407 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efb6ef-f419-4837-963e-3ddb26f88bfb None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:26.917462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 357/700] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Oct 24 13:01:26 2022] GET /identity/v3/endpoints?service_id=e03faa332e594229a6e5f8e891a14330&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:26.917462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efb6ef-f419-4837-963e-3ddb26f88bfb None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:26.951446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:26.970057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f965b8-9df0-4426-9a4e-d72b103f369b None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:27.006326 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ac259-accd-450b-8a26-98f0b09b6540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:27.006954 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ac259-accd-450b-8a26-98f0b09b6540 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:27.007236 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ac259-accd-450b-8a26-98f0b09b6540 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:27.007542 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ac259-accd-450b-8a26-98f0b09b6540 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:27.008127 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ac259-accd-450b-8a26-98f0b09b6540 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:27.009523 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ac259-accd-450b-8a26-98f0b09b6540 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:27.018246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-b36ac259-accd-450b-8a26-98f0b09b6540 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:01:27.018246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:27.018246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:01:27.018246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:01:27.018246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:01:27.018246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:01:27.018246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:01:27.018246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:27.018246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:01:27.018246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:27.018246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:27.018246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:27.018246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:27.018246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:27.018246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:27.018246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:27.018246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:27.019243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:27.019243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:27.019243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:27.019243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:27.019243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:27.019243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:27.019243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:01:27.019243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:01:27.019243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:01:27.019243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:01:27.019243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:27.019243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:27.019243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:27.019243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:27.019243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:27.019243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:27.020782 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:27.020782 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:27.020782 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:27.020782 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:27.020782 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:27.020782 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:27.020782 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:27.020782 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:27.020782 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:27.020782 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:27.020782 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:01:27.020782 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:27.020782 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:01:27.020782 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:27.020782 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 344/701] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Oct 24 13:01:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:27.021718 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ac259-accd-450b-8a26-98f0b09b6540 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:27.028723 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efb6ef-f419-4837-963e-3ddb26f88bfb None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:27.062476 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c984152-0cc6-474b-888e-581fc5ce7bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:27.063101 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c984152-0cc6-474b-888e-581fc5ce7bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:27.063379 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c984152-0cc6-474b-888e-581fc5ce7bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:27.063685 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c984152-0cc6-474b-888e-581fc5ce7bd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:27.070716 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c984152-0cc6-474b-888e-581fc5ce7bd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:27.072261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c984152-0cc6-474b-888e-581fc5ce7bd7 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:27.083462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-7c984152-0cc6-474b-888e-581fc5ce7bd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:27.083462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:27.083462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:27.083462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:27.083462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:27.083462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:27.083462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:27.083462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:27.083462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:27.083462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:27.083462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:27.083462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:27.083462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:01:27.083462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:01:27.083462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:01:27.084991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:01:27.084991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:27.084991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:27.084991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:27.084991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:27.084991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:27.084991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:27.084991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:27.084991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:27.084991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:27.084991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:27.084991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:27.084991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:27.084991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:27.084991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:27.084991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:27.084991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:27.085947 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:01:27.085947 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:01:27.085947 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:01:27.085947 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:01:27.085947 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:01:27.085947 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:01:27.085947 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:27.085947 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:27.085947 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 358/702] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:01:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:27.086455 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c984152-0cc6-474b-888e-581fc5ce7bd7 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:27.115278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:27.124318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ac259-accd-450b-8a26-98f0b09b6540 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:27.157663 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de2535-b2fd-4202-9a01-da6bcebe58b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:27.158255 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de2535-b2fd-4202-9a01-da6bcebe58b0 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:27.158534 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de2535-b2fd-4202-9a01-da6bcebe58b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:27.158804 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de2535-b2fd-4202-9a01-da6bcebe58b0 None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:27.159401 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de2535-b2fd-4202-9a01-da6bcebe58b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:27.160846 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de2535-b2fd-4202-9a01-da6bcebe58b0 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:27.167613 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 345/703] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Oct 24 13:01:27 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:01:27.168384 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de2535-b2fd-4202-9a01-da6bcebe58b0 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:27.179549 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:27.189682 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c984152-0cc6-474b-888e-581fc5ce7bd7 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:27.227985 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe28ee9-42b7-4b99-a364-5942a6aa13f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:27.228555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe28ee9-42b7-4b99-a364-5942a6aa13f7 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:27.228839 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe28ee9-42b7-4b99-a364-5942a6aa13f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:27.229112 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe28ee9-42b7-4b99-a364-5942a6aa13f7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:27.229714 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe28ee9-42b7-4b99-a364-5942a6aa13f7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:27.231148 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe28ee9-42b7-4b99-a364-5942a6aa13f7 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:27.241616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-5fe28ee9-42b7-4b99-a364-5942a6aa13f7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:01:27.241616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:27.241616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:01:27.241616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:01:27.241616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:01:27.241616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:01:27.241616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:01:27.241616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:27.241616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:01:27.241616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:27.241616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:27.241616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:27.241616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:27.241616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:27.241616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:27.241616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:27.241616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:27.242760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:27.242760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:27.242760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:27.242760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:27.242760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:27.242760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:27.242760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:01:27.242760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:01:27.242760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:01:27.242760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:01:27.242760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:27.242760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:27.242760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:27.242760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:27.242760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:27.242760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:27.243673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:27.243673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:27.243673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:27.243673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:27.243673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:27.243673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:27.243673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:27.243673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:27.243673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:27.243673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:27.243673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:01:27.243673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:27.243673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:01:27.243673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:27.243673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 359/704] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:01:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:27.244977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe28ee9-42b7-4b99-a364-5942a6aa13f7 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:27.300533 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de2535-b2fd-4202-9a01-da6bcebe58b0 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:27.338043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04b101-fd6e-4abe-8156-156052a74ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:27.338654 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04b101-fd6e-4abe-8156-156052a74ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:27.338929 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04b101-fd6e-4abe-8156-156052a74ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:27.339197 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04b101-fd6e-4abe-8156-156052a74ee9 None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:27.340065 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04b101-fd6e-4abe-8156-156052a74ee9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:27.340173 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04b101-fd6e-4abe-8156-156052a74ee9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:27.341518 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04b101-fd6e-4abe-8156-156052a74ee9 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:27.353256 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 346/705] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Oct 24 13:01:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:27.353256 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04b101-fd6e-4abe-8156-156052a74ee9 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:27.363838 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe28ee9-42b7-4b99-a364-5942a6aa13f7 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:27.377316 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:27.402786 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487c93b-2d5c-44a6-9477-94a6c527d830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:27.403388 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487c93b-2d5c-44a6-9477-94a6c527d830 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:27.403707 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487c93b-2d5c-44a6-9477-94a6c527d830 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:27.403981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487c93b-2d5c-44a6-9477-94a6c527d830 None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:27.404670 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487c93b-2d5c-44a6-9477-94a6c527d830 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:27.404972 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487c93b-2d5c-44a6-9477-94a6c527d830 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:27.406400 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487c93b-2d5c-44a6-9477-94a6c527d830 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:27.418213 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 360/706] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 24 13:01:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:27.419368 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487c93b-2d5c-44a6-9477-94a6c527d830 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:27.440911 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:27.468509 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04b101-fd6e-4abe-8156-156052a74ee9 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:27.509550 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cd7f1-52b4-4568-bec1-035f671851a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:27.510105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cd7f1-52b4-4568-bec1-035f671851a4 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:27.510536 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cd7f1-52b4-4568-bec1-035f671851a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:27.510726 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cd7f1-52b4-4568-bec1-035f671851a4 None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:27.511390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183cd7f1-52b4-4568-bec1-035f671851a4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:27.511671 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183cd7f1-52b4-4568-bec1-035f671851a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:27.513170 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183cd7f1-52b4-4568-bec1-035f671851a4 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:27.524406 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 347/707] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 24 13:01:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:27.525271 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cd7f1-52b4-4568-bec1-035f671851a4 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:27.544871 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487c93b-2d5c-44a6-9477-94a6c527d830 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:27.582588 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b30241-fce7-48ae-93a5-dec8f5170163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:27.583190 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b30241-fce7-48ae-93a5-dec8f5170163 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:27.583545 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b30241-fce7-48ae-93a5-dec8f5170163 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:27.583760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b30241-fce7-48ae-93a5-dec8f5170163 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:27.585074 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b30241-fce7-48ae-93a5-dec8f5170163 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:27.585252 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b30241-fce7-48ae-93a5-dec8f5170163 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:27.586579 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b30241-fce7-48ae-93a5-dec8f5170163 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:27.592070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 361/708] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Oct 24 13:01:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:27.592674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b30241-fce7-48ae-93a5-dec8f5170163 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:27.630768 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:27.648334 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cd7f1-52b4-4568-bec1-035f671851a4 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:27.677306 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:27.688601 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f5e94-896e-4ec9-91d1-760a913e70c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:27.689208 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f5e94-896e-4ec9-91d1-760a913e70c1 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:27.689678 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f5e94-896e-4ec9-91d1-760a913e70c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:27.689812 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f5e94-896e-4ec9-91d1-760a913e70c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:27.690455 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f5e94-896e-4ec9-91d1-760a913e70c1 None admin] RBAC: Adding query filter params (role.id=b16a8ec40d5545828c8c459f737209de, scope.project.id=f230a12ca6234faabf984e4a58a0d2e8, user.id=f3254b4fddaa4f099c6c44f4c139ee5e) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:27.690761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f5e94-896e-4ec9-91d1-760a913e70c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:27.692224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f5e94-896e-4ec9-91d1-760a913e70c1 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:27.699339 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b30241-fce7-48ae-93a5-dec8f5170163 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:27.707839 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 348/709] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:01:27 2022] GET /identity/v3/role_assignments?user.id=f3254b4fddaa4f099c6c44f4c139ee5e&scope.project.id=f230a12ca6234faabf984e4a58a0d2e8&role.id=b16a8ec40d5545828c8c459f737209de => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:27.710237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f5e94-896e-4ec9-91d1-760a913e70c1 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:27.741144 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f281e-800e-4443-bbda-82932244386a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:27.742025 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f281e-800e-4443-bbda-82932244386a None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:27.742304 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f281e-800e-4443-bbda-82932244386a None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:27.742577 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f281e-800e-4443-bbda-82932244386a None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:27.743218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f281e-800e-4443-bbda-82932244386a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:27.743550 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f281e-800e-4443-bbda-82932244386a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:27.744943 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f281e-800e-4443-bbda-82932244386a None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:27.760042 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 362/710] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 24 13:01:27 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:27.845849 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f5e94-896e-4ec9-91d1-760a913e70c1 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:27.888106 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbc21f-df57-4dd8-af8a-fffedf2c9765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:27.889100 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbc21f-df57-4dd8-af8a-fffedf2c9765 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:27.889575 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbc21f-df57-4dd8-af8a-fffedf2c9765 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:27.890258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbc21f-df57-4dd8-af8a-fffedf2c9765 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:27.891297 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbc21f-df57-4dd8-af8a-fffedf2c9765 None admin] RBAC: Adding query filter params (interface=public, service_id=56b9eb4880da46edbc65d0c93e0a8d2e, region_id=RegionOne) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:27.891852 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbc21f-df57-4dd8-af8a-fffedf2c9765 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:27.893484 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbc21f-df57-4dd8-af8a-fffedf2c9765 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:27.901143 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 349/711] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Oct 24 13:01:27 2022] GET /identity/v3/endpoints?service_id=56b9eb4880da46edbc65d0c93e0a8d2e&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:27.907465 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f281e-800e-4443-bbda-82932244386a None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:28.016637 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f281e-800e-4443-bbda-82932244386a None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:28.050828 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34f6aa-64e3-448f-934b-c7407160582f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:28.051479 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34f6aa-64e3-448f-934b-c7407160582f None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:28.051801 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34f6aa-64e3-448f-934b-c7407160582f None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:28.052069 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34f6aa-64e3-448f-934b-c7407160582f None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:28.052664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34f6aa-64e3-448f-934b-c7407160582f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:28.054089 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34f6aa-64e3-448f-934b-c7407160582f None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:28.060659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 363/712] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Oct 24 13:01:27 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:01:29.384413 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50963f6-8ee8-4b23-ac30-77b4197a5381 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:29.385049 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50963f6-8ee8-4b23-ac30-77b4197a5381 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:29.385049 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50963f6-8ee8-4b23-ac30-77b4197a5381 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:29.386511 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 350/713] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:29.391938 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe1267-1ecc-4ceb-94b2-30ce5ff94457 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:29.392340 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe1267-1ecc-4ceb-94b2-30ce5ff94457 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:29.392518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe1267-1ecc-4ceb-94b2-30ce5ff94457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:29.410836 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-defe1267-1ecc-4ceb-94b2-30ce5ff94457 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:29.412067 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-defe1267-1ecc-4ceb-94b2-30ce5ff94457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:29.414674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:29.484843 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 364/714] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:29.769590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50963f6-8ee8-4b23-ac30-77b4197a5381 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:29.786774 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:29.889836 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50963f6-8ee8-4b23-ac30-77b4197a5381 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:29.926020 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de782571-07d9-4893-b9da-e10146bc3379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:29.926646 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de782571-07d9-4893-b9da-e10146bc3379 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:29.926924 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de782571-07d9-4893-b9da-e10146bc3379 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:29.927197 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de782571-07d9-4893-b9da-e10146bc3379 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:29.927836 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de782571-07d9-4893-b9da-e10146bc3379 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:29.929962 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de782571-07d9-4893-b9da-e10146bc3379 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:29.939166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-de782571-07d9-4893-b9da-e10146bc3379 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:01:29.939166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:29.939166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:01:29.939166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:01:29.939166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:01:29.939166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:01:29.939166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:01:29.939166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:29.939166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:01:29.939166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:29.939166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:29.939166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:29.939166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:29.939166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:29.939166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:29.939166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:29.939166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:29.940216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:29.940216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:29.940216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:29.940216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:29.940216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:29.940216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:29.940216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:01:29.940216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:01:29.940216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:01:29.940216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:01:29.940216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:29.940216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:29.940216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:29.940216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:29.940216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:29.940216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:29.941088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:29.941088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:29.941088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:29.941088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:29.941088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:29.941088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:29.941088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:29.941088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:29.941088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:29.941088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:29.941088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:01:29.941088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:29.941088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:01:29.941088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:29.941088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 351/715] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 24 13:01:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:29.949370 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe1267-1ecc-4ceb-94b2-30ce5ff94457 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:29.969603 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cba6e4-3f2b-4c0e-9a78-d4d7e70c52b2 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:29.970220 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cba6e4-3f2b-4c0e-9a78-d4d7e70c52b2 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:29.970510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cba6e4-3f2b-4c0e-9a78-d4d7e70c52b2 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:29.972226 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 352/716] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:29.978019 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cd38f-f1c2-4488-8a4f-c0e294318785 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:29.978350 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cd38f-f1c2-4488-8a4f-c0e294318785 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:29.978569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cd38f-f1c2-4488-8a4f-c0e294318785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:30.002172 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-9f4cd38f-f1c2-4488-8a4f-c0e294318785 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:30.003448 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-9f4cd38f-f1c2-4488-8a4f-c0e294318785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:30.080861 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 353/717] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:30.082198 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe1267-1ecc-4ceb-94b2-30ce5ff94457 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:30.099305 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05a261-3f5f-494b-a028-627175a545a0 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:30.100131 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05a261-3f5f-494b-a028-627175a545a0 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:30.100909 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05a261-3f5f-494b-a028-627175a545a0 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:30.102793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 354/718] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:01:30.109593 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84171723-6d94-4c98-9530-bf52379107ee None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:30.110188 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84171723-6d94-4c98-9530-bf52379107ee None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:30.110658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84171723-6d94-4c98-9530-bf52379107ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:30.128427 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:30.133789 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-84171723-6d94-4c98-9530-bf52379107ee None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:30.134187 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff1048-59ad-4e47-8360-ca5a28417fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:30.134829 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff1048-59ad-4e47-8360-ca5a28417fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:30.135109 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff1048-59ad-4e47-8360-ca5a28417fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:30.135383 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff1048-59ad-4e47-8360-ca5a28417fc4 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:30.136080 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff1048-59ad-4e47-8360-ca5a28417fc4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:30.136383 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff1048-59ad-4e47-8360-ca5a28417fc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:30.136842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-84171723-6d94-4c98-9530-bf52379107ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:30.137816 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff1048-59ad-4e47-8360-ca5a28417fc4 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:30.144041 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 365/719] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 24 13:01:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:30.153218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff1048-59ad-4e47-8360-ca5a28417fc4 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:30.154995 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:30.220500 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 355/720] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:01:30.249315 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5bef3-130b-47f2-8f0d-190b0d97b687 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:30.249592 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5bef3-130b-47f2-8f0d-190b0d97b687 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:30.249865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5bef3-130b-47f2-8f0d-190b0d97b687 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:30.255114 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 356/721] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:01:30.256888 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348b2e9-b7f2-4b01-8f4d-bc0471b412f7 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:30.257306 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348b2e9-b7f2-4b01-8f4d-bc0471b412f7 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:30.257775 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348b2e9-b7f2-4b01-8f4d-bc0471b412f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:30.272352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff1048-59ad-4e47-8360-ca5a28417fc4 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:30.276762 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-5348b2e9-b7f2-4b01-8f4d-bc0471b412f7 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:30.277925 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-5348b2e9-b7f2-4b01-8f4d-bc0471b412f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:30.314675 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ace22-a267-4922-acd9-e7d6a910f4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:30.315288 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ace22-a267-4922-acd9-e7d6a910f4a6 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:30.315596 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ace22-a267-4922-acd9-e7d6a910f4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:30.315870 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ace22-a267-4922-acd9-e7d6a910f4a6 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:30.316495 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ace22-a267-4922-acd9-e7d6a910f4a6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:30.316794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ace22-a267-4922-acd9-e7d6a910f4a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:30.318153 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ace22-a267-4922-acd9-e7d6a910f4a6 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:30.328951 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 366/722] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 24 13:01:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:30.329917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ace22-a267-4922-acd9-e7d6a910f4a6 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:30.371559 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 357/723] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:30.378781 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348b2e9-b7f2-4b01-8f4d-bc0471b412f7 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:30.410100 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:30.454960 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ace22-a267-4922-acd9-e7d6a910f4a6 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:30.455653 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:30.496957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348b2e9-b7f2-4b01-8f4d-bc0471b412f7 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:30.506965 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b31a0-d8f1-4868-9c73-a7bbe2d7ec88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:30.508027 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b31a0-d8f1-4868-9c73-a7bbe2d7ec88 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:30.508309 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b31a0-d8f1-4868-9c73-a7bbe2d7ec88 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:30.508580 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b31a0-d8f1-4868-9c73-a7bbe2d7ec88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:30.509587 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b31a0-d8f1-4868-9c73-a7bbe2d7ec88 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:30.510936 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b31a0-d8f1-4868-9c73-a7bbe2d7ec88 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:30.531543 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 367/724] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:01:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:01:30.540489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b31a0-d8f1-4868-9c73-a7bbe2d7ec88 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:30.546266 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2319a62-5770-42f7-aeba-dd95a6dbe268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:30.547306 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2319a62-5770-42f7-aeba-dd95a6dbe268 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:30.547882 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2319a62-5770-42f7-aeba-dd95a6dbe268 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:30.548357 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2319a62-5770-42f7-aeba-dd95a6dbe268 None admin] PATH_INFO: `/v3/services/image` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:30.549228 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2319a62-5770-42f7-aeba-dd95a6dbe268 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:30.551716 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2319a62-5770-42f7-aeba-dd95a6dbe268 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:30.566441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-a2319a62-5770-42f7-aeba-dd95a6dbe268 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:01:30.566441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:30.566441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:01:30.566441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:01:30.566441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:01:30.566441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:01:30.566441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:01:30.566441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:30.566441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:01:30.566441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:30.566441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:30.566441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:30.566441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:30.566441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:30.566441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:30.566441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:30.566441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:30.567574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:30.567574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:30.567574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:30.567574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:30.567574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:30.567574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:30.567574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:01:30.567574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:01:30.567574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:01:30.567574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:01:30.567574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:30.567574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:30.567574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:30.567574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:30.567574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:30.567574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:30.568444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:30.568444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:30.568444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:30.568444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:30.568444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:30.568444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:30.568444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:30.568444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:30.568444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:30.568444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:30.568444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:01:30.568444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:30.568444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:01:30.568444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:30.575628 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 358/725] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Oct 24 13:01:30 2022] GET /identity/v3/services/image => generated 86 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:01:30.577314 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2319a62-5770-42f7-aeba-dd95a6dbe268 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:30.677812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b31a0-d8f1-4868-9c73-a7bbe2d7ec88 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:30.703866 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2319a62-5770-42f7-aeba-dd95a6dbe268 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:30.704456 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:30.720093 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbf062-ac5b-470c-abfc-35220811d936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:30.721000 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbf062-ac5b-470c-abfc-35220811d936 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:30.721791 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbf062-ac5b-470c-abfc-35220811d936 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:30.721791 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbf062-ac5b-470c-abfc-35220811d936 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:30.722272 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbf062-ac5b-470c-abfc-35220811d936 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:30.723666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbf062-ac5b-470c-abfc-35220811d936 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:30.733366 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:30.743509 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 368/726] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 24 13:01:30 2022] POST /identity/v3/services => generated 242 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:01:30.744520 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbf062-ac5b-470c-abfc-35220811d936 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:30.752035 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813db0a9-99d8-4616-b1bf-5977c87f8e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:30.752694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813db0a9-99d8-4616-b1bf-5977c87f8e8c None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:30.752975 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813db0a9-99d8-4616-b1bf-5977c87f8e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:30.753317 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813db0a9-99d8-4616-b1bf-5977c87f8e8c None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:30.753999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813db0a9-99d8-4616-b1bf-5977c87f8e8c None admin] RBAC: Adding query filter params (name=image) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:30.754319 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813db0a9-99d8-4616-b1bf-5977c87f8e8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:30.756846 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813db0a9-99d8-4616-b1bf-5977c87f8e8c None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:30.762359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 359/727] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:30.768494 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813db0a9-99d8-4616-b1bf-5977c87f8e8c None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:30.885961 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbf062-ac5b-470c-abfc-35220811d936 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:30.916793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813db0a9-99d8-4616-b1bf-5977c87f8e8c None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:30.933778 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcf7a2-b7a6-47fa-8c52-53f7e3210356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:30.935991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcf7a2-b7a6-47fa-8c52-53f7e3210356 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:30.936272 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcf7a2-b7a6-47fa-8c52-53f7e3210356 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:30.936541 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcf7a2-b7a6-47fa-8c52-53f7e3210356 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:30.937123 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcf7a2-b7a6-47fa-8c52-53f7e3210356 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:30.938489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcf7a2-b7a6-47fa-8c52-53f7e3210356 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:30.951193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-f8bcf7a2-b7a6-47fa-8c52-53f7e3210356 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:01:30.951193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:30.951193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:01:30.951193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:01:30.951193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:01:30.951193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:01:30.951193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:01:30.951193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:30.951193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:01:30.951193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:30.951193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:30.951193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:30.951193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:30.951193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:30.951193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:30.951193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:30.951193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:30.952255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:30.952255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:30.952255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:30.952255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:30.952255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:30.952255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:30.952255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:01:30.952255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:01:30.952255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:01:30.952255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:01:30.952255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:30.952255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:30.952255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:30.952255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:30.952255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:30.952255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:30.954593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:30.954593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:30.954593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:30.954593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:30.954593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:30.954593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:30.954593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:30.954593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:30.954593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:30.954593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:30.954593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:01:30.954593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:30.954593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:01:30.954593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:30.954593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 369/728] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Oct 24 13:01:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:30.962008 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcf7a2-b7a6-47fa-8c52-53f7e3210356 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:30.964428 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3f01d-50b7-47d9-8cfe-c7e26e4c5e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:30.965231 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3f01d-50b7-47d9-8cfe-c7e26e4c5e07 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:30.965506 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3f01d-50b7-47d9-8cfe-c7e26e4c5e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:30.965771 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3f01d-50b7-47d9-8cfe-c7e26e4c5e07 None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:30.966393 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3f01d-50b7-47d9-8cfe-c7e26e4c5e07 None admin] RBAC: Adding query filter params (type=image) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:30.966687 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3f01d-50b7-47d9-8cfe-c7e26e4c5e07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:30.968141 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3f01d-50b7-47d9-8cfe-c7e26e4c5e07 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:30.975533 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 360/729] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:30 2022] GET /identity/v3/services?type=image => generated 122 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:31.039291 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:31.083121 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcf7a2-b7a6-47fa-8c52-53f7e3210356 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:31.124619 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19a773-3fc7-4154-ae6a-deef3d2992ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:31.125417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19a773-3fc7-4154-ae6a-deef3d2992ed None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:31.125796 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19a773-3fc7-4154-ae6a-deef3d2992ed None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:31.126241 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19a773-3fc7-4154-ae6a-deef3d2992ed None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:31.126996 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19a773-3fc7-4154-ae6a-deef3d2992ed None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:31.127399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19a773-3fc7-4154-ae6a-deef3d2992ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:31.128946 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19a773-3fc7-4154-ae6a-deef3d2992ed None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:31.135741 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 370/730] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Oct 24 13:01:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:31.142051 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3f01d-50b7-47d9-8cfe-c7e26e4c5e07 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:31.197044 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:31.250689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3f01d-50b7-47d9-8cfe-c7e26e4c5e07 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:31.286577 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43297b-9e9e-4026-86ed-061861863181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:31.287210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43297b-9e9e-4026-86ed-061861863181 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:31.287560 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43297b-9e9e-4026-86ed-061861863181 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:31.287903 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43297b-9e9e-4026-86ed-061861863181 None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:31.288638 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef43297b-9e9e-4026-86ed-061861863181 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:31.288935 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef43297b-9e9e-4026-86ed-061861863181 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:31.290299 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef43297b-9e9e-4026-86ed-061861863181 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:31.295881 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 361/731] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Oct 24 13:01:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:31.301402 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19a773-3fc7-4154-ae6a-deef3d2992ed None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:31.410235 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19a773-3fc7-4154-ae6a-deef3d2992ed None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:31.422327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:31.446550 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1a867-f76b-4cd2-b42f-6103150d9e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:31.447265 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1a867-f76b-4cd2-b42f-6103150d9e12 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:31.447513 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1a867-f76b-4cd2-b42f-6103150d9e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:31.448076 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1a867-f76b-4cd2-b42f-6103150d9e12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:31.448753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1a867-f76b-4cd2-b42f-6103150d9e12 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:31.450249 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1a867-f76b-4cd2-b42f-6103150d9e12 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:31.476992 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 371/732] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:01:31 2022] POST /identity/v3/endpoints => generated 349 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:01:32.870056 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bbbfb-bd60-4399-add6-6456a3f7b87b None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:32.870554 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bbbfb-bd60-4399-add6-6456a3f7b87b None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:32.870554 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bbbfb-bd60-4399-add6-6456a3f7b87b None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:32.872115 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 362/733] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:32.877351 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4ead0-7dfc-422a-9cbb-d2d5ebf6cf3f None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:32.877742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4ead0-7dfc-422a-9cbb-d2d5ebf6cf3f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:32.877881 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4ead0-7dfc-422a-9cbb-d2d5ebf6cf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:32.897690 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-72b4ead0-7dfc-422a-9cbb-d2d5ebf6cf3f None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:32.898872 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-72b4ead0-7dfc-422a-9cbb-d2d5ebf6cf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:32.976728 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 372/734] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:33.093523 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f5764-5a4f-4162-bed1-f51e7960223d None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:33.093849 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f5764-5a4f-4162-bed1-f51e7960223d None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:33.094065 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f5764-5a4f-4162-bed1-f51e7960223d None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:33.095707 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 363/735] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:33.101681 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96b4cb-c792-4f71-910f-723a99fac107 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:33.101966 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96b4cb-c792-4f71-910f-723a99fac107 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:33.102241 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96b4cb-c792-4f71-910f-723a99fac107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:33.121156 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-9b96b4cb-c792-4f71-910f-723a99fac107 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:33.122252 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9b96b4cb-c792-4f71-910f-723a99fac107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:33.195539 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 373/736] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:33.269084 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f5764-5a4f-4162-bed1-f51e7960223d None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:33.376485 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f5764-5a4f-4162-bed1-f51e7960223d None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:33.391614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:33.415000 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493516a-7a29-41c0-a2b0-259800e51e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:33.416041 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493516a-7a29-41c0-a2b0-259800e51e85 None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:33.416517 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493516a-7a29-41c0-a2b0-259800e51e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:33.416978 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493516a-7a29-41c0-a2b0-259800e51e85 None admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:33.417836 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493516a-7a29-41c0-a2b0-259800e51e85 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:33.419614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493516a-7a29-41c0-a2b0-259800e51e85 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:33.422552 dv-cinder-862491-1-smb devstack@keystone.service[81600]: WARNING keystone.server.flask.common [None req-d493516a-7a29-41c0-a2b0-259800e51e85 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 24 13:01:33.444571 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.sql.core [None req-d493516a-7a29-41c0-a2b0-259800e51e85 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 24 13:01:33.444571 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 13:01:33.444571 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [parameters: {'id': '93ff9893e7e44539bda4970bcafa316a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 24 13:01:33.444571 dv-cinder-862491-1-smb devstack@keystone.service[81600]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81600) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 13:01:33.451835 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-d493516a-7a29-41c0-a2b0-259800e51e85 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 93ff9893e7e44539bda4970bcafa316a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 93ff9893e7e44539bda4970bcafa316a. Oct 24 13:01:33.451835 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:33.451835 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 13:01:33.451835 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 13:01:33.451835 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 13:01:33.451835 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 13:01:33.451835 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 13:01:33.451835 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 13:01:33.451835 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 13:01:33.451835 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application conn.query(q) Oct 24 13:01:33.451835 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 13:01:33.451835 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 13:01:33.451835 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 13:01:33.452635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application result.read() Oct 24 13:01:33.452635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 13:01:33.452635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 13:01:33.452635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 13:01:33.452635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 13:01:33.452635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 13:01:33.452635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 13:01:33.452635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 13:01:33.452635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 13:01:33.452635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 24 13:01:33.452635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:33.452635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 13:01:33.452635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:33.452635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:33.452635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 13:01:33.452635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 13:01:33.452635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 24 13:01:33.452635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 24 13:01:33.453624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 13:01:33.453624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application next(self.gen) Oct 24 13:01:33.453624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 13:01:33.453624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application yield resource Oct 24 13:01:33.453624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 13:01:33.453624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application next(self.gen) Oct 24 13:01:33.453624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 13:01:33.453624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 13:01:33.453624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 13:01:33.453624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 13:01:33.453624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 13:01:33.453624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise self.value Oct 24 13:01:33.453624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 13:01:33.453624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 13:01:33.453624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 13:01:33.453624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application session.commit() Oct 24 13:01:33.453624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 13:01:33.454520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 13:01:33.454520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 13:01:33.454520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 13:01:33.454520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 13:01:33.454520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self.session.flush() Oct 24 13:01:33.454520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 13:01:33.454520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 13:01:33.454520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 13:01:33.454520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 13:01:33.454520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 13:01:33.454520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application compat.raise_( Oct 24 13:01:33.454520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 13:01:33.454520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception Oct 24 13:01:33.454520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 13:01:33.454520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 13:01:33.454520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 13:01:33.454520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 13:01:33.455402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 13:01:33.455402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 13:01:33.455402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 13:01:33.455402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 13:01:33.455402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 24 13:01:33.455402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 24 13:01:33.455402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 13:01:33.455402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 13:01:33.455402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 13:01:33.455402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 13:01:33.455402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 13:01:33.455402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 13:01:33.455402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 13:01:33.455402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 13:01:33.455402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 13:01:33.457502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 13:01:33.457502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 13:01:33.457502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception Oct 24 13:01:33.457502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 13:01:33.457502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 13:01:33.457502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 13:01:33.457502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 13:01:33.457502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 13:01:33.457502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 13:01:33.457502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 13:01:33.457502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application conn.query(q) Oct 24 13:01:33.457502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 13:01:33.457502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 13:01:33.457502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 13:01:33.457502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application result.read() Oct 24 13:01:33.457502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 13:01:33.457502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 13:01:33.460735 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 13:01:33.460735 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 13:01:33.460735 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 13:01:33.460735 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 13:01:33.460735 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 13:01:33.460735 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 13:01:33.460735 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 24 13:01:33.460735 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 13:01:33.460735 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [parameters: {'id': '93ff9893e7e44539bda4970bcafa316a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 24 13:01:33.460735 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 13:01:33.460735 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:33.460735 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:33.460735 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:33.460735 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:33.460735 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 24 13:01:33.462689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 24 13:01:33.462689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 13:01:33.462689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 13:01:33.462689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 24 13:01:33.462689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:33.462689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:33.462689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:33.462689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:33.462689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:33.462689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:33.462689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:33.462689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:33.462689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:33.462689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:33.462689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:33.462689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:33.462689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:33.465696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:33.465696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 24 13:01:33.465696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 24 13:01:33.465696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:33.465696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:33.465696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 24 13:01:33.465696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 24 13:01:33.465696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 93ff9893e7e44539bda4970bcafa316a. Oct 24 13:01:33.465696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:33.465696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 364/737] 10.222.0.18 () {60 vars in 1140 bytes} [Mon Oct 24 13:01:33 2022] POST /identity/v3/projects => generated 262 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:33.466994 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96b4cb-c792-4f71-910f-723a99fac107 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:33.486353 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493516a-7a29-41c0-a2b0-259800e51e85 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:33.492866 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:33.574952 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96b4cb-c792-4f71-910f-723a99fac107 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:33.611555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb0973-36ab-43af-b657-136ad2464aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:33.612647 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb0973-36ab-43af-b657-136ad2464aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:33.613292 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb0973-36ab-43af-b657-136ad2464aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:33.613750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb0973-36ab-43af-b657-136ad2464aa7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:33.622017 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493516a-7a29-41c0-a2b0-259800e51e85 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:33.625922 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb0973-36ab-43af-b657-136ad2464aa7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:33.627127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb0973-36ab-43af-b657-136ad2464aa7 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:33.640913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-a6bb0973-36ab-43af-b657-136ad2464aa7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:33.640913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:33.640913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:33.640913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:33.640913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:33.640913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:33.640913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:33.640913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:33.640913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:33.640913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:33.640913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:33.640913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:33.640913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:01:33.640913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:01:33.640913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:01:33.641901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:01:33.641901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:33.641901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:33.641901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:33.641901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:33.641901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:33.641901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:33.641901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:33.641901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:33.641901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:33.641901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:33.641901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:33.641901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:33.641901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:33.641901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:33.641901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:33.641901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:33.643392 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:01:33.643392 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:01:33.643392 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:01:33.643392 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:01:33.643392 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:01:33.643392 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:01:33.643392 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:33.643392 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:33.643392 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 374/738] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:01:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:33.648527 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ede2e8-d3ea-4eed-849b-2e87588904fc None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:33.648527 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ede2e8-d3ea-4eed-849b-2e87588904fc None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:33.648798 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ede2e8-d3ea-4eed-849b-2e87588904fc None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:33.651463 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 375/739] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:33.651463 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ede2e8-d3ea-4eed-849b-2e87588904fc None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:33.672219 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed45af-0b87-414a-b440-ff619e146604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:33.673346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed45af-0b87-414a-b440-ff619e146604 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:33.673848 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed45af-0b87-414a-b440-ff619e146604 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:33.674354 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed45af-0b87-414a-b440-ff619e146604 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:33.675430 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed45af-0b87-414a-b440-ff619e146604 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:33.678987 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed45af-0b87-414a-b440-ff619e146604 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:33.697336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-26ed45af-0b87-414a-b440-ff619e146604 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:01:33.697336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:33.697336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:01:33.697336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:01:33.697336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:01:33.697336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:01:33.697336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:01:33.697336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:33.697336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:01:33.697336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:33.697336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:33.697336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:33.697336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:33.697336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:33.697336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:33.697336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:33.697336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:33.698666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:33.698666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:33.698666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:33.698666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:33.698666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:33.698666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:33.698666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:01:33.698666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:01:33.698666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:01:33.698666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:01:33.698666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:33.698666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:33.698666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:33.698666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:33.698666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:33.698666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:33.699549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:33.699549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:33.699549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:33.699549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:33.699549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:33.699549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:33.699549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:33.699549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:33.699549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:33.699549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:33.699549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:01:33.699549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:33.699549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:01:33.699549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:33.700986 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 365/740] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:01:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:33.701066 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1626ae5-8283-415e-9f91-85a1805cfa67 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:33.701421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1626ae5-8283-415e-9f91-85a1805cfa67 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:33.701591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1626ae5-8283-415e-9f91-85a1805cfa67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:33.719923 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-b1626ae5-8283-415e-9f91-85a1805cfa67 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:33.721402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b1626ae5-8283-415e-9f91-85a1805cfa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:33.754339 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:33.769546 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:33.789694 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ede2e8-d3ea-4eed-849b-2e87588904fc None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:33.795733 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 366/741] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:33.796554 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1626ae5-8283-415e-9f91-85a1805cfa67 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:33.825668 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e65c48-756c-4925-a283-e955eb29dc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:33.826324 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e65c48-756c-4925-a283-e955eb29dc77 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:33.826607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e65c48-756c-4925-a283-e955eb29dc77 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:33.826880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e65c48-756c-4925-a283-e955eb29dc77 None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:33.827567 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e65c48-756c-4925-a283-e955eb29dc77 None admin] RBAC: Adding query filter params (name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:33.827920 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e65c48-756c-4925-a283-e955eb29dc77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:33.829405 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e65c48-756c-4925-a283-e955eb29dc77 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:33.854350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 376/742] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 24 13:01:33 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:33.854350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f91d1-ec49-450b-815f-05cbd34a6433 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:33.854350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f91d1-ec49-450b-815f-05cbd34a6433 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:33.854350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f91d1-ec49-450b-815f-05cbd34a6433 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:33.854350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 377/743] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:33.859445 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2c7f1-1317-48d9-a9ff-57a6914353be None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:33.859445 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2c7f1-1317-48d9-a9ff-57a6914353be None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:33.859445 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2c7f1-1317-48d9-a9ff-57a6914353be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:33.879656 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-7ef2c7f1-1317-48d9-a9ff-57a6914353be None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:33.881482 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7ef2c7f1-1317-48d9-a9ff-57a6914353be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:33.929165 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1626ae5-8283-415e-9f91-85a1805cfa67 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:33.971257 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452d7b6-81c4-4ed3-8ae7-a316fee385de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:33.972046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452d7b6-81c4-4ed3-8ae7-a316fee385de None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:33.972421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452d7b6-81c4-4ed3-8ae7-a316fee385de None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:33.972780 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452d7b6-81c4-4ed3-8ae7-a316fee385de None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:33.973513 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452d7b6-81c4-4ed3-8ae7-a316fee385de None admin] RBAC: Adding query filter params (name=compute) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:33.973904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452d7b6-81c4-4ed3-8ae7-a316fee385de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:33.975815 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 378/744] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:01:33.976208 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452d7b6-81c4-4ed3-8ae7-a316fee385de None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:33.985381 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 367/745] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 24 13:01:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:33.991780 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2c7f1-1317-48d9-a9ff-57a6914353be None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:34.070344 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452d7b6-81c4-4ed3-8ae7-a316fee385de None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:34.077818 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:34.112205 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:34.113989 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2c7f1-1317-48d9-a9ff-57a6914353be None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:34.157246 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214a650-bc50-4ace-9fc9-7346c1324a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:34.157772 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214a650-bc50-4ace-9fc9-7346c1324a16 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:34.158051 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214a650-bc50-4ace-9fc9-7346c1324a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:34.158415 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214a650-bc50-4ace-9fc9-7346c1324a16 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:34.159035 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214a650-bc50-4ace-9fc9-7346c1324a16 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:34.159473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214a650-bc50-4ace-9fc9-7346c1324a16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:34.160822 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214a650-bc50-4ace-9fc9-7346c1324a16 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:34.167184 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 379/746] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 24 13:01:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:34.173206 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214a650-bc50-4ace-9fc9-7346c1324a16 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:34.201150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452d7b6-81c4-4ed3-8ae7-a316fee385de None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:34.256578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b656fc-2ba2-4e18-84b7-06edc85937bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:34.257408 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b656fc-2ba2-4e18-84b7-06edc85937bc None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:34.258549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b656fc-2ba2-4e18-84b7-06edc85937bc None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:34.258819 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b656fc-2ba2-4e18-84b7-06edc85937bc None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:34.260694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b656fc-2ba2-4e18-84b7-06edc85937bc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:34.261122 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b656fc-2ba2-4e18-84b7-06edc85937bc None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:34.283575 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 368/747] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 24 13:01:34 2022] POST /identity/v3/services => generated 242 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:01:34.283575 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b656fc-2ba2-4e18-84b7-06edc85937bc None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:34.300813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214a650-bc50-4ace-9fc9-7346c1324a16 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:34.352746 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:34.359944 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd940e-0814-46e5-9632-849218a3e358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:34.360824 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd940e-0814-46e5-9632-849218a3e358 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:34.361251 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd940e-0814-46e5-9632-849218a3e358 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:34.362285 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd940e-0814-46e5-9632-849218a3e358 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:34.363345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd940e-0814-46e5-9632-849218a3e358 None admin] RBAC: Adding query filter params (interface=public, service_id=c31411b2730848c0ad11f643af4b357c, region_id=RegionOne) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:34.363925 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd940e-0814-46e5-9632-849218a3e358 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:34.366519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd940e-0814-46e5-9632-849218a3e358 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:34.374122 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 380/748] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Oct 24 13:01:34 2022] GET /identity/v3/endpoints?service_id=c31411b2730848c0ad11f643af4b357c&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:34.379444 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd940e-0814-46e5-9632-849218a3e358 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:34.415712 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:34.436252 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b656fc-2ba2-4e18-84b7-06edc85937bc None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:34.476179 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15528a49-a227-4794-afa6-7afb1fe4af64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:34.476826 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15528a49-a227-4794-afa6-7afb1fe4af64 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:34.477105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15528a49-a227-4794-afa6-7afb1fe4af64 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:34.477366 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15528a49-a227-4794-afa6-7afb1fe4af64 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:34.478016 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15528a49-a227-4794-afa6-7afb1fe4af64 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:34.479469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15528a49-a227-4794-afa6-7afb1fe4af64 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:34.490015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-15528a49-a227-4794-afa6-7afb1fe4af64 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:01:34.490015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:34.490015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:01:34.490015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:01:34.490015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:01:34.490015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:01:34.490015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:01:34.490015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:34.490015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:01:34.490015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:34.490015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:34.490015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:34.490015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:34.490015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:34.490015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:34.490015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:34.490015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:34.492195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:34.492195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:34.492195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:34.492195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:34.492195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:34.492195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:34.492195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:01:34.492195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:01:34.492195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:01:34.492195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:01:34.492195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:34.492195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:34.492195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:34.492195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:34.492195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:34.492195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:34.493225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:34.493225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:34.493225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:34.493225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:34.493225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:34.493225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:34.493225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:34.493225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:34.493225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:34.493225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:34.493225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:01:34.493225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:34.493225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:01:34.493225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:34.493225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 369/749] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Oct 24 13:01:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:34.498151 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15528a49-a227-4794-afa6-7afb1fe4af64 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:34.513952 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd940e-0814-46e5-9632-849218a3e358 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:34.562634 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5864a5-6277-4bef-882c-ba5d248263ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:34.563643 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5864a5-6277-4bef-882c-ba5d248263ea None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:34.564128 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5864a5-6277-4bef-882c-ba5d248263ea None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:34.564600 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5864a5-6277-4bef-882c-ba5d248263ea None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:34.565398 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5864a5-6277-4bef-882c-ba5d248263ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:34.567001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5864a5-6277-4bef-882c-ba5d248263ea None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:34.575234 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 381/750] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Oct 24 13:01:34 2022] GET /identity/v3/services => generated 1957 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:01:34.624601 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15528a49-a227-4794-afa6-7afb1fe4af64 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:34.666173 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac69ddd-b844-4f37-915c-054e8bbcb909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:34.666708 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac69ddd-b844-4f37-915c-054e8bbcb909 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:34.666982 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac69ddd-b844-4f37-915c-054e8bbcb909 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:34.667249 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac69ddd-b844-4f37-915c-054e8bbcb909 None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:34.667913 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac69ddd-b844-4f37-915c-054e8bbcb909 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:34.668209 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac69ddd-b844-4f37-915c-054e8bbcb909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:34.669602 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac69ddd-b844-4f37-915c-054e8bbcb909 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:34.675613 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 370/751] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Oct 24 13:01:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:34.682057 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5864a5-6277-4bef-882c-ba5d248263ea None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:34.753519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:34.801368 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5864a5-6277-4bef-882c-ba5d248263ea None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:34.840721 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c382d3-27f8-4076-b147-324dec11b387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:34.841847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c382d3-27f8-4076-b147-324dec11b387 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:34.842214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c382d3-27f8-4076-b147-324dec11b387 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:34.842598 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c382d3-27f8-4076-b147-324dec11b387 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:34.843472 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c382d3-27f8-4076-b147-324dec11b387 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:34.843883 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c382d3-27f8-4076-b147-324dec11b387 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:34.845495 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c382d3-27f8-4076-b147-324dec11b387 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:34.851793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 382/752] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Oct 24 13:01:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:34.857677 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac69ddd-b844-4f37-915c-054e8bbcb909 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:34.877533 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:34.968016 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac69ddd-b844-4f37-915c-054e8bbcb909 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:35.003049 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290bc40-e8fb-4a65-9fe1-6451f65e685a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:35.003684 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290bc40-e8fb-4a65-9fe1-6451f65e685a None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:35.003961 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290bc40-e8fb-4a65-9fe1-6451f65e685a None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:35.004232 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290bc40-e8fb-4a65-9fe1-6451f65e685a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:35.004936 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290bc40-e8fb-4a65-9fe1-6451f65e685a None admin] RBAC: Adding query filter params (interface=admin, service_id=56b9eb4880da46edbc65d0c93e0a8d2e, region_id=RegionOne) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:35.005238 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290bc40-e8fb-4a65-9fe1-6451f65e685a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:35.007545 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290bc40-e8fb-4a65-9fe1-6451f65e685a None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:35.013060 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 371/753] 10.222.0.18 () {56 vars in 1249 bytes} [Mon Oct 24 13:01:34 2022] GET /identity/v3/endpoints?service_id=56b9eb4880da46edbc65d0c93e0a8d2e&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:35.018930 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c382d3-27f8-4076-b147-324dec11b387 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:35.127004 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c382d3-27f8-4076-b147-324dec11b387 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:35.152243 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:35.166457 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39462b-f435-4189-9d5b-4303159745a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:35.167443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39462b-f435-4189-9d5b-4303159745a2 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:35.167921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39462b-f435-4189-9d5b-4303159745a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:35.168386 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39462b-f435-4189-9d5b-4303159745a2 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:35.169174 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39462b-f435-4189-9d5b-4303159745a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:35.170752 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39462b-f435-4189-9d5b-4303159745a2 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:35.178550 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 383/754] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Oct 24 13:01:35 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:01:36.262558 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09d952-616b-48d5-9422-b46f2e7fab82 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:36.263223 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09d952-616b-48d5-9422-b46f2e7fab82 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:36.263612 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09d952-616b-48d5-9422-b46f2e7fab82 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:36.266369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 372/755] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:36.274747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e4652-72f9-40b3-a046-72c06e829877 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:36.275277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e4652-72f9-40b3-a046-72c06e829877 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:36.275277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e4652-72f9-40b3-a046-72c06e829877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:36.294116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-068e4652-72f9-40b3-a046-72c06e829877 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:36.295294 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-068e4652-72f9-40b3-a046-72c06e829877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:36.364782 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 384/756] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:36 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:36.594325 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f503189-5cd1-4de2-8cc6-9b8115bf21a8 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:36.594700 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f503189-5cd1-4de2-8cc6-9b8115bf21a8 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:36.594861 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f503189-5cd1-4de2-8cc6-9b8115bf21a8 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:36.596485 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 373/757] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:36.602198 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41404469-8394-450c-b5ea-c8858010e3cc None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:36.602490 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41404469-8394-450c-b5ea-c8858010e3cc None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:36.602766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41404469-8394-450c-b5ea-c8858010e3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:36.621590 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-41404469-8394-450c-b5ea-c8858010e3cc None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:36.622757 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-41404469-8394-450c-b5ea-c8858010e3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:36.640876 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f503189-5cd1-4de2-8cc6-9b8115bf21a8 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:36.703517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 385/758] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:36 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:36.743682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:36.765726 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f503189-5cd1-4de2-8cc6-9b8115bf21a8 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:36.801610 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b2c65-f5e5-4da2-a6f9-dc463ef282e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:36.802140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b2c65-f5e5-4da2-a6f9-dc463ef282e1 None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:36.802982 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b2c65-f5e5-4da2-a6f9-dc463ef282e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:36.803257 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b2c65-f5e5-4da2-a6f9-dc463ef282e1 None admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:36.804045 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b2c65-f5e5-4da2-a6f9-dc463ef282e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:36.805483 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b2c65-f5e5-4da2-a6f9-dc463ef282e1 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:36.821141 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.sql.core [None req-ac7b2c65-f5e5-4da2-a6f9-dc463ef282e1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 24 13:01:36.821141 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 24 13:01:36.821141 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [parameters: {'user_id': 'd6bf08352a5940bdbdd5c4c89f3fc2e8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 24 13:01:36.821141 dv-cinder-862491-1-smb devstack@keystone.service[81600]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81600) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 13:01:36.828827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-ac7b2c65-f5e5-4da2-a6f9-dc463ef282e1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 24 13:01:36.828827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:36.828827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 13:01:36.828827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 13:01:36.828827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 13:01:36.828827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 13:01:36.828827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 13:01:36.828827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 13:01:36.828827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 13:01:36.828827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application conn.query(q) Oct 24 13:01:36.828827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 13:01:36.828827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 13:01:36.828827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 13:01:36.828827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application result.read() Oct 24 13:01:36.828827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 13:01:36.829730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 13:01:36.829730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 13:01:36.829730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 13:01:36.829730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 13:01:36.829730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 13:01:36.829730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 13:01:36.829730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 13:01:36.829730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 24 13:01:36.829730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:36.829730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 13:01:36.829730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:36.829730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:36.829730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 13:01:36.829730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 13:01:36.829730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 24 13:01:36.829730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 24 13:01:36.829730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 13:01:36.829730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application next(self.gen) Oct 24 13:01:36.831096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 13:01:36.831096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application yield resource Oct 24 13:01:36.831096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 13:01:36.831096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application next(self.gen) Oct 24 13:01:36.831096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 13:01:36.831096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 13:01:36.831096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 13:01:36.831096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 13:01:36.831096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 13:01:36.831096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise self.value Oct 24 13:01:36.831096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 13:01:36.831096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 13:01:36.831096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 13:01:36.831096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application session.commit() Oct 24 13:01:36.831096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 13:01:36.831096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 13:01:36.831096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 13:01:36.832262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 13:01:36.832262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 13:01:36.832262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self.session.flush() Oct 24 13:01:36.832262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 13:01:36.832262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 13:01:36.832262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 13:01:36.832262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 13:01:36.832262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 13:01:36.832262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application compat.raise_( Oct 24 13:01:36.832262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 13:01:36.832262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception Oct 24 13:01:36.832262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 13:01:36.832262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 13:01:36.832262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 13:01:36.832262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 13:01:36.832262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 13:01:36.832262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 13:01:36.833140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 13:01:36.833140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 13:01:36.833140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 24 13:01:36.833140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 24 13:01:36.833140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 13:01:36.833140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 13:01:36.833140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 13:01:36.833140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 13:01:36.833140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 13:01:36.833140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 13:01:36.833140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 13:01:36.833140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 13:01:36.833140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 13:01:36.833140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 13:01:36.833140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 13:01:36.833140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception Oct 24 13:01:36.834273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 13:01:36.834273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 13:01:36.834273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 13:01:36.834273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 13:01:36.834273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 13:01:36.834273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 13:01:36.834273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 13:01:36.834273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application conn.query(q) Oct 24 13:01:36.834273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 13:01:36.834273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 13:01:36.834273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 13:01:36.834273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application result.read() Oct 24 13:01:36.834273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 13:01:36.834273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 13:01:36.834273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 13:01:36.834273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 13:01:36.836842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 13:01:36.836842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 13:01:36.836842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 13:01:36.836842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 13:01:36.836842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 24 13:01:36.836842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 24 13:01:36.836842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd6bf08352a5940bdbdd5c4c89f3fc2e8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 24 13:01:36.836842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 13:01:36.836842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:36.836842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:36.836842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:36.836842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:36.836842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:36.836842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:36.836842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:36.839086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:36.839086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:36.839086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:36.839086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:36.839086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:36.839086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:36.839086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:36.839086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 24 13:01:36.839086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 24 13:01:36.839086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:36.839086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:36.839086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:01:36.839086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:36.839086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:01:36.839086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:36.839086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 24 13:01:36.839086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 24 13:01:36.842656 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 24 13:01:36.842656 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 24 13:01:36.842656 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 13:01:36.842656 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 13:01:36.842656 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 24 13:01:36.842656 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:36.842656 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 374/759] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Oct 24 13:01:36 2022] POST /identity/v3/users => generated 160 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:01:36.843677 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41404469-8394-450c-b5ea-c8858010e3cc None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:36.901517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:36.956202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41404469-8394-450c-b5ea-c8858010e3cc None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:36.996083 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98cce7-32a3-4c87-9a86-891d2fd9fd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:36.996709 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98cce7-32a3-4c87-9a86-891d2fd9fd67 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:36.996998 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98cce7-32a3-4c87-9a86-891d2fd9fd67 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:36.997250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98cce7-32a3-4c87-9a86-891d2fd9fd67 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:37.004550 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98cce7-32a3-4c87-9a86-891d2fd9fd67 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:37.006919 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98cce7-32a3-4c87-9a86-891d2fd9fd67 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:37.018529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-ae98cce7-32a3-4c87-9a86-891d2fd9fd67 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 13:01:37.018529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:37.018529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:37.018529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:37.018529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:37.018529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:37.018529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:37.018529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:37.018529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:37.018529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:37.018529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:37.018529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:37.018529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:01:37.018529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:01:37.018529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:01:37.018529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:01:37.019531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:37.019531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:37.019531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:01:37.019531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:37.019531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:01:37.019531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:37.019531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:37.019531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:37.019531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:37.019531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:37.019531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:37.019531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:37.019531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:37.019531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:37.019531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:37.019531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:37.019531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:37.019531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:37.021851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:37.021851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:37.021851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:01:37.021851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:01:37.021851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:01:37.021851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:01:37.021851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:01:37.021851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:01:37.021851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 13:01:37.021851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:37.021851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 386/760] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:01:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:37.027271 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b2c65-f5e5-4da2-a6f9-dc463ef282e1 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:37.031458 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98cce7-32a3-4c87-9a86-891d2fd9fd67 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:37.153142 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b2c65-f5e5-4da2-a6f9-dc463ef282e1 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:37.179552 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98cce7-32a3-4c87-9a86-891d2fd9fd67 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:37.193820 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:37.198925 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153084b-6b02-4379-85cd-1833952b64ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:37.200051 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153084b-6b02-4379-85cd-1833952b64ee None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:37.200472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153084b-6b02-4379-85cd-1833952b64ee None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:37.200881 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153084b-6b02-4379-85cd-1833952b64ee None admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:37.201714 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153084b-6b02-4379-85cd-1833952b64ee None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:37.202151 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153084b-6b02-4379-85cd-1833952b64ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:37.204505 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153084b-6b02-4379-85cd-1833952b64ee None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:37.227536 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399b5b4-56e3-4b5a-bdb3-2ca6162d59e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:37.228247 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399b5b4-56e3-4b5a-bdb3-2ca6162d59e1 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:37.228629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399b5b4-56e3-4b5a-bdb3-2ca6162d59e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:37.228979 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399b5b4-56e3-4b5a-bdb3-2ca6162d59e1 None admin] PATH_INFO: `/v3/services/image` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:37.229646 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399b5b4-56e3-4b5a-bdb3-2ca6162d59e1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:37.231478 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399b5b4-56e3-4b5a-bdb3-2ca6162d59e1 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:37.243133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-6399b5b4-56e3-4b5a-bdb3-2ca6162d59e1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:01:37.243133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:37.243133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:01:37.243133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:01:37.243133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:01:37.243133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:01:37.243133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:01:37.243133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:37.243133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:01:37.243133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:37.243133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:37.243133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:37.243133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:37.243133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:37.243133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:37.243133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:37.243133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:37.244764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:37.244764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:37.244764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:37.244764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:37.244764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:37.244764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:37.244764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:01:37.244764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:01:37.244764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:01:37.244764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:01:37.244764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:37.244764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:37.244764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:37.244764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:37.244764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:37.244764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:37.245908 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:37.245908 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:37.245908 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:37.245908 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:37.245908 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:37.245908 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:37.245908 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:37.245908 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:37.245908 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:37.245908 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:37.245908 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:01:37.245908 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:37.245908 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:01:37.245908 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:37.248121 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 387/761] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Oct 24 13:01:37 2022] GET /identity/v3/services/image => generated 86 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:01:37.251803 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:37.253597 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399b5b4-56e3-4b5a-bdb3-2ca6162d59e1 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:37.263716 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 375/762] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 24 13:01:37 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:37.386746 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399b5b4-56e3-4b5a-bdb3-2ca6162d59e1 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:37.429331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d2fe9-c7af-4a50-abae-4b38e45aec2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:37.429883 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d2fe9-c7af-4a50-abae-4b38e45aec2b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:37.430164 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d2fe9-c7af-4a50-abae-4b38e45aec2b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:37.430443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d2fe9-c7af-4a50-abae-4b38e45aec2b None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:37.431142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d2fe9-c7af-4a50-abae-4b38e45aec2b None admin] RBAC: Adding query filter params (name=image) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:37.431465 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d2fe9-c7af-4a50-abae-4b38e45aec2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:37.432872 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d2fe9-c7af-4a50-abae-4b38e45aec2b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:37.441661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95292501-23c4-4044-82e3-dc42ff184468 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:37.442028 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95292501-23c4-4044-82e3-dc42ff184468 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:37.442188 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95292501-23c4-4044-82e3-dc42ff184468 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:37.444102 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 388/763] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:37.444539 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 376/764] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:37.446927 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d2fe9-c7af-4a50-abae-4b38e45aec2b None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:37.450357 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b25e6f-4f33-46eb-bb2b-4bf9598a3d10 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:37.450676 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b25e6f-4f33-46eb-bb2b-4bf9598a3d10 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:37.450910 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b25e6f-4f33-46eb-bb2b-4bf9598a3d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:37.470459 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-24b25e6f-4f33-46eb-bb2b-4bf9598a3d10 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:37.472014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-24b25e6f-4f33-46eb-bb2b-4bf9598a3d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:37.499659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:37.561179 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 377/765] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:37 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:01:37.562754 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3d336-adea-42c5-a341-93076788e9d5 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:37.563033 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3d336-adea-42c5-a341-93076788e9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:37.563404 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3d336-adea-42c5-a341-93076788e9d5 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:37.566156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 378/766] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:37.572223 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6227f5-3f42-43f6-bda6-d82f127eb9c2 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:37.572835 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6227f5-3f42-43f6-bda6-d82f127eb9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:37.573701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6227f5-3f42-43f6-bda6-d82f127eb9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:37.596447 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-0e6227f5-3f42-43f6-bda6-d82f127eb9c2 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:37.597761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-0e6227f5-3f42-43f6-bda6-d82f127eb9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:37.598042 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d2fe9-c7af-4a50-abae-4b38e45aec2b None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:37.641185 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2707029-215d-476b-b00d-4a3958330ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:37.642551 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2707029-215d-476b-b00d-4a3958330ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:37.643090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2707029-215d-476b-b00d-4a3958330ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:37.643600 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2707029-215d-476b-b00d-4a3958330ab9 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:37.644232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2707029-215d-476b-b00d-4a3958330ab9 None admin] RBAC: Adding query filter params (type=image) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:37.644531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2707029-215d-476b-b00d-4a3958330ab9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:37.645937 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2707029-215d-476b-b00d-4a3958330ab9 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:37.657118 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 389/767] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:37.659181 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2707029-215d-476b-b00d-4a3958330ab9 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:37.690836 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 379/768] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:37 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:01:37.768436 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:37.772712 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2707029-215d-476b-b00d-4a3958330ab9 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:37.807860 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bf6a0-6b87-49b5-81cb-a51c9809a3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:37.808604 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bf6a0-6b87-49b5-81cb-a51c9809a3f8 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:37.808974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bf6a0-6b87-49b5-81cb-a51c9809a3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:37.809336 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bf6a0-6b87-49b5-81cb-a51c9809a3f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:37.810140 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0bf6a0-6b87-49b5-81cb-a51c9809a3f8 None admin] RBAC: Adding query filter params (interface=public, service_id=475b9734073044838681c943699b8634, region_id=RegionOne) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:37.810538 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0bf6a0-6b87-49b5-81cb-a51c9809a3f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:37.812022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0bf6a0-6b87-49b5-81cb-a51c9809a3f8 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:37.822921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 390/769] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Oct 24 13:01:37 2022] GET /identity/v3/endpoints?service_id=475b9734073044838681c943699b8634&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:37.824468 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6227f5-3f42-43f6-bda6-d82f127eb9c2 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:37.850124 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bf6a0-6b87-49b5-81cb-a51c9809a3f8 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:37.900180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:37.968141 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6227f5-3f42-43f6-bda6-d82f127eb9c2 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:37.977787 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bf6a0-6b87-49b5-81cb-a51c9809a3f8 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:38.012441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc2c3a-a897-4b52-b97b-9197f56f683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:38.013101 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc2c3a-a897-4b52-b97b-9197f56f683b None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:38.013379 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc2c3a-a897-4b52-b97b-9197f56f683b None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:38.013655 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc2c3a-a897-4b52-b97b-9197f56f683b None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:38.014317 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc2c3a-a897-4b52-b97b-9197f56f683b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:38.015734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc2c3a-a897-4b52-b97b-9197f56f683b None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:38.023219 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b44a6-88d8-4e94-a474-c324308923fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:38.034087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 380/770] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Oct 24 13:01:37 2022] GET /identity/v3/services => generated 1957 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:01:38.034324 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b44a6-88d8-4e94-a474-c324308923fc None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:38.034324 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b44a6-88d8-4e94-a474-c324308923fc None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:38.034324 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b44a6-88d8-4e94-a474-c324308923fc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:38.034597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc2c3a-a897-4b52-b97b-9197f56f683b None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:38.034683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b44a6-88d8-4e94-a474-c324308923fc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:38.034683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b44a6-88d8-4e94-a474-c324308923fc None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:38.035516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-f36b44a6-88d8-4e94-a474-c324308923fc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:01:38.035516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:38.035516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:01:38.035516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:01:38.035516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:01:38.035516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:01:38.035516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:01:38.035516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:38.035516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:01:38.035516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:38.035516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:38.035516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:38.035516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:38.035516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:38.035516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:38.035516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:38.035516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:38.036678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:38.036678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:38.036678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:38.036678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:38.036678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:38.036678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:38.036678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:01:38.036678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:01:38.036678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:01:38.036678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:01:38.036678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:38.036678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:38.036678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:38.036678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:38.036678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:38.036678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:38.040586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:38.040586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:38.040586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:38.040586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:38.040586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:38.040586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:38.040586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:38.040586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:38.040586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:38.040586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:38.040586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:01:38.040586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:38.040586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:01:38.040586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:38.040586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 391/771] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Oct 24 13:01:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:01:38.043385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b44a6-88d8-4e94-a474-c324308923fc None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:38.080488 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:38.154658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc2c3a-a897-4b52-b97b-9197f56f683b None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:38.174952 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b44a6-88d8-4e94-a474-c324308923fc None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:38.181941 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:38.195881 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c1aab-f1ee-4503-9e56-09f227c17613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:38.196525 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c1aab-f1ee-4503-9e56-09f227c17613 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:38.196804 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c1aab-f1ee-4503-9e56-09f227c17613 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:38.197068 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c1aab-f1ee-4503-9e56-09f227c17613 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:38.197906 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c1aab-f1ee-4503-9e56-09f227c17613 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:38.199974 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c1aab-f1ee-4503-9e56-09f227c17613 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:38.210014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-7e0c1aab-f1ee-4503-9e56-09f227c17613 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:01:38.210014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:38.210014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:01:38.210014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:01:38.210014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:01:38.210014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:01:38.210014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:01:38.210014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:38.210014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:01:38.210014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:38.210014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:38.210014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:38.210014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:38.210014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:38.210014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:38.210014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:38.210014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:38.211246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:38.211246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:38.211246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:38.211246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:38.211246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:38.211246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:38.211246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:01:38.211246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:01:38.211246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:01:38.211246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:01:38.211246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:38.211246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:38.211246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:38.211246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:38.211246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:38.211246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:38.212259 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:38.212259 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:38.212259 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:38.212259 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:38.212259 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:38.212259 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:38.212259 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:38.212259 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:38.212259 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:38.212259 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:38.212259 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:01:38.212259 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:38.212259 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:01:38.212259 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:38.212259 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 381/772] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:01:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:38.217689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c1aab-f1ee-4503-9e56-09f227c17613 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:38.225223 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f8946-1b30-4b23-910a-f537e3e78457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:38.225761 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f8946-1b30-4b23-910a-f537e3e78457 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:38.226049 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f8946-1b30-4b23-910a-f537e3e78457 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:38.226318 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f8946-1b30-4b23-910a-f537e3e78457 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:38.226953 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f8946-1b30-4b23-910a-f537e3e78457 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:38.228068 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f8946-1b30-4b23-910a-f537e3e78457 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:38.229446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f8946-1b30-4b23-910a-f537e3e78457 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:38.234692 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 392/773] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Oct 24 13:01:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:38.242472 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f8946-1b30-4b23-910a-f537e3e78457 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:38.326562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c1aab-f1ee-4503-9e56-09f227c17613 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:38.345277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:38.356324 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f8946-1b30-4b23-910a-f537e3e78457 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:38.363447 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4c1f4-e1d1-4155-a841-c265dfae7afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:38.364087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4c1f4-e1d1-4155-a841-c265dfae7afb None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:38.364366 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4c1f4-e1d1-4155-a841-c265dfae7afb None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:38.364638 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4c1f4-e1d1-4155-a841-c265dfae7afb None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:38.365828 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4c1f4-e1d1-4155-a841-c265dfae7afb None admin] RBAC: Adding query filter params (name=compute) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:38.366129 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4c1f4-e1d1-4155-a841-c265dfae7afb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:38.367535 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4c1f4-e1d1-4155-a841-c265dfae7afb None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:38.372866 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 382/774] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 24 13:01:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:38.378380 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4c1f4-e1d1-4155-a841-c265dfae7afb None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:38.396996 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5566a-d1bd-4f17-b9e3-7cd44e1f327a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:38.397707 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5566a-d1bd-4f17-b9e3-7cd44e1f327a None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:38.398064 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5566a-d1bd-4f17-b9e3-7cd44e1f327a None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:38.398397 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5566a-d1bd-4f17-b9e3-7cd44e1f327a None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:38.399477 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5566a-d1bd-4f17-b9e3-7cd44e1f327a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:38.399785 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5566a-d1bd-4f17-b9e3-7cd44e1f327a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:38.401265 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5566a-d1bd-4f17-b9e3-7cd44e1f327a None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:38.412831 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 393/775] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Oct 24 13:01:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:38.413811 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5566a-d1bd-4f17-b9e3-7cd44e1f327a None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:38.435265 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:38.485710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4c1f4-e1d1-4155-a841-c265dfae7afb None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:38.519941 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af0f33-f061-4287-aca1-eccca601b16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:38.520541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af0f33-f061-4287-aca1-eccca601b16d None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:38.520814 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af0f33-f061-4287-aca1-eccca601b16d None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:38.521115 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af0f33-f061-4287-aca1-eccca601b16d None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:38.521992 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af0f33-f061-4287-aca1-eccca601b16d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:38.521992 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af0f33-f061-4287-aca1-eccca601b16d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:38.523372 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af0f33-f061-4287-aca1-eccca601b16d None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:38.528403 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 383/776] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 24 13:01:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:38.531568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5566a-d1bd-4f17-b9e3-7cd44e1f327a None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:38.534736 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af0f33-f061-4287-aca1-eccca601b16d None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:38.578502 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb18802-ca8e-4aac-8222-7e56b83d49d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:38.579113 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb18802-ca8e-4aac-8222-7e56b83d49d0 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:38.579384 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb18802-ca8e-4aac-8222-7e56b83d49d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:38.579698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb18802-ca8e-4aac-8222-7e56b83d49d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:38.580360 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb18802-ca8e-4aac-8222-7e56b83d49d0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:38.581750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb18802-ca8e-4aac-8222-7e56b83d49d0 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:38.611452 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 394/777] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:01:38 2022] POST /identity/v3/endpoints => generated 325 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:01:38.661153 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af0f33-f061-4287-aca1-eccca601b16d None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:38.681521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:38.710183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75275bbc-0239-4a78-a313-3b240c516f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:38.710803 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75275bbc-0239-4a78-a313-3b240c516f53 None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:38.711077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75275bbc-0239-4a78-a313-3b240c516f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:38.711343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75275bbc-0239-4a78-a313-3b240c516f53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:38.712043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75275bbc-0239-4a78-a313-3b240c516f53 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:38.713442 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75275bbc-0239-4a78-a313-3b240c516f53 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:38.751542 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 384/778] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:01:38 2022] POST /identity/v3/endpoints => generated 334 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:01:40.264330 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a98ac-33f7-43c8-b4f0-a6d90fd4f8bf None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:40.264854 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a98ac-33f7-43c8-b4f0-a6d90fd4f8bf None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:40.264854 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a98ac-33f7-43c8-b4f0-a6d90fd4f8bf None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:40.266341 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 395/779] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:40.272139 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2be872-7c44-4f3d-8029-dca2bfae6ce6 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:40.272654 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2be872-7c44-4f3d-8029-dca2bfae6ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:40.272853 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2be872-7c44-4f3d-8029-dca2bfae6ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:40.290787 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-be2be872-7c44-4f3d-8029-dca2bfae6ce6 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:40.291997 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-be2be872-7c44-4f3d-8029-dca2bfae6ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:40.365996 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 385/780] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:40.636905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a98ac-33f7-43c8-b4f0-a6d90fd4f8bf None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:40.657083 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:40.749331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a98ac-33f7-43c8-b4f0-a6d90fd4f8bf None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:40.784051 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c4fcf-dace-41f9-aba7-9174acceeb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:40.784680 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c4fcf-dace-41f9-aba7-9174acceeb79 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:40.784955 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c4fcf-dace-41f9-aba7-9174acceeb79 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:40.785221 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c4fcf-dace-41f9-aba7-9174acceeb79 None admin] PATH_INFO: `/v3/services/image` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:40.785798 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c4fcf-dace-41f9-aba7-9174acceeb79 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:40.787729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c4fcf-dace-41f9-aba7-9174acceeb79 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:40.797385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-f75c4fcf-dace-41f9-aba7-9174acceeb79 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:01:40.797385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:40.797385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:01:40.797385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:01:40.797385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:01:40.797385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:01:40.797385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:01:40.797385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:40.797385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:01:40.797385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:40.797385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:40.797385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:40.797385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:40.797385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:40.797385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:40.797385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:40.797385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:40.798417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:40.798417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:40.798417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:40.798417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:40.798417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:40.798417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:40.798417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:01:40.798417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:01:40.798417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:01:40.798417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:01:40.798417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:40.798417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:40.798417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:40.798417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:40.798417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:40.798417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:40.799917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:40.799917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:40.799917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:40.799917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:40.799917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:40.799917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:40.799917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:40.799917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:40.799917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:40.799917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:40.799917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:01:40.799917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:01:40.799917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:01:40.799917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:40.803635 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 396/781] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Oct 24 13:01:40 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:40.805200 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2be872-7c44-4f3d-8029-dca2bfae6ce6 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:40.846248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc2085-99c4-475b-b742-7e729de6559c None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:40.846536 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc2085-99c4-475b-b742-7e729de6559c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:40.846806 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc2085-99c4-475b-b742-7e729de6559c None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:40.848324 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 397/782] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:01:40.853920 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cfff3-8af3-4f18-92b0-59cc89e10049 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:40.854211 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cfff3-8af3-4f18-92b0-59cc89e10049 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:40.854489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cfff3-8af3-4f18-92b0-59cc89e10049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:40.873252 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-630cfff3-8af3-4f18-92b0-59cc89e10049 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:40.874425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-630cfff3-8af3-4f18-92b0-59cc89e10049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:40.906427 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:40.915911 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2be872-7c44-4f3d-8029-dca2bfae6ce6 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:40.957268 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48c7b8-de45-4652-b256-c3cac21cab6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:40.957934 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 398/783] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:01:40.958074 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48c7b8-de45-4652-b256-c3cac21cab6d None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:40.958155 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48c7b8-de45-4652-b256-c3cac21cab6d None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:40.958425 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48c7b8-de45-4652-b256-c3cac21cab6d None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:40.959243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48c7b8-de45-4652-b256-c3cac21cab6d None admin] RBAC: Adding query filter params (name=image) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:40.959573 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48c7b8-de45-4652-b256-c3cac21cab6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:40.960961 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48c7b8-de45-4652-b256-c3cac21cab6d None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:40.972020 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 386/784] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:40.973080 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cfff3-8af3-4f18-92b0-59cc89e10049 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:40.985568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:41.042407 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f56fa0-a7b4-43c4-bf32-33a4fa9641b9 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:41.042688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f56fa0-a7b4-43c4-bf32-33a4fa9641b9 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:41.042955 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f56fa0-a7b4-43c4-bf32-33a4fa9641b9 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:41.044431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 387/785] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:01:41.048994 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d9a3b-479f-4f25-a11e-547c4d3dd253 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:41.049218 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d9a3b-479f-4f25-a11e-547c4d3dd253 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:41.049488 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d9a3b-479f-4f25-a11e-547c4d3dd253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:41.067231 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-994d9a3b-479f-4f25-a11e-547c4d3dd253 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:41.068525 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-994d9a3b-479f-4f25-a11e-547c4d3dd253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:41.077090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cfff3-8af3-4f18-92b0-59cc89e10049 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:41.114172 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b20ec3-9080-4b74-bc35-ed5fbecc2524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:41.114994 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b20ec3-9080-4b74-bc35-ed5fbecc2524 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:41.115270 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b20ec3-9080-4b74-bc35-ed5fbecc2524 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:41.115566 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b20ec3-9080-4b74-bc35-ed5fbecc2524 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:41.116185 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b20ec3-9080-4b74-bc35-ed5fbecc2524 None admin] RBAC: Adding query filter params (type=image) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:41.116482 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b20ec3-9080-4b74-bc35-ed5fbecc2524 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:41.117833 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b20ec3-9080-4b74-bc35-ed5fbecc2524 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:41.127723 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 399/786] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:41.128876 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b20ec3-9080-4b74-bc35-ed5fbecc2524 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:41.147874 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 388/787] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:01:41.208176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:41.232581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d9a3b-479f-4f25-a11e-547c4d3dd253 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:41.238561 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b20ec3-9080-4b74-bc35-ed5fbecc2524 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:41.277461 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e6dca-a11b-43b7-b28b-311acac16cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:41.278095 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e6dca-a11b-43b7-b28b-311acac16cbc None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:41.278328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e6dca-a11b-43b7-b28b-311acac16cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:41.278604 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e6dca-a11b-43b7-b28b-311acac16cbc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:41.279239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e6dca-a11b-43b7-b28b-311acac16cbc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:41.280638 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e6dca-a11b-43b7-b28b-311acac16cbc None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:41.303046 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 400/788] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:01:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:01:41.327262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:41.343121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d9a3b-479f-4f25-a11e-547c4d3dd253 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:41.388397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854d55e-54a4-44bd-894c-724f389ab47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:41.389042 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854d55e-54a4-44bd-894c-724f389ab47e None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:41.389318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854d55e-54a4-44bd-894c-724f389ab47e None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:41.389586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854d55e-54a4-44bd-894c-724f389ab47e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:41.391084 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854d55e-54a4-44bd-894c-724f389ab47e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:41.392683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854d55e-54a4-44bd-894c-724f389ab47e None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:41.394498 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 389/789] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:41.401036 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e6dca-a11b-43b7-b28b-311acac16cbc None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:41.416592 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854d55e-54a4-44bd-894c-724f389ab47e None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:41.518509 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e6dca-a11b-43b7-b28b-311acac16cbc None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:41.529844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854d55e-54a4-44bd-894c-724f389ab47e None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:41.554841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:41.562535 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e1870-175c-4e80-9806-201efc81c508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:41.563404 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e1870-175c-4e80-9806-201efc81c508 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:41.563947 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e1870-175c-4e80-9806-201efc81c508 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:41.564444 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e1870-175c-4e80-9806-201efc81c508 None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:41.565339 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e1870-175c-4e80-9806-201efc81c508 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:41.566762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e1870-175c-4e80-9806-201efc81c508 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:41.572009 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9c44d-17b3-44ef-9a11-5c937c27cee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:41.573227 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9c44d-17b3-44ef-9a11-5c937c27cee9 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:41.573507 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9c44d-17b3-44ef-9a11-5c937c27cee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:41.573780 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9c44d-17b3-44ef-9a11-5c937c27cee9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:41.585823 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9c44d-17b3-44ef-9a11-5c937c27cee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:01:41.590766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-b0d9c44d-17b3-44ef-9a11-5c937c27cee9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 13:01:41.590766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:41.590766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:41.590766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:41.590766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:41.590766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:41.590766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:41.590766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:41.590766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:41.590766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:41.590766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:41.590766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:41.590766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:01:41.590766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:01:41.590766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:01:41.590766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:01:41.592005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:01:41.592005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:01:41.592005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:01:41.592005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:01:41.592005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:41.592005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:41.592005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:41.592005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:41.592005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:41.592005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:41.592005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:41.592005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:41.592005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:41.592005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:41.592005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:41.592005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:41.592867 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:41.592867 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:41.592867 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:41.592867 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:41.592867 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:01:41.592867 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:01:41.592867 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:01:41.592867 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:01:41.592867 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:01:41.592867 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:01:41.592867 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 13:01:41.592867 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:41.592867 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 390/790] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Oct 24 13:01:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:01:41.597768 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 401/791] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 24 13:01:41 2022] POST /identity/v3/projects => generated 311 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:01:41.598744 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9c44d-17b3-44ef-9a11-5c937c27cee9 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:41.617973 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:41.715896 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9c44d-17b3-44ef-9a11-5c937c27cee9 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:41.756932 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65063f2-054b-48c5-848c-970f6c522b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:41.757558 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65063f2-054b-48c5-848c-970f6c522b8f None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:41.757838 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65063f2-054b-48c5-848c-970f6c522b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:41.758111 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65063f2-054b-48c5-848c-970f6c522b8f None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:41.758786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65063f2-054b-48c5-848c-970f6c522b8f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:41.759090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65063f2-054b-48c5-848c-970f6c522b8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:41.760594 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65063f2-054b-48c5-848c-970f6c522b8f None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:41.774936 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 391/792] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Oct 24 13:01:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:41.776279 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e1870-175c-4e80-9806-201efc81c508 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:41.887014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e1870-175c-4e80-9806-201efc81c508 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:42.037533 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b681b93-2d2a-4ee8-98dc-bc04bc9c67fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:42.038176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b681b93-2d2a-4ee8-98dc-bc04bc9c67fc None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:42.038455 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b681b93-2d2a-4ee8-98dc-bc04bc9c67fc None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:42.038725 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b681b93-2d2a-4ee8-98dc-bc04bc9c67fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:42.049006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b681b93-2d2a-4ee8-98dc-bc04bc9c67fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:42.050448 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b681b93-2d2a-4ee8-98dc-bc04bc9c67fc None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:42.064981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-5b681b93-2d2a-4ee8-98dc-bc04bc9c67fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:42.064981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:42.064981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:42.064981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:42.064981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:42.064981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:42.064981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:42.064981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:42.064981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:42.064981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:42.064981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:42.064981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:42.064981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:42.064981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:42.064981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:42.064981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:42.066117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:42.066117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:42.066117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:42.066117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:42.066117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:42.066117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:42.066117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:42.066117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:42.066117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:42.066117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:42.066117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:42.066117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:42.066117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:42.066117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:42.066117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:42.066117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:42.066117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:42.067173 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:42.067173 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:42.067173 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:42.067173 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 402/793] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:42.072597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65063f2-054b-48c5-848c-970f6c522b8f None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:42.150818 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:42.177637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65063f2-054b-48c5-848c-970f6c522b8f None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:42.218748 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe2e51-cf52-4262-bbf5-a6c592384a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:42.219532 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe2e51-cf52-4262-bbf5-a6c592384a11 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:42.219907 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe2e51-cf52-4262-bbf5-a6c592384a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:42.220274 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe2e51-cf52-4262-bbf5-a6c592384a11 None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:42.221006 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe2e51-cf52-4262-bbf5-a6c592384a11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:42.221424 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe2e51-cf52-4262-bbf5-a6c592384a11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:42.223213 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe2e51-cf52-4262-bbf5-a6c592384a11 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:42.235647 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 392/794] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:42.241095 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b681b93-2d2a-4ee8-98dc-bc04bc9c67fc None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:42.277978 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:42.346875 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b681b93-2d2a-4ee8-98dc-bc04bc9c67fc None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:42.379838 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723283d-2211-4fb4-aeef-0b715f622c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:42.381154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723283d-2211-4fb4-aeef-0b715f622c74 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:42.381653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723283d-2211-4fb4-aeef-0b715f622c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:42.382018 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723283d-2211-4fb4-aeef-0b715f622c74 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:42.389123 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723283d-2211-4fb4-aeef-0b715f622c74 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:42.390647 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723283d-2211-4fb4-aeef-0b715f622c74 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:42.402880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-d723283d-2211-4fb4-aeef-0b715f622c74 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:01:42.402880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:42.402880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:42.402880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:42.402880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:42.402880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:42.402880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:42.402880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:42.402880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:42.402880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:42.402880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:42.402880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:42.402880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:01:42.402880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:01:42.402880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:01:42.402880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:01:42.404028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:42.404028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:42.404028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:01:42.404028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:42.404028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:01:42.404028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:42.404028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:42.404028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:42.404028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:42.404028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:42.404028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:42.404028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:42.404028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:42.404028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:42.404028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:42.404028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:42.404028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:42.404028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:42.405185 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:42.405185 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:42.405185 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:01:42.405185 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:01:42.405185 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:01:42.405185 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:01:42.405185 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:01:42.405185 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:01:42.405185 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:01:42.405185 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:42.406702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 403/795] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Oct 24 13:01:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:42.412250 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe2e51-cf52-4262-bbf5-a6c592384a11 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:42.511882 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe2e51-cf52-4262-bbf5-a6c592384a11 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:42.557535 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe08767-77d8-4e2c-a2e5-8e7bc21b9154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:42.558157 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe08767-77d8-4e2c-a2e5-8e7bc21b9154 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:42.558436 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe08767-77d8-4e2c-a2e5-8e7bc21b9154 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:42.558706 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe08767-77d8-4e2c-a2e5-8e7bc21b9154 None admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:42.559476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe08767-77d8-4e2c-a2e5-8e7bc21b9154 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:42.559783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe08767-77d8-4e2c-a2e5-8e7bc21b9154 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:42.561226 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe08767-77d8-4e2c-a2e5-8e7bc21b9154 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:42.563135 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:42.582150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 393/796] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Oct 24 13:01:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:42.588074 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723283d-2211-4fb4-aeef-0b715f622c74 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:42.681776 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:42.689281 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723283d-2211-4fb4-aeef-0b715f622c74 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:42.723459 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e7343-6c10-47c7-ab61-b4358b3817c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:42.724183 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e7343-6c10-47c7-ab61-b4358b3817c1 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:42.724696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e7343-6c10-47c7-ab61-b4358b3817c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:42.724982 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e7343-6c10-47c7-ab61-b4358b3817c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:42.734718 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e7343-6c10-47c7-ab61-b4358b3817c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:42.736179 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e7343-6c10-47c7-ab61-b4358b3817c1 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:42.751277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-792e7343-6c10-47c7-ab61-b4358b3817c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:42.751277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:42.751277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:42.751277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:42.751277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:42.751277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:42.751277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:42.751277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:42.751277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:42.751277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:42.751277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:42.751277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:42.751277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:42.751277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:42.751277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:42.751277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:42.752366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:42.752366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:42.752366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:42.752366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:42.752366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:42.752366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:42.752366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:42.752366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:42.752366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:42.752366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:42.752366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:42.752366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:42.752366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:42.752366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:42.752366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:42.752366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:42.752366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:42.756960 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:42.756960 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:42.756960 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:42.756960 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 404/797] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:42.760371 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe08767-77d8-4e2c-a2e5-8e7bc21b9154 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:42.861278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe08767-77d8-4e2c-a2e5-8e7bc21b9154 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:42.894450 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0d213-1cd0-4892-8d30-8aa0bae91447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:42.895244 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0d213-1cd0-4892-8d30-8aa0bae91447 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:42.895607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0d213-1cd0-4892-8d30-8aa0bae91447 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:42.896475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0d213-1cd0-4892-8d30-8aa0bae91447 None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:42.897107 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0d213-1cd0-4892-8d30-8aa0bae91447 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:42.897447 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0d213-1cd0-4892-8d30-8aa0bae91447 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:42.898828 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0d213-1cd0-4892-8d30-8aa0bae91447 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:42.910319 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 394/798] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:42.916425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e7343-6c10-47c7-ab61-b4358b3817c1 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:43.023157 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e7343-6c10-47c7-ab61-b4358b3817c1 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:43.056230 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128b29c-08f8-4950-ba40-cb76cb2a5e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:43.056846 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128b29c-08f8-4950-ba40-cb76cb2a5e00 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:43.057120 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128b29c-08f8-4950-ba40-cb76cb2a5e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:43.057386 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128b29c-08f8-4950-ba40-cb76cb2a5e00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:43.063783 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128b29c-08f8-4950-ba40-cb76cb2a5e00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:43.065207 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128b29c-08f8-4950-ba40-cb76cb2a5e00 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:43.077201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-a128b29c-08f8-4950-ba40-cb76cb2a5e00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:43.077201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:43.077201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:43.077201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:43.077201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:43.077201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:43.077201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:43.077201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:43.077201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:43.077201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:43.077201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:43.077201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:43.077201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:01:43.077201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:01:43.077201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:01:43.078166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:01:43.078166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:43.078166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:43.078166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:43.078166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:43.078166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:43.078166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:43.078166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:43.078166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:43.078166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:43.078166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:43.078166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:43.078166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:43.078166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:43.078166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:43.078166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:43.078166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:43.085120 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:01:43.085120 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:01:43.085120 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:01:43.085120 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:01:43.085120 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:01:43.085120 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:01:43.085120 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:43.085120 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:43.085120 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 405/799] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:01:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:43.085655 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0d213-1cd0-4892-8d30-8aa0bae91447 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:43.139976 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:43.191006 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0d213-1cd0-4892-8d30-8aa0bae91447 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:43.227203 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29201111-66ef-444e-bf16-f8d1eb834193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:43.228188 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29201111-66ef-444e-bf16-f8d1eb834193 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:43.228710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29201111-66ef-444e-bf16-f8d1eb834193 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:43.229198 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29201111-66ef-444e-bf16-f8d1eb834193 None admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:43.230029 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29201111-66ef-444e-bf16-f8d1eb834193 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:43.230475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29201111-66ef-444e-bf16-f8d1eb834193 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:43.232076 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29201111-66ef-444e-bf16-f8d1eb834193 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:43.249217 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 395/800] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 24 13:01:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:43.250996 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128b29c-08f8-4950-ba40-cb76cb2a5e00 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:43.260928 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:43.355847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128b29c-08f8-4950-ba40-cb76cb2a5e00 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:43.389871 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203988c-baf3-4f89-8254-5991566e2716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:43.390738 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203988c-baf3-4f89-8254-5991566e2716 None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:43.391134 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203988c-baf3-4f89-8254-5991566e2716 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:43.391539 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203988c-baf3-4f89-8254-5991566e2716 None admin] PATH_INFO: `/v3/projects/f230a12ca6234faabf984e4a58a0d2e8/users/4f6b27c7d052437a949a371169fb48ff/roles/b16a8ec40d5545828c8c459f737209de` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:43.393774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203988c-baf3-4f89-8254-5991566e2716 None admin] RBAC: Authorizing `identity:create_grant(project_id=f230a12ca6234faabf984e4a58a0d2e8, user_id=4f6b27c7d052437a949a371169fb48ff, role_id=b16a8ec40d5545828c8c459f737209de)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:43.395309 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203988c-baf3-4f89-8254-5991566e2716 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:43.408475 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 406/801] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 13:01:43 2022] PUT /identity/v3/projects/f230a12ca6234faabf984e4a58a0d2e8/users/4f6b27c7d052437a949a371169fb48ff/roles/b16a8ec40d5545828c8c459f737209de => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:01:43.561612 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc755c-748f-45d2-89fd-8f28e1b8c967 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:43.562183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc755c-748f-45d2-89fd-8f28e1b8c967 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:43.562183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc755c-748f-45d2-89fd-8f28e1b8c967 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:43.563705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 396/802] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:01:43.569450 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c310fad-b6b2-48db-8b41-1dc7f90e0a27 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:43.569734 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c310fad-b6b2-48db-8b41-1dc7f90e0a27 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:43.570011 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c310fad-b6b2-48db-8b41-1dc7f90e0a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:43.590599 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-4c310fad-b6b2-48db-8b41-1dc7f90e0a27 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:43.592021 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4c310fad-b6b2-48db-8b41-1dc7f90e0a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:43.653971 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:43.663911 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 407/803] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:43.844892 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97b61d-600d-4551-b2a3-05130860a86b None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:43.845233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97b61d-600d-4551-b2a3-05130860a86b None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:43.845469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97b61d-600d-4551-b2a3-05130860a86b None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:43.846811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 397/804] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:43.852733 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f7de4-cf16-49dd-9b2e-ffcd32400ced None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:43.853022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f7de4-cf16-49dd-9b2e-ffcd32400ced None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:43.853298 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f7de4-cf16-49dd-9b2e-ffcd32400ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:43.872129 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-350f7de4-cf16-49dd-9b2e-ffcd32400ced None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:43.873298 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-350f7de4-cf16-49dd-9b2e-ffcd32400ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:43.937598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97b61d-600d-4551-b2a3-05130860a86b None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:43.941540 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 408/805] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:44.040015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97b61d-600d-4551-b2a3-05130860a86b None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:44.053125 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:44.075294 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff758d-a738-4140-8024-c5013239c135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:44.075920 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff758d-a738-4140-8024-c5013239c135 None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:44.076246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff758d-a738-4140-8024-c5013239c135 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:44.076508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff758d-a738-4140-8024-c5013239c135 None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:44.077179 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff758d-a738-4140-8024-c5013239c135 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:44.078546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff758d-a738-4140-8024-c5013239c135 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:44.086731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.sql.core [None req-96ff758d-a738-4140-8024-c5013239c135 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 13:01:44.086731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 13:01:44.086731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [parameters: {'id': 'db24479b4a4d407693f879d3dcfd6620', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 24 13:01:44.086731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81600) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 13:01:44.094349 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-96ff758d-a738-4140-8024-c5013239c135 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 24 13:01:44.094349 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:44.094349 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 13:01:44.094349 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 13:01:44.094349 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 13:01:44.094349 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 13:01:44.094349 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 13:01:44.094349 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 13:01:44.094349 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 13:01:44.094349 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application conn.query(q) Oct 24 13:01:44.094349 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 13:01:44.094349 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 13:01:44.094349 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 13:01:44.094349 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application result.read() Oct 24 13:01:44.095176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 13:01:44.095176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 13:01:44.095176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 13:01:44.095176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 13:01:44.095176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 13:01:44.095176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 13:01:44.095176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 13:01:44.095176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 13:01:44.095176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 13:01:44.095176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:44.095176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 13:01:44.095176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:44.095176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:44.095176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 13:01:44.095176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 13:01:44.095176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 24 13:01:44.095176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 24 13:01:44.095176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 13:01:44.096546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application next(self.gen) Oct 24 13:01:44.096546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 13:01:44.096546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application yield resource Oct 24 13:01:44.096546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 13:01:44.096546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application next(self.gen) Oct 24 13:01:44.096546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 13:01:44.096546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 13:01:44.096546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 13:01:44.096546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 13:01:44.096546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 13:01:44.096546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise self.value Oct 24 13:01:44.096546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 13:01:44.096546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 13:01:44.096546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 13:01:44.096546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application session.commit() Oct 24 13:01:44.096546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 13:01:44.096546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 13:01:44.097477 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 13:01:44.097477 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 13:01:44.097477 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 13:01:44.097477 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self.session.flush() Oct 24 13:01:44.097477 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 13:01:44.097477 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 13:01:44.097477 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 13:01:44.097477 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 13:01:44.097477 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 13:01:44.097477 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application compat.raise_( Oct 24 13:01:44.097477 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 13:01:44.097477 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception Oct 24 13:01:44.097477 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 13:01:44.097477 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 13:01:44.097477 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 13:01:44.097477 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 13:01:44.097477 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 13:01:44.098912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 13:01:44.098912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 13:01:44.098912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 13:01:44.098912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 24 13:01:44.098912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 24 13:01:44.098912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 13:01:44.098912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 13:01:44.098912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 13:01:44.098912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 13:01:44.098912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 13:01:44.098912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 13:01:44.098912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 13:01:44.098912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 13:01:44.098912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 13:01:44.098912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 13:01:44.101167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 13:01:44.101167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception Oct 24 13:01:44.101167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 13:01:44.101167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 13:01:44.101167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 13:01:44.101167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 13:01:44.101167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 13:01:44.101167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 13:01:44.101167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 13:01:44.101167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application conn.query(q) Oct 24 13:01:44.101167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 13:01:44.101167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 13:01:44.101167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 13:01:44.101167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application result.read() Oct 24 13:01:44.101167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 13:01:44.101167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 13:01:44.101167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 13:01:44.103725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 13:01:44.103725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 13:01:44.103725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 13:01:44.103725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 13:01:44.103725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 13:01:44.103725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 13:01:44.103725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 13:01:44.103725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [parameters: {'id': 'db24479b4a4d407693f879d3dcfd6620', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 24 13:01:44.103725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 13:01:44.103725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:44.103725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:44.103725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:44.103725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:44.103725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 24 13:01:44.103725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 24 13:01:44.105658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 13:01:44.105658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 13:01:44.105658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 24 13:01:44.105658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:44.105658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:01:44.105658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:44.105658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:44.105658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:44.105658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:44.105658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:44.105658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:44.105658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:44.105658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:44.105658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:44.105658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:44.105658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:44.105658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:44.108001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 24 13:01:44.108001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 24 13:01:44.108001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:44.108001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:44.108001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 24 13:01:44.108001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 24 13:01:44.108001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:44.108001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:44.108001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 24 13:01:44.108001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 24 13:01:44.108001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 24 13:01:44.108001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:44.108001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 398/806] 10.222.0.18 () {60 vars in 1137 bytes} [Mon Oct 24 13:01:43 2022] POST /identity/v3/domains => generated 190 bytes in 164 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:01:44.109661 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f7de4-cf16-49dd-9b2e-ffcd32400ced None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:44.207810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f7de4-cf16-49dd-9b2e-ffcd32400ced None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:44.219347 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff758d-a738-4140-8024-c5013239c135 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:44.238379 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:44.247710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4f96f-1739-4663-9bd9-7fb91aad19bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:44.248338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4f96f-1739-4663-9bd9-7fb91aad19bd None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:44.248610 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4f96f-1739-4663-9bd9-7fb91aad19bd None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:44.248878 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4f96f-1739-4663-9bd9-7fb91aad19bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:44.260178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4f96f-1739-4663-9bd9-7fb91aad19bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:44.261631 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4f96f-1739-4663-9bd9-7fb91aad19bd None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:44.278467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-fde4f96f-1739-4663-9bd9-7fb91aad19bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:44.278467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:44.278467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:44.278467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:44.278467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:44.278467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:44.278467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:44.278467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:44.278467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:44.278467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:44.278467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:44.278467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:44.278467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:44.278467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:44.278467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:44.278467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:44.279698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:44.279698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:44.279698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:44.279698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:44.279698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:44.279698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:44.279698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:44.279698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:44.279698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:44.279698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:44.279698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:44.279698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:44.279698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:44.279698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:44.279698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:44.279698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:44.279698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:44.280614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:44.280614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:44.280614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:44.280614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 409/807] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:44.285573 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4f96f-1739-4663-9bd9-7fb91aad19bd None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:44.338101 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff758d-a738-4140-8024-c5013239c135 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:44.376647 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717e367-8050-4c83-858f-2e2ea807d329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:44.377278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717e367-8050-4c83-858f-2e2ea807d329 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:44.377556 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717e367-8050-4c83-858f-2e2ea807d329 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:44.377827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717e367-8050-4c83-858f-2e2ea807d329 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:44.378917 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717e367-8050-4c83-858f-2e2ea807d329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:44.380433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717e367-8050-4c83-858f-2e2ea807d329 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:44.381982 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 399/808] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:44.387689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717e367-8050-4c83-858f-2e2ea807d329 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:44.403407 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4f96f-1739-4663-9bd9-7fb91aad19bd None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:44.436253 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:44.444102 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a68eab-8dfc-4151-97d9-6730a1fca11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:44.444702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a68eab-8dfc-4151-97d9-6730a1fca11c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:44.444981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a68eab-8dfc-4151-97d9-6730a1fca11c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:44.445247 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a68eab-8dfc-4151-97d9-6730a1fca11c None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:44.445879 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a68eab-8dfc-4151-97d9-6730a1fca11c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:44.446610 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a68eab-8dfc-4151-97d9-6730a1fca11c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:44.448262 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a68eab-8dfc-4151-97d9-6730a1fca11c None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:44.461197 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 410/809] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:44.500814 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717e367-8050-4c83-858f-2e2ea807d329 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:44.542364 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594f887-699f-4224-94e8-efca8fb1e197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:44.542815 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594f887-699f-4224-94e8-efca8fb1e197 None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:44.543211 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594f887-699f-4224-94e8-efca8fb1e197 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:44.543595 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594f887-699f-4224-94e8-efca8fb1e197 None admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:44.544354 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594f887-699f-4224-94e8-efca8fb1e197 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:44.545914 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594f887-699f-4224-94e8-efca8fb1e197 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:44.574376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 400/810] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 24 13:01:44 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:01:45.602778 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc093d70-1fa5-462c-95ae-9dde904a489a None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:45.603306 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc093d70-1fa5-462c-95ae-9dde904a489a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:45.603306 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc093d70-1fa5-462c-95ae-9dde904a489a None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:45.604639 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 411/811] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:45.609953 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0e40f-5561-417d-8d0f-18a37eeb0d59 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:45.610352 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0e40f-5561-417d-8d0f-18a37eeb0d59 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:45.610486 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0e40f-5561-417d-8d0f-18a37eeb0d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:45.628168 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-56c0e40f-5561-417d-8d0f-18a37eeb0d59 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:45.629317 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-56c0e40f-5561-417d-8d0f-18a37eeb0d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:45.693623 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 401/812] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:45.963291 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc093d70-1fa5-462c-95ae-9dde904a489a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:46.002821 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:46.061709 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc093d70-1fa5-462c-95ae-9dde904a489a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:46.094857 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126270e7-7849-484e-9007-bc8f31db645e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:46.095616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126270e7-7849-484e-9007-bc8f31db645e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:46.095899 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126270e7-7849-484e-9007-bc8f31db645e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:46.096164 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126270e7-7849-484e-9007-bc8f31db645e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:46.106071 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126270e7-7849-484e-9007-bc8f31db645e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:01:46.110800 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-126270e7-7849-484e-9007-bc8f31db645e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 13:01:46.110800 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:46.110800 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:46.110800 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:46.110800 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:46.110800 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:46.110800 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:46.110800 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:46.110800 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:46.110800 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:46.110800 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:46.110800 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:46.110800 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:01:46.110800 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:01:46.110800 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:01:46.110800 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:01:46.111858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:01:46.111858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:01:46.111858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:01:46.111858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:01:46.111858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:46.111858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:46.111858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:46.111858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:46.111858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:46.111858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:46.111858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:46.111858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:46.111858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:46.111858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:46.111858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:46.111858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:46.112805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:46.112805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:46.112805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:46.112805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:46.112805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:01:46.112805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:01:46.112805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:01:46.112805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:01:46.112805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:01:46.112805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:01:46.112805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 13:01:46.112805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:46.112805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 412/813] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Oct 24 13:01:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:46.117851 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0e40f-5561-417d-8d0f-18a37eeb0d59 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:46.147549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:46.218347 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0e40f-5561-417d-8d0f-18a37eeb0d59 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:46.253330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef9ea7-f334-4b4a-82ac-63ecb9b2cd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:46.253927 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef9ea7-f334-4b4a-82ac-63ecb9b2cd59 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:46.254201 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef9ea7-f334-4b4a-82ac-63ecb9b2cd59 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:46.254468 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef9ea7-f334-4b4a-82ac-63ecb9b2cd59 None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:46.255667 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef9ea7-f334-4b4a-82ac-63ecb9b2cd59 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:46.255972 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef9ea7-f334-4b4a-82ac-63ecb9b2cd59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:46.257342 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef9ea7-f334-4b4a-82ac-63ecb9b2cd59 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:46.265410 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 402/814] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Oct 24 13:01:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:46.271988 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126270e7-7849-484e-9007-bc8f31db645e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:46.366042 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:46.370158 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126270e7-7849-484e-9007-bc8f31db645e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:46.402886 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8b448-6b54-484d-86ca-6f5d1af28867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:46.403531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8b448-6b54-484d-86ca-6f5d1af28867 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:46.403807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8b448-6b54-484d-86ca-6f5d1af28867 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:46.404069 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8b448-6b54-484d-86ca-6f5d1af28867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:46.413902 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8b448-6b54-484d-86ca-6f5d1af28867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:46.415327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8b448-6b54-484d-86ca-6f5d1af28867 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:46.430138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-1af8b448-6b54-484d-86ca-6f5d1af28867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:46.430138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:46.430138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:46.430138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:46.430138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:46.430138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:46.430138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:46.430138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:46.430138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:46.430138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:46.430138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:46.430138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:46.430138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:46.430138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:46.430138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:46.430138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:46.431283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:46.431283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:46.431283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:46.431283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:46.431283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:46.431283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:46.431283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:46.431283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:46.431283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:46.431283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:46.431283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:46.431283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:46.431283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:46.431283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:46.431283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:46.431283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:46.431283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:46.432244 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:46.432244 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:46.432244 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:46.432244 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 413/815] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:46.437042 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef9ea7-f334-4b4a-82ac-63ecb9b2cd59 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:46.528206 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:46.538550 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef9ea7-f334-4b4a-82ac-63ecb9b2cd59 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:46.572473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c223b-4be4-4b94-8019-47c2d58021ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:46.573075 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c223b-4be4-4b94-8019-47c2d58021ef None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:46.573351 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c223b-4be4-4b94-8019-47c2d58021ef None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:46.573620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c223b-4be4-4b94-8019-47c2d58021ef None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:46.574250 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c223b-4be4-4b94-8019-47c2d58021ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:46.574548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c223b-4be4-4b94-8019-47c2d58021ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:46.575954 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c223b-4be4-4b94-8019-47c2d58021ef None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:46.587902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 403/816] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:46.593516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8b448-6b54-484d-86ca-6f5d1af28867 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:46.691144 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8b448-6b54-484d-86ca-6f5d1af28867 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:46.726467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced9a80-368a-442c-b932-da75d3ba62a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:46.727093 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced9a80-368a-442c-b932-da75d3ba62a2 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:46.727366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced9a80-368a-442c-b932-da75d3ba62a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:46.727660 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced9a80-368a-442c-b932-da75d3ba62a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:46.735011 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced9a80-368a-442c-b932-da75d3ba62a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:46.736531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced9a80-368a-442c-b932-da75d3ba62a2 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:46.747671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-1ced9a80-368a-442c-b932-da75d3ba62a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:01:46.747671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:46.747671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:46.747671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:46.747671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:46.747671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:46.747671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:46.747671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:46.747671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:46.747671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:46.747671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:46.747671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:46.747671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:01:46.747671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:01:46.747671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:01:46.747671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:01:46.748810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:46.748810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:46.748810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:01:46.748810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:46.748810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:01:46.748810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:46.748810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:46.748810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:46.748810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:46.748810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:46.748810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:46.748810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:46.748810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:46.748810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:46.748810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:46.748810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:46.748810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:46.748810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:46.749786 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:46.749786 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:46.749786 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:01:46.749786 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:01:46.749786 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:01:46.749786 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:01:46.749786 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:01:46.749786 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:01:46.749786 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:01:46.749786 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:46.749786 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 414/817] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Oct 24 13:01:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:46.754778 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c223b-4be4-4b94-8019-47c2d58021ef None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:46.794407 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4118f-5029-4818-a10b-e04bbcc4d7a7 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:46.794621 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4118f-5029-4818-a10b-e04bbcc4d7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:46.794901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4118f-5029-4818-a10b-e04bbcc4d7a7 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:46.796252 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 415/818] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:01:46.801386 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4cc3d-8916-4a84-b721-6045878e0b21 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:46.801724 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4cc3d-8916-4a84-b721-6045878e0b21 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:46.802367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4cc3d-8916-4a84-b721-6045878e0b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:46.820244 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-2ba4cc3d-8916-4a84-b721-6045878e0b21 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:46.821409 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2ba4cc3d-8916-4a84-b721-6045878e0b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:46.824331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:46.854933 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c223b-4be4-4b94-8019-47c2d58021ef None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:46.888884 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c853049-f8cc-4bad-b3b5-54a221c74230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:46.889273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 416/819] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:01:46.889474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c853049-f8cc-4bad-b3b5-54a221c74230 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:46.889754 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c853049-f8cc-4bad-b3b5-54a221c74230 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:46.890021 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c853049-f8cc-4bad-b3b5-54a221c74230 None admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:46.890734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c853049-f8cc-4bad-b3b5-54a221c74230 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:46.891031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c853049-f8cc-4bad-b3b5-54a221c74230 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:46.892495 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c853049-f8cc-4bad-b3b5-54a221c74230 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:46.909695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 404/820] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Oct 24 13:01:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:46.915549 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4cc3d-8916-4a84-b721-6045878e0b21 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:47.009006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4cc3d-8916-4a84-b721-6045878e0b21 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:47.041067 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db9487-62cf-4357-9632-f8ab0d2c6371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:47.041653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db9487-62cf-4357-9632-f8ab0d2c6371 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:47.041926 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db9487-62cf-4357-9632-f8ab0d2c6371 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:47.042190 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db9487-62cf-4357-9632-f8ab0d2c6371 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:47.052537 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:47.106335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db9487-62cf-4357-9632-f8ab0d2c6371 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:47.107799 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db9487-62cf-4357-9632-f8ab0d2c6371 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:47.159736 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c853049-f8cc-4bad-b3b5-54a221c74230 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:47.171802 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:47.202892 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 417/821] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:01:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:01:47.208680 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db9487-62cf-4357-9632-f8ab0d2c6371 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:47.247684 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:47.261612 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c853049-f8cc-4bad-b3b5-54a221c74230 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:47.294346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053ccaf-4928-4d91-adc2-25da598ac1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:47.294963 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053ccaf-4928-4d91-adc2-25da598ac1bd None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:47.295236 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053ccaf-4928-4d91-adc2-25da598ac1bd None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:47.295549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053ccaf-4928-4d91-adc2-25da598ac1bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:47.303763 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db9487-62cf-4357-9632-f8ab0d2c6371 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:47.305868 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053ccaf-4928-4d91-adc2-25da598ac1bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:01:47.310688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-4053ccaf-4928-4d91-adc2-25da598ac1bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:01:47.310688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:47.310688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:47.310688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:47.310688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:47.310688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:47.310688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:47.310688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:47.310688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:47.310688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:47.310688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:47.310688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:47.310688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:01:47.310688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:01:47.310688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:01:47.310688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:01:47.311818 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:01:47.311818 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:01:47.311818 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:01:47.311818 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:01:47.311818 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:47.311818 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:47.311818 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:47.311818 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:47.311818 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:47.311818 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:47.311818 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:47.311818 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:47.311818 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:47.311818 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:47.311818 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:47.311818 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:47.312772 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:47.312772 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:47.312772 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:47.312772 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:47.312772 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:01:47.312772 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:01:47.312772 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:01:47.312772 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:01:47.312772 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:01:47.312772 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:01:47.312772 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:01:47.312772 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:47.313959 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 405/822] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 24 13:01:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:01:47.318310 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053ccaf-4928-4d91-adc2-25da598ac1bd None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:47.337201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c01803-2a4c-4776-b4f3-41d792b7af43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:47.337823 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c01803-2a4c-4776-b4f3-41d792b7af43 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:47.338093 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c01803-2a4c-4776-b4f3-41d792b7af43 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:47.338358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c01803-2a4c-4776-b4f3-41d792b7af43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:47.348761 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c01803-2a4c-4776-b4f3-41d792b7af43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:47.350441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c01803-2a4c-4776-b4f3-41d792b7af43 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:47.366454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-04c01803-2a4c-4776-b4f3-41d792b7af43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:47.366454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:47.366454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:47.366454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:47.366454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:47.366454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:47.366454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:47.366454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:47.366454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:47.366454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:47.366454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:47.366454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:47.366454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:47.366454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:47.366454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:47.366454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:47.372613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:47.372613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:47.372613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:47.372613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:47.372613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:47.372613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:47.372613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:47.372613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:47.372613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:47.372613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:47.372613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:47.372613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:47.372613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:47.372613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:47.372613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:47.372613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:47.372613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:47.373559 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:47.373559 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:47.373559 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:47.373559 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 418/823] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:01:47.373559 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c01803-2a4c-4776-b4f3-41d792b7af43 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:47.389091 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:47.421583 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053ccaf-4928-4d91-adc2-25da598ac1bd None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:47.455601 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a4b3b-6522-4775-980b-add40d245801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:47.456195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a4b3b-6522-4775-980b-add40d245801 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:47.456470 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a4b3b-6522-4775-980b-add40d245801 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:47.456738 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a4b3b-6522-4775-980b-add40d245801 None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:47.457387 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a4b3b-6522-4775-980b-add40d245801 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:47.457710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a4b3b-6522-4775-980b-add40d245801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:47.459111 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a4b3b-6522-4775-980b-add40d245801 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:47.461763 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:47.467364 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 406/824] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:01:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:47.470354 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c01803-2a4c-4776-b4f3-41d792b7af43 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:47.473046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a4b3b-6522-4775-980b-add40d245801 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:47.503884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7e9a2-9388-4869-a538-6a8226f44a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:47.504479 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7e9a2-9388-4869-a538-6a8226f44a49 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:47.504753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7e9a2-9388-4869-a538-6a8226f44a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:47.505225 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7e9a2-9388-4869-a538-6a8226f44a49 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:47.505875 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7e9a2-9388-4869-a538-6a8226f44a49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:47.506173 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7e9a2-9388-4869-a538-6a8226f44a49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:47.507548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7e9a2-9388-4869-a538-6a8226f44a49 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:47.518649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 419/825] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:47.524436 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7e9a2-9388-4869-a538-6a8226f44a49 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:47.577332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a4b3b-6522-4775-980b-add40d245801 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:47.605654 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:47.610902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a1305-8565-4552-b334-052a56dd85aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:47.611615 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a1305-8565-4552-b334-052a56dd85aa None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:47.612017 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a1305-8565-4552-b334-052a56dd85aa None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:47.612305 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a1305-8565-4552-b334-052a56dd85aa None admin] PATH_INFO: `/v3/users/5e40f0edb7944d89adaca02a44a0d9c2` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:47.626444 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7e9a2-9388-4869-a538-6a8226f44a49 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:47.626596 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a1305-8565-4552-b334-052a56dd85aa None admin] RBAC: Authorizing `identity:get_user(user_id=5e40f0edb7944d89adaca02a44a0d9c2)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:47.628047 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a1305-8565-4552-b334-052a56dd85aa None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:47.629675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 407/826] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:01:47 2022] GET /identity/v3/users/5e40f0edb7944d89adaca02a44a0d9c2 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:47.635372 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a1305-8565-4552-b334-052a56dd85aa None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:47.660336 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e683d74-9983-4816-abfc-7ba64dac3e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:47.660953 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e683d74-9983-4816-abfc-7ba64dac3e58 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:47.661891 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e683d74-9983-4816-abfc-7ba64dac3e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:47.662201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e683d74-9983-4816-abfc-7ba64dac3e58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:47.668690 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e683d74-9983-4816-abfc-7ba64dac3e58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:47.670107 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e683d74-9983-4816-abfc-7ba64dac3e58 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:47.681785 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-5e683d74-9983-4816-abfc-7ba64dac3e58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:47.681785 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:47.681785 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:47.681785 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:47.681785 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:47.681785 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:47.681785 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:47.681785 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:47.681785 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:47.681785 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:47.681785 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:47.681785 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:47.681785 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:01:47.681785 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:01:47.681785 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:01:47.682863 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:01:47.682863 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:47.682863 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:47.682863 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:47.682863 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:47.682863 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:47.682863 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:47.682863 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:47.682863 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:47.682863 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:47.682863 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:47.682863 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:47.682863 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:47.682863 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:47.682863 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:47.682863 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:47.682863 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:47.683997 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:01:47.683997 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:01:47.683997 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:01:47.683997 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:01:47.683997 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:01:47.683997 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:01:47.683997 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:47.683997 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:01:47.683997 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 420/827] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:01:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:01:47.688520 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e683d74-9983-4816-abfc-7ba64dac3e58 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:47.703152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:47.736897 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a1305-8565-4552-b334-052a56dd85aa None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:47.772501 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc2172-5ab7-4e3c-8e3b-6d1ccd82ac22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:47.773144 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc2172-5ab7-4e3c-8e3b-6d1ccd82ac22 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:47.773381 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc2172-5ab7-4e3c-8e3b-6d1ccd82ac22 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:47.773647 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc2172-5ab7-4e3c-8e3b-6d1ccd82ac22 None admin] PATH_INFO: `/v3/projects/a763e16ffa0642e5a884772398f073ce` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:47.774730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc2172-5ab7-4e3c-8e3b-6d1ccd82ac22 None admin] RBAC: Authorizing `identity:get_project(project_id=a763e16ffa0642e5a884772398f073ce)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:47.776178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc2172-5ab7-4e3c-8e3b-6d1ccd82ac22 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:47.777774 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 408/828] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:01:47 2022] GET /identity/v3/projects/a763e16ffa0642e5a884772398f073ce => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:47.783616 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc2172-5ab7-4e3c-8e3b-6d1ccd82ac22 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:47.788557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e683d74-9983-4816-abfc-7ba64dac3e58 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:47.823465 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26552d-fe28-47c3-9dae-ce728bb86fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:47.824069 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26552d-fe28-47c3-9dae-ce728bb86fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:47.824342 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26552d-fe28-47c3-9dae-ce728bb86fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:47.824609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26552d-fe28-47c3-9dae-ce728bb86fb3 None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:47.825288 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26552d-fe28-47c3-9dae-ce728bb86fb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:47.825586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26552d-fe28-47c3-9dae-ce728bb86fb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:47.827011 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26552d-fe28-47c3-9dae-ce728bb86fb3 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:47.839022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 421/829] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 24 13:01:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:47.844578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:47.844885 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26552d-fe28-47c3-9dae-ce728bb86fb3 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:47.886575 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc2172-5ab7-4e3c-8e3b-6d1ccd82ac22 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:47.911483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:47.919985 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961cc66-23a0-4575-8759-27b025c0dc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:47.920629 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961cc66-23a0-4575-8759-27b025c0dc50 None admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:47.920904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961cc66-23a0-4575-8759-27b025c0dc50 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:47.921168 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961cc66-23a0-4575-8759-27b025c0dc50 None admin] PATH_INFO: `/v3/projects/a763e16ffa0642e5a884772398f073ce/users/5e40f0edb7944d89adaca02a44a0d9c2/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:47.923537 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961cc66-23a0-4575-8759-27b025c0dc50 None admin] RBAC: Authorizing `identity:create_grant(project_id=a763e16ffa0642e5a884772398f073ce, user_id=5e40f0edb7944d89adaca02a44a0d9c2, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:47.924965 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961cc66-23a0-4575-8759-27b025c0dc50 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:47.938347 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 409/830] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 13:01:47 2022] PUT /identity/v3/projects/a763e16ffa0642e5a884772398f073ce/users/5e40f0edb7944d89adaca02a44a0d9c2/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:01:47.941990 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26552d-fe28-47c3-9dae-ce728bb86fb3 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:47.979220 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c01649-8611-401f-8d69-ed5fff695c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:47.979892 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c01649-8611-401f-8d69-ed5fff695c44 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:47.980166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c01649-8611-401f-8d69-ed5fff695c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:47.980432 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c01649-8611-401f-8d69-ed5fff695c44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:47.981159 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c01649-8611-401f-8d69-ed5fff695c44 None admin] RBAC: Adding query filter params (role.id=b16a8ec40d5545828c8c459f737209de, scope.project.id=f230a12ca6234faabf984e4a58a0d2e8, user.id=4f6b27c7d052437a949a371169fb48ff) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:47.981460 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c01649-8611-401f-8d69-ed5fff695c44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:47.982889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c01649-8611-401f-8d69-ed5fff695c44 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:47.990895 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 422/831] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:01:47 2022] GET /identity/v3/role_assignments?user.id=4f6b27c7d052437a949a371169fb48ff&scope.project.id=f230a12ca6234faabf984e4a58a0d2e8&role.id=b16a8ec40d5545828c8c459f737209de => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:50.068732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b96f8-c462-4b48-87ec-c748c2b71ccb None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:50.069266 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b96f8-c462-4b48-87ec-c748c2b71ccb None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:50.069266 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b96f8-c462-4b48-87ec-c748c2b71ccb None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:50.070585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 410/832] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:50.075939 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc602f-01dd-42f9-8e02-0f8c883102fa None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:50.076367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc602f-01dd-42f9-8e02-0f8c883102fa None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:50.076483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc602f-01dd-42f9-8e02-0f8c883102fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:50.095027 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-7efc602f-01dd-42f9-8e02-0f8c883102fa None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:50.096222 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7efc602f-01dd-42f9-8e02-0f8c883102fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:50.159962 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 423/833] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:50.427881 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b96f8-c462-4b48-87ec-c748c2b71ccb None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:50.526741 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b96f8-c462-4b48-87ec-c748c2b71ccb None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:50.543405 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:50.561236 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013b429-8383-4b36-a73e-d94e835250ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:50.561854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013b429-8383-4b36-a73e-d94e835250ce None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:50.562128 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013b429-8383-4b36-a73e-d94e835250ce None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:50.562392 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013b429-8383-4b36-a73e-d94e835250ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:50.572928 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013b429-8383-4b36-a73e-d94e835250ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:01:50.577701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-4013b429-8383-4b36-a73e-d94e835250ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:01:50.577701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:50.577701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:50.577701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:50.577701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:50.577701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:50.577701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:50.577701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:50.577701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:50.577701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:50.577701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:50.577701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:50.577701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:01:50.577701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:01:50.577701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:01:50.577701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:01:50.578805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:01:50.578805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:01:50.578805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:01:50.578805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:01:50.578805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:50.578805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:50.578805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:50.578805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:50.578805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:50.578805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:50.578805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:50.578805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:50.578805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:50.578805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:50.578805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:50.578805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:50.579723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:50.579723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:50.579723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:50.579723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:50.579723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:01:50.579723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:01:50.579723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:01:50.579723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:01:50.579723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:01:50.579723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:01:50.579723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:01:50.579723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:01:50.579723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 411/834] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 24 13:01:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:50.585311 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc602f-01dd-42f9-8e02-0f8c883102fa None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:50.647510 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:50.680658 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc602f-01dd-42f9-8e02-0f8c883102fa None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:50.714895 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d74ad-3dba-401e-bab9-9a8647fe536f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:50.715510 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d74ad-3dba-401e-bab9-9a8647fe536f None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:50.715793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d74ad-3dba-401e-bab9-9a8647fe536f None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:50.716061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d74ad-3dba-401e-bab9-9a8647fe536f None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:50.716708 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d74ad-3dba-401e-bab9-9a8647fe536f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:50.717006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d74ad-3dba-401e-bab9-9a8647fe536f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:50.718352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d74ad-3dba-401e-bab9-9a8647fe536f None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:50.726054 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 424/835] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:01:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:50.731940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013b429-8383-4b36-a73e-d94e835250ce None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:50.830316 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013b429-8383-4b36-a73e-d94e835250ce None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:50.862200 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6254ce6-b4b3-42c2-895a-2c3dd8ed3f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:50.862806 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6254ce6-b4b3-42c2-895a-2c3dd8ed3f56 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:50.863076 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6254ce6-b4b3-42c2-895a-2c3dd8ed3f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:50.863340 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6254ce6-b4b3-42c2-895a-2c3dd8ed3f56 None admin] PATH_INFO: `/v3/users/5e40f0edb7944d89adaca02a44a0d9c2` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:50.865099 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6254ce6-b4b3-42c2-895a-2c3dd8ed3f56 None admin] RBAC: Authorizing `identity:get_user(user_id=5e40f0edb7944d89adaca02a44a0d9c2)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:50.866526 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6254ce6-b4b3-42c2-895a-2c3dd8ed3f56 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:50.868089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 412/836] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:01:50 2022] GET /identity/v3/users/5e40f0edb7944d89adaca02a44a0d9c2 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:50.873852 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d74ad-3dba-401e-bab9-9a8647fe536f None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:50.971118 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d74ad-3dba-401e-bab9-9a8647fe536f None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:50.995978 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:51.003732 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7aa51-d124-490e-8ed6-b71d54af1519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:51.004319 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7aa51-d124-490e-8ed6-b71d54af1519 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:51.005198 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7aa51-d124-490e-8ed6-b71d54af1519 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:51.005557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7aa51-d124-490e-8ed6-b71d54af1519 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:51.069294 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7aa51-d124-490e-8ed6-b71d54af1519 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:51.070721 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7aa51-d124-490e-8ed6-b71d54af1519 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:51.163904 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 425/837] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:01:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:01:51.169775 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6254ce6-b4b3-42c2-895a-2c3dd8ed3f56 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:51.216789 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:51.268362 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6254ce6-b4b3-42c2-895a-2c3dd8ed3f56 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:51.301157 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023ebbc-a065-4f82-ad5c-fb98af5b4c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:51.301931 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023ebbc-a065-4f82-ad5c-fb98af5b4c6b None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:51.302205 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023ebbc-a065-4f82-ad5c-fb98af5b4c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:51.302468 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023ebbc-a065-4f82-ad5c-fb98af5b4c6b None admin] PATH_INFO: `/v3/projects/a763e16ffa0642e5a884772398f073ce` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:51.303572 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023ebbc-a065-4f82-ad5c-fb98af5b4c6b None admin] RBAC: Authorizing `identity:get_project(project_id=a763e16ffa0642e5a884772398f073ce)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:51.305025 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023ebbc-a065-4f82-ad5c-fb98af5b4c6b None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:51.306590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 413/838] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:01:51 2022] GET /identity/v3/projects/a763e16ffa0642e5a884772398f073ce => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:51.312564 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7aa51-d124-490e-8ed6-b71d54af1519 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:51.339605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:51.406392 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7aa51-d124-490e-8ed6-b71d54af1519 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:51.437923 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46800629-1155-4c3c-990a-8d5b9bc7ac05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:51.438500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46800629-1155-4c3c-990a-8d5b9bc7ac05 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:51.438772 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46800629-1155-4c3c-990a-8d5b9bc7ac05 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:51.439037 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46800629-1155-4c3c-990a-8d5b9bc7ac05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:51.439768 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46800629-1155-4c3c-990a-8d5b9bc7ac05 None admin] RBAC: Adding query filter params (role.id=23ca6ecd60b2470cba913daeaf54f0f7, scope.project.id=a763e16ffa0642e5a884772398f073ce, user.id=5e40f0edb7944d89adaca02a44a0d9c2) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:51.440067 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46800629-1155-4c3c-990a-8d5b9bc7ac05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:51.441465 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46800629-1155-4c3c-990a-8d5b9bc7ac05 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:51.447692 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 426/839] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:01:51 2022] GET /identity/v3/role_assignments?user.id=5e40f0edb7944d89adaca02a44a0d9c2&scope.project.id=a763e16ffa0642e5a884772398f073ce&role.id=23ca6ecd60b2470cba913daeaf54f0f7 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:53.596452 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d1cd5-f7e4-49a0-a2bc-d441ec3ebad2 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:53.596946 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d1cd5-f7e4-49a0-a2bc-d441ec3ebad2 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:53.597037 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d1cd5-f7e4-49a0-a2bc-d441ec3ebad2 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:53.598844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 414/840] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:53.604438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34a855-3d91-4dc8-9055-a8e2b84f7a0a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:53.604855 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34a855-3d91-4dc8-9055-a8e2b84f7a0a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:53.604955 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34a855-3d91-4dc8-9055-a8e2b84f7a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:53.623012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-6d34a855-3d91-4dc8-9055-a8e2b84f7a0a None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:53.624206 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6d34a855-3d91-4dc8-9055-a8e2b84f7a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:53.687213 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 427/841] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:53.958526 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d1cd5-f7e4-49a0-a2bc-d441ec3ebad2 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:54.056574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d1cd5-f7e4-49a0-a2bc-d441ec3ebad2 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:54.069802 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:54.090093 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf04303-e00b-4557-8952-b5723599f627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:54.090698 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf04303-e00b-4557-8952-b5723599f627 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:54.090972 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf04303-e00b-4557-8952-b5723599f627 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:54.091243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf04303-e00b-4557-8952-b5723599f627 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:54.092350 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf04303-e00b-4557-8952-b5723599f627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:54.093774 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf04303-e00b-4557-8952-b5723599f627 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:54.095295 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 415/842] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:54.101566 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34a855-3d91-4dc8-9055-a8e2b84f7a0a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:54.124221 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:54.195624 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34a855-3d91-4dc8-9055-a8e2b84f7a0a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:54.228011 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddbbc0-0561-4af9-8af3-5c6041c88093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:54.228540 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddbbc0-0561-4af9-8af3-5c6041c88093 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:54.228813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddbbc0-0561-4af9-8af3-5c6041c88093 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:54.229079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddbbc0-0561-4af9-8af3-5c6041c88093 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:54.229715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddbbc0-0561-4af9-8af3-5c6041c88093 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:54.231119 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddbbc0-0561-4af9-8af3-5c6041c88093 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:54.251186 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 428/843] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 24 13:01:54 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:01:56.419483 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5c5da-7102-401e-92b4-be1037ee0271 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:56.420039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5c5da-7102-401e-92b4-be1037ee0271 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:56.420039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5c5da-7102-401e-92b4-be1037ee0271 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:56.421334 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 416/844] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:56.426407 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fde67-06ac-4c10-a3a4-5c3ccfd0c400 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:56.426821 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fde67-06ac-4c10-a3a4-5c3ccfd0c400 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:56.426947 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fde67-06ac-4c10-a3a4-5c3ccfd0c400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:56.444999 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-bd8fde67-06ac-4c10-a3a4-5c3ccfd0c400 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:56.446163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-bd8fde67-06ac-4c10-a3a4-5c3ccfd0c400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:56.510064 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 429/845] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:56.774652 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5c5da-7102-401e-92b4-be1037ee0271 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:56.874168 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5c5da-7102-401e-92b4-be1037ee0271 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:56.907275 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092dc32-feeb-4a19-aa77-c608110e452a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:56.907911 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092dc32-feeb-4a19-aa77-c608110e452a None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:56.908188 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092dc32-feeb-4a19-aa77-c608110e452a None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:56.908457 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092dc32-feeb-4a19-aa77-c608110e452a None admin] PATH_INFO: `/v3/roles/4bcba8c3ff16483b9115020b5b886522` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:56.909814 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092dc32-feeb-4a19-aa77-c608110e452a None admin] RBAC: Authorizing `identity:get_role(role_id=4bcba8c3ff16483b9115020b5b886522)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:56.911643 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092dc32-feeb-4a19-aa77-c608110e452a None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:56.912947 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 417/846] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:01:56 2022] GET /identity/v3/roles/4bcba8c3ff16483b9115020b5b886522 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:56.918789 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fde67-06ac-4c10-a3a4-5c3ccfd0c400 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:56.929374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:57.016026 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fde67-06ac-4c10-a3a4-5c3ccfd0c400 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:57.047868 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e050a98-394f-4c4c-b3cf-0f1fb48e7be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:57.048431 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e050a98-394f-4c4c-b3cf-0f1fb48e7be1 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:57.048707 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e050a98-394f-4c4c-b3cf-0f1fb48e7be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:57.048976 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e050a98-394f-4c4c-b3cf-0f1fb48e7be1 None admin] PATH_INFO: `/v3/users/d6e1eb6b9457419a8682c9a2f3ff70af` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:57.061929 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e050a98-394f-4c4c-b3cf-0f1fb48e7be1 None admin] RBAC: Authorizing `identity:get_user(user_id=d6e1eb6b9457419a8682c9a2f3ff70af)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:57.063355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e050a98-394f-4c4c-b3cf-0f1fb48e7be1 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:57.064924 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 430/847] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:01:56 2022] GET /identity/v3/users/d6e1eb6b9457419a8682c9a2f3ff70af => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:57.071513 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092dc32-feeb-4a19-aa77-c608110e452a None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:57.121021 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:57.170305 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092dc32-feeb-4a19-aa77-c608110e452a None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:57.204255 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e19e12-e454-4579-b7c4-c1dfdcf4f943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:57.204872 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e19e12-e454-4579-b7c4-c1dfdcf4f943 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:57.205153 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e19e12-e454-4579-b7c4-c1dfdcf4f943 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:57.205428 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e19e12-e454-4579-b7c4-c1dfdcf4f943 None admin] PATH_INFO: `/v3/projects/a763e16ffa0642e5a884772398f073ce` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:57.206525 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e19e12-e454-4579-b7c4-c1dfdcf4f943 None admin] RBAC: Authorizing `identity:get_project(project_id=a763e16ffa0642e5a884772398f073ce)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:57.208723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e19e12-e454-4579-b7c4-c1dfdcf4f943 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:57.210318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 418/848] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:01:57 2022] GET /identity/v3/projects/a763e16ffa0642e5a884772398f073ce => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:57.216425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e050a98-394f-4c4c-b3cf-0f1fb48e7be1 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:57.279485 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:57.311987 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e050a98-394f-4c4c-b3cf-0f1fb48e7be1 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:57.344992 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bcc43-34a4-4d2b-a0e5-30e77cfb5fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:57.345631 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bcc43-34a4-4d2b-a0e5-30e77cfb5fad None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:57.345907 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bcc43-34a4-4d2b-a0e5-30e77cfb5fad None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:57.346176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bcc43-34a4-4d2b-a0e5-30e77cfb5fad None admin] PATH_INFO: `/v3/projects/a763e16ffa0642e5a884772398f073ce/users/d6e1eb6b9457419a8682c9a2f3ff70af/roles/4bcba8c3ff16483b9115020b5b886522` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:57.348324 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bcc43-34a4-4d2b-a0e5-30e77cfb5fad None admin] RBAC: Authorizing `identity:create_grant(project_id=a763e16ffa0642e5a884772398f073ce, user_id=d6e1eb6b9457419a8682c9a2f3ff70af, role_id=4bcba8c3ff16483b9115020b5b886522)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:57.349731 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bcc43-34a4-4d2b-a0e5-30e77cfb5fad None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:57.362089 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 431/849] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 13:01:57 2022] PUT /identity/v3/projects/a763e16ffa0642e5a884772398f073ce/users/d6e1eb6b9457419a8682c9a2f3ff70af/roles/4bcba8c3ff16483b9115020b5b886522 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:01:59.486679 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436ff35-e1a2-47c2-b4a3-07bf45a2e99f None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:59.487212 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436ff35-e1a2-47c2-b4a3-07bf45a2e99f None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:59.487212 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436ff35-e1a2-47c2-b4a3-07bf45a2e99f None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:59.488608 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 419/850] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:59.493788 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060ce2e-1051-4fc8-b5af-c303a7f2af1d None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:59.494198 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060ce2e-1051-4fc8-b5af-c303a7f2af1d None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:59.494340 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060ce2e-1051-4fc8-b5af-c303a7f2af1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:59.513112 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d060ce2e-1051-4fc8-b5af-c303a7f2af1d None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:59.514282 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d060ce2e-1051-4fc8-b5af-c303a7f2af1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:59.581292 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 432/851] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:59.856622 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436ff35-e1a2-47c2-b4a3-07bf45a2e99f None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:59.956013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436ff35-e1a2-47c2-b4a3-07bf45a2e99f None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:59.972165 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:59.988043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b4b4c-e111-46ad-bbfb-8857ce3d5b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:59.989217 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b4b4c-e111-46ad-bbfb-8857ce3d5b32 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:59.989473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b4b4c-e111-46ad-bbfb-8857ce3d5b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:59.989736 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b4b4c-e111-46ad-bbfb-8857ce3d5b32 None admin] PATH_INFO: `/v3/roles/4bcba8c3ff16483b9115020b5b886522` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:59.991087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b4b4c-e111-46ad-bbfb-8857ce3d5b32 None admin] RBAC: Authorizing `identity:get_role(role_id=4bcba8c3ff16483b9115020b5b886522)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:59.992491 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b4b4c-e111-46ad-bbfb-8857ce3d5b32 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:59.993786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 420/852] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:01:59 2022] GET /identity/v3/roles/4bcba8c3ff16483b9115020b5b886522 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:59.999899 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060ce2e-1051-4fc8-b5af-c303a7f2af1d None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:00.053995 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:00.099444 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060ce2e-1051-4fc8-b5af-c303a7f2af1d None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:00.134483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e0824-d310-4bd0-ba21-4755fc8bc052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:00.135051 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e0824-d310-4bd0-ba21-4755fc8bc052 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:00.135329 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e0824-d310-4bd0-ba21-4755fc8bc052 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:00.135640 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e0824-d310-4bd0-ba21-4755fc8bc052 None admin] PATH_INFO: `/v3/users/d6e1eb6b9457419a8682c9a2f3ff70af` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:00.136741 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e0824-d310-4bd0-ba21-4755fc8bc052 None admin] RBAC: Authorizing `identity:get_user(user_id=d6e1eb6b9457419a8682c9a2f3ff70af)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:00.138159 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e0824-d310-4bd0-ba21-4755fc8bc052 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:00.139738 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 433/853] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:01:59 2022] GET /identity/v3/users/d6e1eb6b9457419a8682c9a2f3ff70af => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:00.145748 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b4b4c-e111-46ad-bbfb-8857ce3d5b32 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:00.244128 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b4b4c-e111-46ad-bbfb-8857ce3d5b32 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:00.276548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80553e-3cd0-464c-b080-f0eecfead8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:00.277139 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80553e-3cd0-464c-b080-f0eecfead8af None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:00.277414 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80553e-3cd0-464c-b080-f0eecfead8af None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:00.277682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80553e-3cd0-464c-b080-f0eecfead8af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:00.331113 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:00.347223 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80553e-3cd0-464c-b080-f0eecfead8af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:00.349678 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80553e-3cd0-464c-b080-f0eecfead8af None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:00.444549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 421/854] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:02:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:02:00.450707 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e0824-d310-4bd0-ba21-4755fc8bc052 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:00.550401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e0824-d310-4bd0-ba21-4755fc8bc052 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:00.573136 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:00.584324 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb611d-63c6-4ae1-9d46-a2978d9a4205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:00.584936 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb611d-63c6-4ae1-9d46-a2978d9a4205 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:00.585210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb611d-63c6-4ae1-9d46-a2978d9a4205 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:00.585480 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb611d-63c6-4ae1-9d46-a2978d9a4205 None admin] PATH_INFO: `/v3/projects/a763e16ffa0642e5a884772398f073ce` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:00.586586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb611d-63c6-4ae1-9d46-a2978d9a4205 None admin] RBAC: Authorizing `identity:get_project(project_id=a763e16ffa0642e5a884772398f073ce)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:00.588270 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb611d-63c6-4ae1-9d46-a2978d9a4205 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:00.589897 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 434/855] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:02:00 2022] GET /identity/v3/projects/a763e16ffa0642e5a884772398f073ce => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:00.596170 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80553e-3cd0-464c-b080-f0eecfead8af None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:00.678777 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:00.693615 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80553e-3cd0-464c-b080-f0eecfead8af None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:00.727142 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077a909-781e-4443-81ef-7d0be812d2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:00.727694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077a909-781e-4443-81ef-7d0be812d2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:00.727969 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077a909-781e-4443-81ef-7d0be812d2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:00.728235 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077a909-781e-4443-81ef-7d0be812d2d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:00.728938 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077a909-781e-4443-81ef-7d0be812d2d7 None admin] RBAC: Adding query filter params (role.id=4bcba8c3ff16483b9115020b5b886522, scope.project.id=a763e16ffa0642e5a884772398f073ce, user.id=d6e1eb6b9457419a8682c9a2f3ff70af) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:00.729238 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077a909-781e-4443-81ef-7d0be812d2d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:00.730648 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077a909-781e-4443-81ef-7d0be812d2d7 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:00.736293 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 422/856] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:02:00 2022] GET /identity/v3/role_assignments?user.id=d6e1eb6b9457419a8682c9a2f3ff70af&scope.project.id=a763e16ffa0642e5a884772398f073ce&role.id=4bcba8c3ff16483b9115020b5b886522 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:02.881119 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5e67b-74d0-4c19-bc7b-11cb7e37f1e8 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:02.881616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5e67b-74d0-4c19-bc7b-11cb7e37f1e8 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:02.881616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5e67b-74d0-4c19-bc7b-11cb7e37f1e8 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:02.882887 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 435/857] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:02:02.888104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51841c-5c6c-4f7e-b991-6e7f0048cc21 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:02.888544 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51841c-5c6c-4f7e-b991-6e7f0048cc21 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:02.888714 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51841c-5c6c-4f7e-b991-6e7f0048cc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:02.907050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-6f51841c-5c6c-4f7e-b991-6e7f0048cc21 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:02:02.908238 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-6f51841c-5c6c-4f7e-b991-6e7f0048cc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:02:02.975342 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 423/858] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:02:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:02:03.240765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5e67b-74d0-4c19-bc7b-11cb7e37f1e8 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:03.340410 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5e67b-74d0-4c19-bc7b-11cb7e37f1e8 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:03.373150 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471ce99-e4cc-427e-9f88-f642a30b45b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:03.373757 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471ce99-e4cc-427e-9f88-f642a30b45b5 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:03.374033 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471ce99-e4cc-427e-9f88-f642a30b45b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:03.374301 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471ce99-e4cc-427e-9f88-f642a30b45b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:03.375385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471ce99-e4cc-427e-9f88-f642a30b45b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:03.376828 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471ce99-e4cc-427e-9f88-f642a30b45b5 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:03.378343 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 436/859] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:02:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:03.384433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51841c-5c6c-4f7e-b991-6e7f0048cc21 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:03.462131 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:03.482320 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51841c-5c6c-4f7e-b991-6e7f0048cc21 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:03.515550 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdfdcd-542b-4e3b-96f8-59558b908a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:03.516087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdfdcd-542b-4e3b-96f8-59558b908a06 None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:03.516363 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdfdcd-542b-4e3b-96f8-59558b908a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:03.516631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdfdcd-542b-4e3b-96f8-59558b908a06 None admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:03.517266 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdfdcd-542b-4e3b-96f8-59558b908a06 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:03.518705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdfdcd-542b-4e3b-96f8-59558b908a06 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:03.545612 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 424/860] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 24 13:02:03 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:02:05.726283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1bf8f-58ad-46c2-a5cf-9d5b8e45e7b0 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:05.726807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1bf8f-58ad-46c2-a5cf-9d5b8e45e7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:05.726807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1bf8f-58ad-46c2-a5cf-9d5b8e45e7b0 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:05.728173 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 437/861] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:02:05.733424 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b75039-1763-4484-b1ac-4ee59124b8c0 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:05.733810 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b75039-1763-4484-b1ac-4ee59124b8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:05.733964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b75039-1763-4484-b1ac-4ee59124b8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:05.752501 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-e3b75039-1763-4484-b1ac-4ee59124b8c0 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:02:05.753651 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-e3b75039-1763-4484-b1ac-4ee59124b8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:02:05.817432 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 425/862] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:02:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:02:06.088459 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1bf8f-58ad-46c2-a5cf-9d5b8e45e7b0 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:06.146248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:06.185465 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1bf8f-58ad-46c2-a5cf-9d5b8e45e7b0 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:06.218749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770fefb-5676-4db2-86ca-7d1a928be2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:06.219351 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770fefb-5676-4db2-86ca-7d1a928be2c5 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:06.219653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770fefb-5676-4db2-86ca-7d1a928be2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:06.219920 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770fefb-5676-4db2-86ca-7d1a928be2c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:06.220995 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770fefb-5676-4db2-86ca-7d1a928be2c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:06.222399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770fefb-5676-4db2-86ca-7d1a928be2c5 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:06.224091 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 438/863] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:02:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:06.229992 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b75039-1763-4484-b1ac-4ee59124b8c0 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:06.289174 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:06.328049 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b75039-1763-4484-b1ac-4ee59124b8c0 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:06.361769 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054623f-d3da-4e34-9f9d-b4d028cdc7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:06.362303 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054623f-d3da-4e34-9f9d-b4d028cdc7ce None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:06.362581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054623f-d3da-4e34-9f9d-b4d028cdc7ce None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:06.362852 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054623f-d3da-4e34-9f9d-b4d028cdc7ce None admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:06.363613 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054623f-d3da-4e34-9f9d-b4d028cdc7ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:06.365023 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054623f-d3da-4e34-9f9d-b4d028cdc7ce None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:06.386052 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 426/864] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 24 13:02:06 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:02:08.517763 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115608ce-76bc-429c-8d15-79fcf67f47ab None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:08.518288 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115608ce-76bc-429c-8d15-79fcf67f47ab None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:08.518288 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115608ce-76bc-429c-8d15-79fcf67f47ab None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:08.520531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 439/865] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:02:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:02:08.525727 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288cc7a-cf28-4415-bac0-62c38e16cba5 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:08.526149 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288cc7a-cf28-4415-bac0-62c38e16cba5 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:08.526274 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288cc7a-cf28-4415-bac0-62c38e16cba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:08.659687 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-3288cc7a-cf28-4415-bac0-62c38e16cba5 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:02:08.661634 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-3288cc7a-cf28-4415-bac0-62c38e16cba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:02:08.726560 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 427/866] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:02:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:02:08.991838 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115608ce-76bc-429c-8d15-79fcf67f47ab None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:09.089723 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115608ce-76bc-429c-8d15-79fcf67f47ab None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:09.114560 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:09.122216 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5d3fb-671f-4a9e-b1c2-1dd5d3e410fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:09.122823 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5d3fb-671f-4a9e-b1c2-1dd5d3e410fa None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:09.123097 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5d3fb-671f-4a9e-b1c2-1dd5d3e410fa None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:09.123365 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5d3fb-671f-4a9e-b1c2-1dd5d3e410fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:09.132945 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5d3fb-671f-4a9e-b1c2-1dd5d3e410fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:02:09.137749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-8ce5d3fb-671f-4a9e-b1c2-1dd5d3e410fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:02:09.137749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:09.137749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:09.137749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:09.137749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:09.137749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:09.137749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:09.137749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:09.137749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:09.137749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:09.137749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:09.137749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:09.137749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:02:09.137749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:02:09.137749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:02:09.137749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:02:09.138841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:02:09.138841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:02:09.138841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:02:09.138841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:02:09.138841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:09.138841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:09.138841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:09.138841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:09.138841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:09.138841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:09.138841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:09.138841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:09.138841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:09.138841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:09.138841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:09.138841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:09.139742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:09.139742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:09.139742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:09.139742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:09.139742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:02:09.139742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:02:09.139742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:02:09.139742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:02:09.139742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:02:09.139742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:02:09.139742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:02:09.139742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:02:09.139742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 440/867] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 24 13:02:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:02:09.145382 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288cc7a-cf28-4415-bac0-62c38e16cba5 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:09.192347 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:09.245390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288cc7a-cf28-4415-bac0-62c38e16cba5 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:09.278652 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c2b14-8c60-474e-a460-5e530bb37146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:09.279241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c2b14-8c60-474e-a460-5e530bb37146 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:09.279552 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c2b14-8c60-474e-a460-5e530bb37146 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:09.279824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c2b14-8c60-474e-a460-5e530bb37146 None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:09.280480 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c2b14-8c60-474e-a460-5e530bb37146 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:09.280777 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c2b14-8c60-474e-a460-5e530bb37146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:09.282140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c2b14-8c60-474e-a460-5e530bb37146 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:09.290090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 428/868] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:02:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:09.295941 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5d3fb-671f-4a9e-b1c2-1dd5d3e410fa None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:09.391073 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5d3fb-671f-4a9e-b1c2-1dd5d3e410fa None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:09.423008 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f1ca9-e428-4472-9f1c-126599799cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:09.423638 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f1ca9-e428-4472-9f1c-126599799cbb None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:09.423917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f1ca9-e428-4472-9f1c-126599799cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:09.424187 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f1ca9-e428-4472-9f1c-126599799cbb None admin] PATH_INFO: `/v3/users/b5eae7d9d09a4a408506287ef2bc4a8a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:09.436693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f1ca9-e428-4472-9f1c-126599799cbb None admin] RBAC: Authorizing `identity:get_user(user_id=b5eae7d9d09a4a408506287ef2bc4a8a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:09.438120 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f1ca9-e428-4472-9f1c-126599799cbb None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:09.439679 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 441/869] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:02:09 2022] GET /identity/v3/users/b5eae7d9d09a4a408506287ef2bc4a8a => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:09.445805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c2b14-8c60-474e-a460-5e530bb37146 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:09.542937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c2b14-8c60-474e-a460-5e530bb37146 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:09.553976 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:09.578108 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65420c0b-da9b-420d-9b2c-7d21f2a4f5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:09.578732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65420c0b-da9b-420d-9b2c-7d21f2a4f5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:09.579010 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65420c0b-da9b-420d-9b2c-7d21f2a4f5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:09.579282 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65420c0b-da9b-420d-9b2c-7d21f2a4f5a7 None admin] PATH_INFO: `/v3/projects/e9420cf9c3854212ab318b543c98b7b3` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:09.580420 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65420c0b-da9b-420d-9b2c-7d21f2a4f5a7 None admin] RBAC: Authorizing `identity:get_project(project_id=e9420cf9c3854212ab318b543c98b7b3)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:09.581891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65420c0b-da9b-420d-9b2c-7d21f2a4f5a7 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:09.583667 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 429/870] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:02:09 2022] GET /identity/v3/projects/e9420cf9c3854212ab318b543c98b7b3 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:09.589498 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f1ca9-e428-4472-9f1c-126599799cbb None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:09.634866 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:09.685322 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f1ca9-e428-4472-9f1c-126599799cbb None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:09.717817 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cb418-23af-410d-bd7c-b87ba871ba7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:09.718449 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cb418-23af-410d-bd7c-b87ba871ba7b None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:09.718727 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cb418-23af-410d-bd7c-b87ba871ba7b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:09.718999 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cb418-23af-410d-bd7c-b87ba871ba7b None admin] PATH_INFO: `/v3/projects/e9420cf9c3854212ab318b543c98b7b3/users/b5eae7d9d09a4a408506287ef2bc4a8a/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:09.720877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788cb418-23af-410d-bd7c-b87ba871ba7b None admin] RBAC: Authorizing `identity:create_grant(project_id=e9420cf9c3854212ab318b543c98b7b3, user_id=b5eae7d9d09a4a408506287ef2bc4a8a, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:09.722294 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788cb418-23af-410d-bd7c-b87ba871ba7b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:09.734672 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 442/871] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 13:02:09 2022] PUT /identity/v3/projects/e9420cf9c3854212ab318b543c98b7b3/users/b5eae7d9d09a4a408506287ef2bc4a8a/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:02:11.854344 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80155c8-8a0b-48ad-97a7-1dc4c535e15c None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:11.854870 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80155c8-8a0b-48ad-97a7-1dc4c535e15c None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:11.854870 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80155c8-8a0b-48ad-97a7-1dc4c535e15c None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:11.856169 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 430/872] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:02:11.861344 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5ed8b-f0db-4d1f-833f-53bbb8bd2405 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:11.861754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5ed8b-f0db-4d1f-833f-53bbb8bd2405 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:11.861892 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5ed8b-f0db-4d1f-833f-53bbb8bd2405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:11.881272 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-f7a5ed8b-f0db-4d1f-833f-53bbb8bd2405 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:02:11.882441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f7a5ed8b-f0db-4d1f-833f-53bbb8bd2405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:02:11.945669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 443/873] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:02:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:02:12.218904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80155c8-8a0b-48ad-97a7-1dc4c535e15c None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:12.317274 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80155c8-8a0b-48ad-97a7-1dc4c535e15c None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:12.349791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1dea7-93a4-4344-a742-6f782a5fc64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:12.350404 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1dea7-93a4-4344-a742-6f782a5fc64f None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:12.350682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1dea7-93a4-4344-a742-6f782a5fc64f None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:12.350951 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1dea7-93a4-4344-a742-6f782a5fc64f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:12.360704 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1dea7-93a4-4344-a742-6f782a5fc64f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:02:12.366156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-ceb1dea7-93a4-4344-a742-6f782a5fc64f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:02:12.366156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:12.366156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:12.366156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:12.366156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:12.366156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:12.366156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:12.366156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:12.366156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:12.366156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:12.366156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:12.366156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:12.366156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:02:12.366156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:02:12.366156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:02:12.366156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:02:12.367241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:02:12.367241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:02:12.367241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:02:12.367241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:02:12.367241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:12.367241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:12.367241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:12.367241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:12.367241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:12.367241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:12.367241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:12.367241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:12.367241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:12.367241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:12.367241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:12.367241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:12.368313 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:12.368313 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:12.368313 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:12.368313 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:12.368313 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:02:12.368313 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:02:12.368313 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:02:12.368313 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:02:12.368313 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:02:12.368313 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:02:12.368313 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:02:12.368313 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:02:12.368313 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 431/874] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 24 13:02:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:02:12.373245 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5ed8b-f0db-4d1f-833f-53bbb8bd2405 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:12.405411 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:12.468538 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5ed8b-f0db-4d1f-833f-53bbb8bd2405 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:12.501273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba1095-7fa2-40f7-ad7e-1099ae067ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:12.501798 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba1095-7fa2-40f7-ad7e-1099ae067ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:12.502071 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba1095-7fa2-40f7-ad7e-1099ae067ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:12.502343 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba1095-7fa2-40f7-ad7e-1099ae067ab3 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:12.502982 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba1095-7fa2-40f7-ad7e-1099ae067ab3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:12.503274 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba1095-7fa2-40f7-ad7e-1099ae067ab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:12.504856 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba1095-7fa2-40f7-ad7e-1099ae067ab3 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:12.512397 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 444/875] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:02:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:12.518531 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1dea7-93a4-4344-a742-6f782a5fc64f None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:12.559116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:12.617999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1dea7-93a4-4344-a742-6f782a5fc64f None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:12.650857 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67adbd-66f6-4e28-93d9-071ee586eb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:12.651488 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67adbd-66f6-4e28-93d9-071ee586eb83 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:12.651768 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67adbd-66f6-4e28-93d9-071ee586eb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:12.652037 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67adbd-66f6-4e28-93d9-071ee586eb83 None admin] PATH_INFO: `/v3/users/b5eae7d9d09a4a408506287ef2bc4a8a` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:12.653118 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67adbd-66f6-4e28-93d9-071ee586eb83 None admin] RBAC: Authorizing `identity:get_user(user_id=b5eae7d9d09a4a408506287ef2bc4a8a)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:12.654582 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67adbd-66f6-4e28-93d9-071ee586eb83 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:12.656163 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 432/876] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:02:12 2022] GET /identity/v3/users/b5eae7d9d09a4a408506287ef2bc4a8a => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:12.662788 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba1095-7fa2-40f7-ad7e-1099ae067ab3 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:12.756168 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:12.760233 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba1095-7fa2-40f7-ad7e-1099ae067ab3 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:12.792562 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc892790-aa58-4dc4-99e2-fcae1034fae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:12.793148 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc892790-aa58-4dc4-99e2-fcae1034fae3 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:12.793423 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc892790-aa58-4dc4-99e2-fcae1034fae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:12.793690 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc892790-aa58-4dc4-99e2-fcae1034fae3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:12.856717 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc892790-aa58-4dc4-99e2-fcae1034fae3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:12.858161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc892790-aa58-4dc4-99e2-fcae1034fae3 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:12.946365 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:12.951362 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 445/877] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:02:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:02:12.957966 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67adbd-66f6-4e28-93d9-071ee586eb83 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:13.058862 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67adbd-66f6-4e28-93d9-071ee586eb83 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:13.069195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:13.097343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07d560-e0f4-4158-9b2a-beb72168373b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:13.098055 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07d560-e0f4-4158-9b2a-beb72168373b None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:13.098334 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07d560-e0f4-4158-9b2a-beb72168373b None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:13.098605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07d560-e0f4-4158-9b2a-beb72168373b None admin] PATH_INFO: `/v3/projects/e9420cf9c3854212ab318b543c98b7b3` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:13.099727 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e07d560-e0f4-4158-9b2a-beb72168373b None admin] RBAC: Authorizing `identity:get_project(project_id=e9420cf9c3854212ab318b543c98b7b3)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:13.101159 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e07d560-e0f4-4158-9b2a-beb72168373b None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:13.102762 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 433/878] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:02:12 2022] GET /identity/v3/projects/e9420cf9c3854212ab318b543c98b7b3 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:13.108898 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc892790-aa58-4dc4-99e2-fcae1034fae3 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:13.213105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc892790-aa58-4dc4-99e2-fcae1034fae3 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:13.247223 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc95e68-d3ad-497c-8d2a-06a6b03fcbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:13.247846 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc95e68-d3ad-497c-8d2a-06a6b03fcbdb None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:13.248120 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc95e68-d3ad-497c-8d2a-06a6b03fcbdb None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:13.248388 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc95e68-d3ad-497c-8d2a-06a6b03fcbdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:13.249142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc95e68-d3ad-497c-8d2a-06a6b03fcbdb None admin] RBAC: Adding query filter params (role.id=23ca6ecd60b2470cba913daeaf54f0f7, scope.project.id=e9420cf9c3854212ab318b543c98b7b3, user.id=b5eae7d9d09a4a408506287ef2bc4a8a) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:13.249653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc95e68-d3ad-497c-8d2a-06a6b03fcbdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:13.251448 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc95e68-d3ad-497c-8d2a-06a6b03fcbdb None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:13.259779 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 446/879] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:02:13 2022] GET /identity/v3/role_assignments?user.id=b5eae7d9d09a4a408506287ef2bc4a8a&scope.project.id=e9420cf9c3854212ab318b543c98b7b3&role.id=23ca6ecd60b2470cba913daeaf54f0f7 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:15.467695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001839fb-317a-4bdc-881e-ee9a2420680b None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:15.468279 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001839fb-317a-4bdc-881e-ee9a2420680b None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:15.468279 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001839fb-317a-4bdc-881e-ee9a2420680b None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:15.469549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 434/880] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:02:15.475881 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd9460-ed8c-48ab-a5a4-e0278563c6e5 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:15.476279 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd9460-ed8c-48ab-a5a4-e0278563c6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:15.476425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd9460-ed8c-48ab-a5a4-e0278563c6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:15.495018 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-bbbd9460-ed8c-48ab-a5a4-e0278563c6e5 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:02:15.496235 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-bbbd9460-ed8c-48ab-a5a4-e0278563c6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:02:15.552158 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:15.562824 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 447/881] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:02:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:02:15.838384 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001839fb-317a-4bdc-881e-ee9a2420680b None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:15.936258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001839fb-317a-4bdc-881e-ee9a2420680b None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:15.970132 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcb7de-c370-44a9-9eaf-2bbab845d356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:15.970755 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcb7de-c370-44a9-9eaf-2bbab845d356 None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:15.971029 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcb7de-c370-44a9-9eaf-2bbab845d356 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:15.971295 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcb7de-c370-44a9-9eaf-2bbab845d356 None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:15.971989 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defcb7de-c370-44a9-9eaf-2bbab845d356 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:15.973674 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defcb7de-c370-44a9-9eaf-2bbab845d356 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:15.989556 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 435/882] 10.222.0.18 () {60 vars in 1138 bytes} [Mon Oct 24 13:02:15 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:02:18.145135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae193f2-ae06-42c9-9d60-3bd877ea69ee None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:18.145674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae193f2-ae06-42c9-9d60-3bd877ea69ee None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:18.145674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae193f2-ae06-42c9-9d60-3bd877ea69ee None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:18.146962 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 448/883] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:02:18.152221 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a7194-69c9-47d5-9287-ca45c91bda16 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:18.152653 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a7194-69c9-47d5-9287-ca45c91bda16 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:18.152751 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a7194-69c9-47d5-9287-ca45c91bda16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:18.170839 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-093a7194-69c9-47d5-9287-ca45c91bda16 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:02:18.172043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-093a7194-69c9-47d5-9287-ca45c91bda16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:02:18.198902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:18.239712 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 436/884] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:02:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:02:18.511630 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae193f2-ae06-42c9-9d60-3bd877ea69ee None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:18.611178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae193f2-ae06-42c9-9d60-3bd877ea69ee None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:18.642942 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d8445-1bf3-480b-9672-3c7ea900971c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:18.643656 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d8445-1bf3-480b-9672-3c7ea900971c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:18.644487 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d8445-1bf3-480b-9672-3c7ea900971c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:18.644763 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d8445-1bf3-480b-9672-3c7ea900971c None admin] PATH_INFO: `/v3/domains/dcc3429a42a249b48f3ae28b666d1a67` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:18.654664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d8445-1bf3-480b-9672-3c7ea900971c None admin] RBAC: Authorizing `identity:get_domain(domain_id=dcc3429a42a249b48f3ae28b666d1a67)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:18.656121 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d8445-1bf3-480b-9672-3c7ea900971c None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:18.657669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 449/885] 10.222.0.18 () {56 vars in 1183 bytes} [Mon Oct 24 13:02:18 2022] GET /identity/v3/domains/dcc3429a42a249b48f3ae28b666d1a67 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:18.664353 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a7194-69c9-47d5-9287-ca45c91bda16 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:18.758389 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a7194-69c9-47d5-9287-ca45c91bda16 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:18.791392 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ebab5-80ff-4a3b-8993-a39be8172b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:18.791963 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ebab5-80ff-4a3b-8993-a39be8172b76 None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:18.792240 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ebab5-80ff-4a3b-8993-a39be8172b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:18.792511 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ebab5-80ff-4a3b-8993-a39be8172b76 None admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:18.793152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ebab5-80ff-4a3b-8993-a39be8172b76 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:18.794585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ebab5-80ff-4a3b-8993-a39be8172b76 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:18.820006 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 437/886] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 24 13:02:18 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:02:20.965578 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25446e-aad3-4c7b-8470-12864bcd7057 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:20.967323 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25446e-aad3-4c7b-8470-12864bcd7057 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:20.967323 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25446e-aad3-4c7b-8470-12864bcd7057 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:20.967644 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 450/887] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:02:20.972933 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fc36c-a02e-4dac-9f30-006731173918 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:20.973370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fc36c-a02e-4dac-9f30-006731173918 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:20.973471 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fc36c-a02e-4dac-9f30-006731173918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:20.991971 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-267fc36c-a02e-4dac-9f30-006731173918 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:02:20.993153 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-267fc36c-a02e-4dac-9f30-006731173918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:02:21.004177 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:21.059747 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 438/888] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:02:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:02:21.332253 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25446e-aad3-4c7b-8470-12864bcd7057 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:21.383986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:21.454082 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25446e-aad3-4c7b-8470-12864bcd7057 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:21.486550 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd480ab-92cd-4aeb-82f1-e7747851ef6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:21.487163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd480ab-92cd-4aeb-82f1-e7747851ef6c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:21.488062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd480ab-92cd-4aeb-82f1-e7747851ef6c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:21.488347 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd480ab-92cd-4aeb-82f1-e7747851ef6c None admin] PATH_INFO: `/v3/domains/dcc3429a42a249b48f3ae28b666d1a67` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:21.489631 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd480ab-92cd-4aeb-82f1-e7747851ef6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=dcc3429a42a249b48f3ae28b666d1a67)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:21.491062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd480ab-92cd-4aeb-82f1-e7747851ef6c None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:21.492618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 451/889] 10.222.0.18 () {56 vars in 1183 bytes} [Mon Oct 24 13:02:21 2022] GET /identity/v3/domains/dcc3429a42a249b48f3ae28b666d1a67 => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:21.498352 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fc36c-a02e-4dac-9f30-006731173918 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:21.594565 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fc36c-a02e-4dac-9f30-006731173918 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:21.628096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c845f-70a5-4a7c-b713-e84c5391627f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:21.628684 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c845f-70a5-4a7c-b713-e84c5391627f None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:21.629013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c845f-70a5-4a7c-b713-e84c5391627f None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:21.629280 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c845f-70a5-4a7c-b713-e84c5391627f None admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:21.629996 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c845f-70a5-4a7c-b713-e84c5391627f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:21.631482 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c845f-70a5-4a7c-b713-e84c5391627f None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:21.652480 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 439/890] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 24 13:02:21 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:02:23.813369 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a907d-2126-434c-8952-73aed53608f2 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:23.813882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a907d-2126-434c-8952-73aed53608f2 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:23.813882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a907d-2126-434c-8952-73aed53608f2 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:23.815163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 452/891] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:02:23.820684 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e844c9b-b525-4a82-a40b-9599c5f9dd19 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:23.821118 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e844c9b-b525-4a82-a40b-9599c5f9dd19 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:23.821212 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e844c9b-b525-4a82-a40b-9599c5f9dd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:23.827678 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:23.842394 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-2e844c9b-b525-4a82-a40b-9599c5f9dd19 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:02:23.843586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-2e844c9b-b525-4a82-a40b-9599c5f9dd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:02:23.907368 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 440/892] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:02:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:02:24.177557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a907d-2126-434c-8952-73aed53608f2 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:24.276500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a907d-2126-434c-8952-73aed53608f2 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:24.296180 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:24.310030 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf2bde-c6ed-49af-a4c9-bee9e4a421d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:24.310643 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf2bde-c6ed-49af-a4c9-bee9e4a421d3 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:24.310920 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf2bde-c6ed-49af-a4c9-bee9e4a421d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:24.311188 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf2bde-c6ed-49af-a4c9-bee9e4a421d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:24.321890 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf2bde-c6ed-49af-a4c9-bee9e4a421d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:02:24.326678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-80cf2bde-c6ed-49af-a4c9-bee9e4a421d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:02:24.326678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:24.326678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:24.326678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:24.326678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:24.326678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:24.326678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:24.326678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:24.326678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:24.326678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:24.326678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:24.326678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:24.326678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:02:24.326678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:02:24.326678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:02:24.326678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:02:24.327847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:02:24.327847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:02:24.327847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:02:24.327847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:02:24.327847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:24.327847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:24.327847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:24.327847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:24.327847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:24.327847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:24.327847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:24.327847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:24.327847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:24.327847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:24.327847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:24.327847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:24.328913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:24.328913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:24.328913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:24.328913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:24.328913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:02:24.328913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:02:24.328913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:02:24.328913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:02:24.328913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:02:24.328913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:02:24.328913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:02:24.328913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:02:24.328913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 453/893] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 24 13:02:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:02:24.334481 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e844c9b-b525-4a82-a40b-9599c5f9dd19 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:24.428728 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e844c9b-b525-4a82-a40b-9599c5f9dd19 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:24.457594 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:24.462865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5e20a-d15d-4f4c-a203-0009dc1dd182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:24.463478 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5e20a-d15d-4f4c-a203-0009dc1dd182 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:24.463756 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5e20a-d15d-4f4c-a203-0009dc1dd182 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:24.464027 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5e20a-d15d-4f4c-a203-0009dc1dd182 None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:24.464678 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5e20a-d15d-4f4c-a203-0009dc1dd182 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:24.464972 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5e20a-d15d-4f4c-a203-0009dc1dd182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:24.466325 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5e20a-d15d-4f4c-a203-0009dc1dd182 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:24.474346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 441/894] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:02:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:24.480106 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf2bde-c6ed-49af-a4c9-bee9e4a421d3 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:24.581654 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf2bde-c6ed-49af-a4c9-bee9e4a421d3 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:24.613959 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6ce7c-f700-47c5-aa47-fdde5e62f968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:24.614573 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6ce7c-f700-47c5-aa47-fdde5e62f968 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:24.614848 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6ce7c-f700-47c5-aa47-fdde5e62f968 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:24.615116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6ce7c-f700-47c5-aa47-fdde5e62f968 None admin] PATH_INFO: `/v3/users/d0ebc489cc1e4272a7224e09e2e12322` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:24.627405 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6ce7c-f700-47c5-aa47-fdde5e62f968 None admin] RBAC: Authorizing `identity:get_user(user_id=d0ebc489cc1e4272a7224e09e2e12322)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:24.629432 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6ce7c-f700-47c5-aa47-fdde5e62f968 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:24.630974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 454/895] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:02:24 2022] GET /identity/v3/users/d0ebc489cc1e4272a7224e09e2e12322 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:24.636728 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5e20a-d15d-4f4c-a203-0009dc1dd182 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:24.731098 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5e20a-d15d-4f4c-a203-0009dc1dd182 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:24.763256 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2cbc1-a54e-40fa-b9fb-69eada44bcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:24.763895 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2cbc1-a54e-40fa-b9fb-69eada44bcf7 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:24.764170 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2cbc1-a54e-40fa-b9fb-69eada44bcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:24.764437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2cbc1-a54e-40fa-b9fb-69eada44bcf7 None admin] PATH_INFO: `/v3/projects/55c960a879a44914a3bdb5fe61c6a0a5` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:24.765509 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2cbc1-a54e-40fa-b9fb-69eada44bcf7 None admin] RBAC: Authorizing `identity:get_project(project_id=55c960a879a44914a3bdb5fe61c6a0a5)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:24.766922 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2cbc1-a54e-40fa-b9fb-69eada44bcf7 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:24.768549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 442/896] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:02:24 2022] GET /identity/v3/projects/55c960a879a44914a3bdb5fe61c6a0a5 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:24.774499 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6ce7c-f700-47c5-aa47-fdde5e62f968 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:24.812835 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:24.869203 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6ce7c-f700-47c5-aa47-fdde5e62f968 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:24.901418 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f560d9-8a51-4f68-968a-acd7e1ecbc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:24.902047 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f560d9-8a51-4f68-968a-acd7e1ecbc5e None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:24.902321 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f560d9-8a51-4f68-968a-acd7e1ecbc5e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:24.902589 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f560d9-8a51-4f68-968a-acd7e1ecbc5e None admin] PATH_INFO: `/v3/projects/55c960a879a44914a3bdb5fe61c6a0a5/users/d0ebc489cc1e4272a7224e09e2e12322/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:24.904437 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f560d9-8a51-4f68-968a-acd7e1ecbc5e None admin] RBAC: Authorizing `identity:create_grant(project_id=55c960a879a44914a3bdb5fe61c6a0a5, user_id=d0ebc489cc1e4272a7224e09e2e12322, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:24.905851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f560d9-8a51-4f68-968a-acd7e1ecbc5e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:24.918281 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 455/897] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 13:02:24 2022] PUT /identity/v3/projects/55c960a879a44914a3bdb5fe61c6a0a5/users/d0ebc489cc1e4272a7224e09e2e12322/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:02:27.026167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473c6ca-f7b3-4b39-97c3-3e663d30497b None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:27.026714 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473c6ca-f7b3-4b39-97c3-3e663d30497b None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:27.026714 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473c6ca-f7b3-4b39-97c3-3e663d30497b None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:27.028063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 443/898] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:02:27.033292 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede02e7-9826-456c-a21a-8f1754cc22c9 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:27.033711 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede02e7-9826-456c-a21a-8f1754cc22c9 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:27.033814 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede02e7-9826-456c-a21a-8f1754cc22c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:27.051873 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-6ede02e7-9826-456c-a21a-8f1754cc22c9 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:02:27.053034 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6ede02e7-9826-456c-a21a-8f1754cc22c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:02:27.116305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 456/899] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:02:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:02:27.384737 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473c6ca-f7b3-4b39-97c3-3e663d30497b None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:27.445967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:27.484573 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473c6ca-f7b3-4b39-97c3-3e663d30497b None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:27.516393 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7aeaf7-eb25-4b8b-b94e-1f1f5b390318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:27.516996 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7aeaf7-eb25-4b8b-b94e-1f1f5b390318 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:27.517269 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7aeaf7-eb25-4b8b-b94e-1f1f5b390318 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:27.517532 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7aeaf7-eb25-4b8b-b94e-1f1f5b390318 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:27.528224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7aeaf7-eb25-4b8b-b94e-1f1f5b390318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:02:27.532980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-eb7aeaf7-eb25-4b8b-b94e-1f1f5b390318 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:02:27.532980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:27.532980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:27.532980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:27.532980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:27.532980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:27.532980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:27.532980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:27.532980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:27.532980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:27.532980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:27.532980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:27.532980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:02:27.532980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:02:27.532980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:02:27.532980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:02:27.534036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:02:27.534036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:02:27.534036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:02:27.534036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:02:27.534036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:27.534036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:27.534036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:27.534036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:27.534036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:27.534036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:27.534036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:27.534036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:27.534036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:27.534036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:27.534036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:27.534036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:27.534893 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:27.534893 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:27.534893 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:27.534893 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:27.534893 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:02:27.534893 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:02:27.534893 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:02:27.534893 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:02:27.534893 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:02:27.534893 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:02:27.534893 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:02:27.534893 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:02:27.534893 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 444/900] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 24 13:02:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:02:27.540347 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede02e7-9826-456c-a21a-8f1754cc22c9 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:27.567211 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:27.635991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede02e7-9826-456c-a21a-8f1754cc22c9 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:27.667606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117292f-2bba-4dda-9a7a-964a9772b3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:27.668200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117292f-2bba-4dda-9a7a-964a9772b3bf None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:27.668478 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117292f-2bba-4dda-9a7a-964a9772b3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:27.668749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117292f-2bba-4dda-9a7a-964a9772b3bf None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:27.669406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117292f-2bba-4dda-9a7a-964a9772b3bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:27.669708 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117292f-2bba-4dda-9a7a-964a9772b3bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:27.671056 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117292f-2bba-4dda-9a7a-964a9772b3bf None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:27.679224 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 457/901] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:02:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:27.685219 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7aeaf7-eb25-4b8b-b94e-1f1f5b390318 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:27.782018 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7aeaf7-eb25-4b8b-b94e-1f1f5b390318 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:27.803663 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:27.814709 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf96501-ebf4-47f6-a7ee-779ba2e604ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:27.815957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf96501-ebf4-47f6-a7ee-779ba2e604ca None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:27.816328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf96501-ebf4-47f6-a7ee-779ba2e604ca None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:27.816597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf96501-ebf4-47f6-a7ee-779ba2e604ca None admin] PATH_INFO: `/v3/users/d0ebc489cc1e4272a7224e09e2e12322` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:27.817695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf96501-ebf4-47f6-a7ee-779ba2e604ca None admin] RBAC: Authorizing `identity:get_user(user_id=d0ebc489cc1e4272a7224e09e2e12322)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:27.819120 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf96501-ebf4-47f6-a7ee-779ba2e604ca None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:27.820677 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 445/902] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 24 13:02:27 2022] GET /identity/v3/users/d0ebc489cc1e4272a7224e09e2e12322 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:27.826657 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117292f-2bba-4dda-9a7a-964a9772b3bf None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:27.914203 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:27.923632 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117292f-2bba-4dda-9a7a-964a9772b3bf None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:27.956432 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff573a4-2323-4aca-926c-4e692a073a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:27.957014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff573a4-2323-4aca-926c-4e692a073a7c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:27.957292 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff573a4-2323-4aca-926c-4e692a073a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:27.957566 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff573a4-2323-4aca-926c-4e692a073a7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:28.021479 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff573a4-2323-4aca-926c-4e692a073a7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:28.022911 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff573a4-2323-4aca-926c-4e692a073a7c None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:28.113641 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:28.123917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 458/903] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:02:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:02:28.129854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf96501-ebf4-47f6-a7ee-779ba2e604ca None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:28.226130 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf96501-ebf4-47f6-a7ee-779ba2e604ca None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:28.258626 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49efdd-de08-401b-9d2d-3076fe6a449e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:28.259240 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49efdd-de08-401b-9d2d-3076fe6a449e None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:28.259545 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49efdd-de08-401b-9d2d-3076fe6a449e None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:28.259817 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49efdd-de08-401b-9d2d-3076fe6a449e None admin] PATH_INFO: `/v3/projects/55c960a879a44914a3bdb5fe61c6a0a5` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:28.260911 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49efdd-de08-401b-9d2d-3076fe6a449e None admin] RBAC: Authorizing `identity:get_project(project_id=55c960a879a44914a3bdb5fe61c6a0a5)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:28.262331 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49efdd-de08-401b-9d2d-3076fe6a449e None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:28.263947 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 446/904] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 24 13:02:28 2022] GET /identity/v3/projects/55c960a879a44914a3bdb5fe61c6a0a5 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:28.270571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff573a4-2323-4aca-926c-4e692a073a7c None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:28.364863 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff573a4-2323-4aca-926c-4e692a073a7c None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:28.397524 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cabd40-066b-4bb9-a19f-cfd01ce3af9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:28.398106 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cabd40-066b-4bb9-a19f-cfd01ce3af9f None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:28.398380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cabd40-066b-4bb9-a19f-cfd01ce3af9f None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:28.398647 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cabd40-066b-4bb9-a19f-cfd01ce3af9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:28.399349 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cabd40-066b-4bb9-a19f-cfd01ce3af9f None admin] RBAC: Adding query filter params (role.id=23ca6ecd60b2470cba913daeaf54f0f7, scope.project.id=55c960a879a44914a3bdb5fe61c6a0a5, user.id=d0ebc489cc1e4272a7224e09e2e12322) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:28.399675 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cabd40-066b-4bb9-a19f-cfd01ce3af9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:28.401075 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cabd40-066b-4bb9-a19f-cfd01ce3af9f None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:28.406504 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 459/905] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:02:28 2022] GET /identity/v3/role_assignments?user.id=d0ebc489cc1e4272a7224e09e2e12322&scope.project.id=55c960a879a44914a3bdb5fe61c6a0a5&role.id=23ca6ecd60b2470cba913daeaf54f0f7 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:38.254576 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=71 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:38.404024 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=73 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:24.121242 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd2b04-c40e-4e23-8b74-d04aafcfb2b3 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:24.121878 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd2b04-c40e-4e23-8b74-d04aafcfb2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:24.121878 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd2b04-c40e-4e23-8b74-d04aafcfb2b3 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:24.123114 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 447/906] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:03:24.129536 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe98378-62b4-4c56-b584-1bd449e5f3b8 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:24.130043 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe98378-62b4-4c56-b584-1bd449e5f3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:24.130350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe98378-62b4-4c56-b584-1bd449e5f3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:24.149811 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-afe98378-62b4-4c56-b584-1bd449e5f3b8 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:03:24.151156 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-afe98378-62b4-4c56-b584-1bd449e5f3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:03:24.236682 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 460/907] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:03:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:03:24.524167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd2b04-c40e-4e23-8b74-d04aafcfb2b3 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:24.661489 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd2b04-c40e-4e23-8b74-d04aafcfb2b3 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:24.702435 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c031012-876f-4a00-9556-2fee6f48f0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:24.703479 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c031012-876f-4a00-9556-2fee6f48f0fc None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:24.704065 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c031012-876f-4a00-9556-2fee6f48f0fc None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:24.704736 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c031012-876f-4a00-9556-2fee6f48f0fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:24.719621 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c031012-876f-4a00-9556-2fee6f48f0fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:24.721880 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c031012-876f-4a00-9556-2fee6f48f0fc None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:24.739528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-2c031012-876f-4a00-9556-2fee6f48f0fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:03:24.739528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:24.739528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:24.739528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:24.739528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:24.739528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:24.739528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:24.739528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:24.739528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:24.739528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:24.739528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:24.739528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:24.739528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:03:24.739528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:03:24.739528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:03:24.739528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:03:24.740844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:24.740844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:24.740844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:24.740844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:24.740844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:24.740844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:24.740844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:24.740844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:24.740844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:24.740844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:24.740844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:24.740844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:24.740844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:24.740844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:24.740844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:24.740844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:24.740844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:03:24.742020 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:03:24.742020 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:03:24.742020 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:03:24.743325 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 448/908] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:03:24.749453 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe98378-62b4-4c56-b584-1bd449e5f3b8 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:24.878739 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe98378-62b4-4c56-b584-1bd449e5f3b8 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:24.917161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:24.925042 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f0092-3b5b-4ea5-aec3-7bd676492598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:24.925887 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f0092-3b5b-4ea5-aec3-7bd676492598 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:24.926364 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f0092-3b5b-4ea5-aec3-7bd676492598 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:24.926780 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f0092-3b5b-4ea5-aec3-7bd676492598 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:24.927643 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f0092-3b5b-4ea5-aec3-7bd676492598 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:24.928108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f0092-3b5b-4ea5-aec3-7bd676492598 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:24.929726 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f0092-3b5b-4ea5-aec3-7bd676492598 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:24.945001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 461/909] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:03:24.951712 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c031012-876f-4a00-9556-2fee6f48f0fc None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:25.027359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:25.087812 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c031012-876f-4a00-9556-2fee6f48f0fc None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:25.139300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea39d82-e913-4196-95ca-f5c4b29a291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:25.141278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea39d82-e913-4196-95ca-f5c4b29a291e None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:25.141542 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea39d82-e913-4196-95ca-f5c4b29a291e None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:25.141849 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea39d82-e913-4196-95ca-f5c4b29a291e None admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:25.143297 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea39d82-e913-4196-95ca-f5c4b29a291e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:25.144975 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea39d82-e913-4196-95ca-f5c4b29a291e None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:25.168967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 449/910] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 24 13:03:24 2022] POST /identity/v3/users => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:03:27.637077 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fe743-4471-424f-9bea-44ce56a47b8a None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:27.637729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fe743-4471-424f-9bea-44ce56a47b8a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:27.637729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fe743-4471-424f-9bea-44ce56a47b8a None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:27.638916 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 462/911] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:03:27.646040 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bea8a-e47b-433a-982d-961045625948 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:27.646606 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bea8a-e47b-433a-982d-961045625948 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:27.646714 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bea8a-e47b-433a-982d-961045625948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:27.668156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-3b8bea8a-e47b-433a-982d-961045625948 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:03:27.670355 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-3b8bea8a-e47b-433a-982d-961045625948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:03:27.751027 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 450/912] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:03:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:03:28.049223 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fe743-4471-424f-9bea-44ce56a47b8a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:28.164901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fe743-4471-424f-9bea-44ce56a47b8a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:28.202194 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d48a4-6a02-4d6b-9c5f-5488287eabe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:28.203025 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d48a4-6a02-4d6b-9c5f-5488287eabe3 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:28.203329 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d48a4-6a02-4d6b-9c5f-5488287eabe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:28.203818 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d48a4-6a02-4d6b-9c5f-5488287eabe3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:28.215721 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d48a4-6a02-4d6b-9c5f-5488287eabe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:03:28.221331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-9e0d48a4-6a02-4d6b-9c5f-5488287eabe3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:03:28.221331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:28.221331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:28.221331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:28.221331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:28.221331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:28.221331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:28.221331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:28.221331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:28.221331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:28.221331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:28.221331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:28.221331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:03:28.221331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:03:28.221331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:03:28.221331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:03:28.222352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:03:28.222352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:03:28.222352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:03:28.222352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:03:28.222352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:28.222352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:28.222352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:28.222352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:28.222352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:28.222352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:28.222352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:28.222352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:28.222352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:28.222352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:28.222352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:28.222352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:28.223218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:28.223218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:28.223218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:28.223218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:28.223218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:03:28.223218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:03:28.223218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:03:28.223218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:03:28.223218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:03:28.223218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:03:28.223218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:03:28.223218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:03:28.223218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 463/913] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 24 13:03:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:03:28.229248 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8bea8a-e47b-433a-982d-961045625948 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:28.281881 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:28.356436 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8bea8a-e47b-433a-982d-961045625948 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:28.400131 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510de60-ccf3-41ad-80f0-7c50d4feb525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:28.400748 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510de60-ccf3-41ad-80f0-7c50d4feb525 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:28.401026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510de60-ccf3-41ad-80f0-7c50d4feb525 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:28.401301 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510de60-ccf3-41ad-80f0-7c50d4feb525 None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:28.401958 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510de60-ccf3-41ad-80f0-7c50d4feb525 None admin] RBAC: Adding query filter params (name=service) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:28.402261 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510de60-ccf3-41ad-80f0-7c50d4feb525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:28.403715 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510de60-ccf3-41ad-80f0-7c50d4feb525 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:28.413102 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 451/914] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 24 13:03:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:28.418957 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d48a4-6a02-4d6b-9c5f-5488287eabe3 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:28.489941 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:28.561557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d48a4-6a02-4d6b-9c5f-5488287eabe3 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:28.600437 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0421e9-34fe-42fd-bd07-6309037078a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:28.601117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0421e9-34fe-42fd-bd07-6309037078a4 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:28.601396 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0421e9-34fe-42fd-bd07-6309037078a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:28.601670 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0421e9-34fe-42fd-bd07-6309037078a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:28.612835 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0421e9-34fe-42fd-bd07-6309037078a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:28.614345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0421e9-34fe-42fd-bd07-6309037078a4 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:28.634012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-fc0421e9-34fe-42fd-bd07-6309037078a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:03:28.634012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:28.634012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:28.634012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:28.634012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:28.634012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:28.634012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:28.634012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:28.634012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:28.634012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:28.634012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:28.634012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:28.634012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:03:28.634012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:03:28.634012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:03:28.634012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:03:28.635729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:28.635729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:28.635729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:28.635729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:28.635729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:28.635729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:28.635729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:28.635729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:28.635729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:28.635729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:28.635729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:28.635729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:28.635729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:28.635729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:28.635729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:28.635729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:28.635729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:03:28.636663 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:03:28.636663 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:03:28.636663 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:03:28.636663 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 464/915] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:03:28.641216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510de60-ccf3-41ad-80f0-7c50d4feb525 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:28.753682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:28.756808 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510de60-ccf3-41ad-80f0-7c50d4feb525 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:28.797038 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170a607-2771-4f7d-88bd-8a14c2064864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:28.797643 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170a607-2771-4f7d-88bd-8a14c2064864 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:28.797921 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170a607-2771-4f7d-88bd-8a14c2064864 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:28.798271 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170a607-2771-4f7d-88bd-8a14c2064864 None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:28.799121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170a607-2771-4f7d-88bd-8a14c2064864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:28.799618 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170a607-2771-4f7d-88bd-8a14c2064864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:28.801184 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170a607-2771-4f7d-88bd-8a14c2064864 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:28.815759 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 452/916] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:28.822233 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0421e9-34fe-42fd-bd07-6309037078a4 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:28.936000 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0421e9-34fe-42fd-bd07-6309037078a4 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:28.937675 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:28.976316 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a8b4f-e752-4b51-b6bc-ae3f8b35064c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:28.977124 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a8b4f-e752-4b51-b6bc-ae3f8b35064c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:28.977281 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a8b4f-e752-4b51-b6bc-ae3f8b35064c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:28.977581 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a8b4f-e752-4b51-b6bc-ae3f8b35064c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:28.985723 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a8b4f-e752-4b51-b6bc-ae3f8b35064c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:28.987886 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a8b4f-e752-4b51-b6bc-ae3f8b35064c None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:29.000117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-cc2a8b4f-e752-4b51-b6bc-ae3f8b35064c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 24 13:03:29.000117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:29.000117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:29.000117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:29.000117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:29.000117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:29.000117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:29.000117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:29.000117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:29.000117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:29.000117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:29.000117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:29.000117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:03:29.000117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:03:29.000117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:03:29.000117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:03:29.001389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:29.001389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:29.001389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:03:29.001389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:03:29.001389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:03:29.001389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:03:29.001389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:29.001389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:29.001389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:29.001389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:29.001389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:29.001389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:29.001389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:29.001389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:29.001389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:29.001389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:29.001389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:29.001389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:29.002522 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:29.002522 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:29.002522 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:03:29.002522 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:03:29.002522 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:03:29.002522 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:03:29.002522 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:03:29.002522 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:03:29.002522 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 24 13:03:29.002522 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:03:29.002522 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 465/917] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:03:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:03:29.007454 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170a607-2771-4f7d-88bd-8a14c2064864 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:29.119373 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170a607-2771-4f7d-88bd-8a14c2064864 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:29.156208 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f701429-8580-45ad-b51d-811660fbdfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:29.156888 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f701429-8580-45ad-b51d-811660fbdfc0 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:29.157240 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f701429-8580-45ad-b51d-811660fbdfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:29.157486 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f701429-8580-45ad-b51d-811660fbdfc0 None admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:29.158840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f701429-8580-45ad-b51d-811660fbdfc0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:29.159206 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f701429-8580-45ad-b51d-811660fbdfc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:29.160727 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f701429-8580-45ad-b51d-811660fbdfc0 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:29.178438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 453/918] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Oct 24 13:03:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:29.184162 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a8b4f-e752-4b51-b6bc-ae3f8b35064c None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:29.311089 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a8b4f-e752-4b51-b6bc-ae3f8b35064c None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:29.352938 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b89812-1850-4d23-ae92-5fed0723a885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:29.353553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b89812-1850-4d23-ae92-5fed0723a885 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:29.353827 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b89812-1850-4d23-ae92-5fed0723a885 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:29.354100 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b89812-1850-4d23-ae92-5fed0723a885 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:29.365520 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b89812-1850-4d23-ae92-5fed0723a885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:29.367121 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b89812-1850-4d23-ae92-5fed0723a885 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:29.387310 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-33b89812-1850-4d23-ae92-5fed0723a885 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:03:29.387310 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:29.387310 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:29.387310 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:29.387310 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:29.387310 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:29.387310 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:29.387310 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:29.387310 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:29.387310 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:29.387310 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:29.387310 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:29.387310 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:03:29.387310 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:03:29.387310 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:03:29.387310 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:03:29.395704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:29.395704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:29.395704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:29.395704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:29.395704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:29.395704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:29.395704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:29.395704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:29.395704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:29.395704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:29.395704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:29.395704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:29.395704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:29.395704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:29.395704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:29.395704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:29.395704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:03:29.396688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:03:29.396688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:03:29.396688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:03:29.396688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 466/919] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:03:29.396917 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f701429-8580-45ad-b51d-811660fbdfc0 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:29.415945 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:29.516705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f701429-8580-45ad-b51d-811660fbdfc0 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:29.566529 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ed73b-8071-4231-8ccb-ed399c9600f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:29.567067 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ed73b-8071-4231-8ccb-ed399c9600f6 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:29.567335 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ed73b-8071-4231-8ccb-ed399c9600f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:29.567625 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ed73b-8071-4231-8ccb-ed399c9600f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:29.568291 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ed73b-8071-4231-8ccb-ed399c9600f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:29.568549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ed73b-8071-4231-8ccb-ed399c9600f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:29.569911 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ed73b-8071-4231-8ccb-ed399c9600f6 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:29.587013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 454/920] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:03:29.588691 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b89812-1850-4d23-ae92-5fed0723a885 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:29.607299 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:29.709066 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b89812-1850-4d23-ae92-5fed0723a885 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:29.750251 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956655e-a08a-47c9-8f67-39efb33dde09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:29.750942 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956655e-a08a-47c9-8f67-39efb33dde09 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:29.751802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956655e-a08a-47c9-8f67-39efb33dde09 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:29.752138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956655e-a08a-47c9-8f67-39efb33dde09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:29.759411 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956655e-a08a-47c9-8f67-39efb33dde09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:29.760882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956655e-a08a-47c9-8f67-39efb33dde09 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:29.774248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-b956655e-a08a-47c9-8f67-39efb33dde09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:03:29.774248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:29.774248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:29.774248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:29.774248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:29.774248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:29.774248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:29.774248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:29.774248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:29.774248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:29.774248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:29.774248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:29.774248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:03:29.774248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:03:29.774248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:03:29.775327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:03:29.775327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:29.775327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:29.775327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:29.775327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:29.775327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:29.775327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:29.775327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:29.775327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:29.775327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:29.775327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:29.775327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:29.775327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:29.775327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:29.775327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:29.775327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:29.775327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:29.781414 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:03:29.781414 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:03:29.781414 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:03:29.781414 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:03:29.781414 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:03:29.781414 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:03:29.781414 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:03:29.781414 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:03:29.781414 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 467/921] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:03:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:03:29.782041 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ed73b-8071-4231-8ccb-ed399c9600f6 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:29.880491 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:29.910106 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ed73b-8071-4231-8ccb-ed399c9600f6 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:29.959685 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10094200-70ee-45f3-90b9-039e341f2fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:29.960299 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10094200-70ee-45f3-90b9-039e341f2fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:29.960576 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10094200-70ee-45f3-90b9-039e341f2fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:29.960848 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10094200-70ee-45f3-90b9-039e341f2fd9 None admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:29.961537 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10094200-70ee-45f3-90b9-039e341f2fd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:29.961838 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10094200-70ee-45f3-90b9-039e341f2fd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:29.963401 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10094200-70ee-45f3-90b9-039e341f2fd9 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:29.978022 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 455/922] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 24 13:03:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:29.985302 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956655e-a08a-47c9-8f67-39efb33dde09 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:30.084893 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:30.115014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956655e-a08a-47c9-8f67-39efb33dde09 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:30.155151 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bec41c-a552-41eb-95ae-d0e8bf6f1578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:30.155945 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bec41c-a552-41eb-95ae-d0e8bf6f1578 None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:30.156281 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bec41c-a552-41eb-95ae-d0e8bf6f1578 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:30.156581 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bec41c-a552-41eb-95ae-d0e8bf6f1578 None admin] PATH_INFO: `/v3/projects/f230a12ca6234faabf984e4a58a0d2e8/users/60b3ca8694ab4a169a3c36561290d8c5/roles/ce7268982b3046a08a5a58a49d928fc6` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:30.174054 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bec41c-a552-41eb-95ae-d0e8bf6f1578 None admin] RBAC: Authorizing `identity:create_grant(project_id=f230a12ca6234faabf984e4a58a0d2e8, user_id=60b3ca8694ab4a169a3c36561290d8c5, role_id=ce7268982b3046a08a5a58a49d928fc6)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:30.175535 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bec41c-a552-41eb-95ae-d0e8bf6f1578 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:30.188397 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 468/923] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 13:03:29 2022] PUT /identity/v3/projects/f230a12ca6234faabf984e4a58a0d2e8/users/60b3ca8694ab4a169a3c36561290d8c5/roles/ce7268982b3046a08a5a58a49d928fc6 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:03:32.417224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c3232-670a-4088-ab9f-f86e64a91c94 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:32.417790 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c3232-670a-4088-ab9f-f86e64a91c94 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:32.417790 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c3232-670a-4088-ab9f-f86e64a91c94 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:32.419092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 456/924] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:03:32.425047 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068b304-3f98-48c1-9be3-30ec72da8a0c None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:32.425496 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068b304-3f98-48c1-9be3-30ec72da8a0c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:32.425596 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068b304-3f98-48c1-9be3-30ec72da8a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:32.444752 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-5068b304-3f98-48c1-9be3-30ec72da8a0c None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:03:32.446073 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5068b304-3f98-48c1-9be3-30ec72da8a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:03:32.519111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 469/925] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:03:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:03:32.792957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c3232-670a-4088-ab9f-f86e64a91c94 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:32.906944 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c3232-670a-4088-ab9f-f86e64a91c94 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:32.945979 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e8fd6-6211-476d-ac35-352377b500a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:32.946863 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e8fd6-6211-476d-ac35-352377b500a6 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:32.947139 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e8fd6-6211-476d-ac35-352377b500a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:32.947404 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e8fd6-6211-476d-ac35-352377b500a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:32.955090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:32.960010 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e8fd6-6211-476d-ac35-352377b500a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:03:32.966194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-a60e8fd6-6211-476d-ac35-352377b500a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:03:32.966194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:32.966194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:32.966194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:32.966194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:32.966194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:32.966194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:32.966194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:32.966194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:32.966194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:32.966194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:32.966194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:32.966194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:03:32.966194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:03:32.966194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:03:32.966194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:03:32.967367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:03:32.967367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:03:32.967367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:03:32.967367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:03:32.967367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:32.967367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:32.967367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:32.967367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:32.967367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:32.967367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:32.967367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:32.967367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:32.967367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:32.967367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:32.967367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:32.967367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:32.968451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:32.968451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:32.968451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:32.968451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:32.968451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:03:32.968451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:03:32.968451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:03:32.968451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:03:32.968451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:03:32.968451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:03:32.968451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:03:32.968451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:03:32.968451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 457/926] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 24 13:03:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:03:32.974501 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068b304-3f98-48c1-9be3-30ec72da8a0c None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:33.033565 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:33.080506 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068b304-3f98-48c1-9be3-30ec72da8a0c None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:33.119847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd0d45-debf-4d0c-b945-cde2d869d19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:33.120854 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd0d45-debf-4d0c-b945-cde2d869d19c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:33.121375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd0d45-debf-4d0c-b945-cde2d869d19c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:33.121915 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd0d45-debf-4d0c-b945-cde2d869d19c None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:33.122900 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd0d45-debf-4d0c-b945-cde2d869d19c None admin] RBAC: Adding query filter params (name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:33.123303 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd0d45-debf-4d0c-b945-cde2d869d19c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:33.125460 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd0d45-debf-4d0c-b945-cde2d869d19c None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:33.137161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 470/927] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 24 13:03:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:33.144923 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e8fd6-6211-476d-ac35-352377b500a6 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:33.266221 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e8fd6-6211-476d-ac35-352377b500a6 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:33.307539 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699aaa1-a9f4-42f1-ab45-5c94f04254f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:33.308162 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699aaa1-a9f4-42f1-ab45-5c94f04254f4 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:33.308435 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699aaa1-a9f4-42f1-ab45-5c94f04254f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:33.308702 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699aaa1-a9f4-42f1-ab45-5c94f04254f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:33.319930 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699aaa1-a9f4-42f1-ab45-5c94f04254f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:33.322093 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699aaa1-a9f4-42f1-ab45-5c94f04254f4 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:33.339237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-8699aaa1-a9f4-42f1-ab45-5c94f04254f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:03:33.339237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:33.339237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:33.339237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:33.339237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:33.339237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:33.339237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:33.339237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:33.339237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:33.339237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:33.339237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:33.339237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:33.339237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:03:33.339237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:03:33.339237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:03:33.339237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:03:33.340399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:33.340399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:33.340399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:33.340399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:33.340399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:33.340399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:33.340399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:33.340399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:33.340399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:33.340399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:33.340399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:33.340399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:33.340399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:33.340399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:33.340399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:33.340399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:33.340399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:03:33.342065 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:03:33.342065 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:03:33.342065 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:03:33.342065 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 458/928] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:03:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:03:33.348547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd0d45-debf-4d0c-b945-cde2d869d19c None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:33.458111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd0d45-debf-4d0c-b945-cde2d869d19c None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:33.476859 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:33.496236 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587a8d3-c957-4697-b8a6-6ad15a1f55ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:33.496835 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587a8d3-c957-4697-b8a6-6ad15a1f55ca None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:33.497109 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587a8d3-c957-4697-b8a6-6ad15a1f55ca None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:33.497376 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587a8d3-c957-4697-b8a6-6ad15a1f55ca None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:33.498009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587a8d3-c957-4697-b8a6-6ad15a1f55ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:33.498303 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587a8d3-c957-4697-b8a6-6ad15a1f55ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:33.499693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587a8d3-c957-4697-b8a6-6ad15a1f55ca None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:33.512900 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 471/929] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:33.519542 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699aaa1-a9f4-42f1-ab45-5c94f04254f4 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:33.574304 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:33.631575 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699aaa1-a9f4-42f1-ab45-5c94f04254f4 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:33.669292 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c8724-93a2-48b3-9bfb-e88ddd8a0272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:33.669924 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c8724-93a2-48b3-9bfb-e88ddd8a0272 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:33.670203 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c8724-93a2-48b3-9bfb-e88ddd8a0272 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:33.670475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c8724-93a2-48b3-9bfb-e88ddd8a0272 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:33.679001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c8724-93a2-48b3-9bfb-e88ddd8a0272 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:33.680531 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c8724-93a2-48b3-9bfb-e88ddd8a0272 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:33.694821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-5d0c8724-93a2-48b3-9bfb-e88ddd8a0272 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 24 13:03:33.694821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:33.694821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:33.694821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:33.694821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:33.694821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:33.694821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:33.694821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:33.694821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:33.694821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:33.694821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:33.694821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:33.694821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:03:33.694821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:03:33.694821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:03:33.694821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:03:33.695999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:33.695999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:33.695999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:03:33.695999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:03:33.695999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:03:33.695999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:03:33.695999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:33.695999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:33.695999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:33.695999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:33.695999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:33.695999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:33.695999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:33.695999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:33.695999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:33.695999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:33.695999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:33.695999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:33.697657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:33.697657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:33.697657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:03:33.697657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:03:33.697657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:03:33.697657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:03:33.697657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:03:33.697657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:03:33.697657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 24 13:03:33.697657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:03:33.697657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 459/930] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:03:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:03:33.702433 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587a8d3-c957-4697-b8a6-6ad15a1f55ca None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:33.807603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587a8d3-c957-4697-b8a6-6ad15a1f55ca None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:33.847470 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835963db-61ba-405e-aa16-2369f85d6c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:33.848088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835963db-61ba-405e-aa16-2369f85d6c39 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:33.848370 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835963db-61ba-405e-aa16-2369f85d6c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:33.848709 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835963db-61ba-405e-aa16-2369f85d6c39 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:33.849552 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835963db-61ba-405e-aa16-2369f85d6c39 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:33.849885 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835963db-61ba-405e-aa16-2369f85d6c39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:33.851514 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835963db-61ba-405e-aa16-2369f85d6c39 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:33.872017 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 472/931] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Oct 24 13:03:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:33.878699 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c8724-93a2-48b3-9bfb-e88ddd8a0272 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:33.992841 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c8724-93a2-48b3-9bfb-e88ddd8a0272 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:34.004646 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:34.029567 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9afe460-a48d-40dd-a58c-5b3ac187246c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:34.030203 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afe460-a48d-40dd-a58c-5b3ac187246c None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:34.030529 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afe460-a48d-40dd-a58c-5b3ac187246c None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:34.030800 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afe460-a48d-40dd-a58c-5b3ac187246c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:34.102812 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9afe460-a48d-40dd-a58c-5b3ac187246c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:34.104319 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9afe460-a48d-40dd-a58c-5b3ac187246c None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:34.217683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 460/932] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:03:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:03:34.224145 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835963db-61ba-405e-aa16-2369f85d6c39 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:34.266417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:34.347342 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835963db-61ba-405e-aa16-2369f85d6c39 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:34.386813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baeee90-aa44-4138-abe9-86192377da62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:34.387476 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baeee90-aa44-4138-abe9-86192377da62 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:34.387755 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baeee90-aa44-4138-abe9-86192377da62 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:34.388027 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baeee90-aa44-4138-abe9-86192377da62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:34.400111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baeee90-aa44-4138-abe9-86192377da62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:34.401801 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baeee90-aa44-4138-abe9-86192377da62 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:34.418603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-0baeee90-aa44-4138-abe9-86192377da62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:03:34.418603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:34.418603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:34.418603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:34.418603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:34.418603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:34.418603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:34.418603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:34.418603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:34.418603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:34.418603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:34.418603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:34.418603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:03:34.418603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:03:34.418603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:03:34.418603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:03:34.419794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:34.419794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:34.419794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:34.419794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:34.419794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:34.419794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:34.419794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:34.419794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:34.419794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:34.419794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:34.419794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:34.419794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:34.419794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:34.419794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:34.419794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:34.419794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:34.419794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:03:34.421136 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:03:34.421136 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:03:34.421136 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:03:34.421136 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 473/933] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:03:34.426870 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9afe460-a48d-40dd-a58c-5b3ac187246c None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:34.440596 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:34.536542 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9afe460-a48d-40dd-a58c-5b3ac187246c None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:34.578522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf8a78-0808-43b7-8cf3-dfaed80ed49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:34.579120 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf8a78-0808-43b7-8cf3-dfaed80ed49f None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:34.579499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf8a78-0808-43b7-8cf3-dfaed80ed49f None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:34.579943 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf8a78-0808-43b7-8cf3-dfaed80ed49f None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:34.580576 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf8a78-0808-43b7-8cf3-dfaed80ed49f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:34.580871 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf8a78-0808-43b7-8cf3-dfaed80ed49f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:34.582228 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf8a78-0808-43b7-8cf3-dfaed80ed49f None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:34.599964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 461/934] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:34.601329 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baeee90-aa44-4138-abe9-86192377da62 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:34.695160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:34.712087 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baeee90-aa44-4138-abe9-86192377da62 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:34.747898 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d8475-61ba-414a-9bda-a35d254308cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:34.748585 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d8475-61ba-414a-9bda-a35d254308cd None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:34.748934 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d8475-61ba-414a-9bda-a35d254308cd None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:34.749219 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d8475-61ba-414a-9bda-a35d254308cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:34.756553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d8475-61ba-414a-9bda-a35d254308cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:34.758005 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d8475-61ba-414a-9bda-a35d254308cd None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:34.769500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-703d8475-61ba-414a-9bda-a35d254308cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:03:34.769500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:34.769500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:34.769500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:34.769500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:34.769500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:34.769500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:34.769500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:34.769500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:34.769500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:34.769500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:34.769500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:34.769500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:03:34.769500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:03:34.769500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:03:34.770438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:03:34.770438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:34.770438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:34.770438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:34.770438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:34.770438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:34.770438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:34.770438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:34.770438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:34.770438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:34.770438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:34.770438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:34.770438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:34.770438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:34.770438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:34.770438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:34.770438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:34.771372 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:03:34.771372 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:03:34.771372 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:03:34.771372 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:03:34.771372 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:03:34.771372 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:03:34.771372 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:03:34.771372 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:03:34.771372 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 474/935] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:03:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:03:34.777512 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf8a78-0808-43b7-8cf3-dfaed80ed49f None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:34.862363 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:34.896996 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf8a78-0808-43b7-8cf3-dfaed80ed49f None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:34.936629 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca13067-9a35-4238-b1c9-0fda45d56521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:34.937239 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca13067-9a35-4238-b1c9-0fda45d56521 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:34.937518 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca13067-9a35-4238-b1c9-0fda45d56521 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:34.937785 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca13067-9a35-4238-b1c9-0fda45d56521 None admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:34.938469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca13067-9a35-4238-b1c9-0fda45d56521 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:34.938824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca13067-9a35-4238-b1c9-0fda45d56521 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:34.940751 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca13067-9a35-4238-b1c9-0fda45d56521 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:34.953143 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 462/936] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 24 13:03:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:34.959375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d8475-61ba-414a-9bda-a35d254308cd None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:35.061911 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d8475-61ba-414a-9bda-a35d254308cd None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:35.097092 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8b900-8726-4f95-9ba8-772644b0a127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:35.097788 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8b900-8726-4f95-9ba8-772644b0a127 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:35.098063 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8b900-8726-4f95-9ba8-772644b0a127 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:35.098329 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8b900-8726-4f95-9ba8-772644b0a127 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:35.099071 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8b900-8726-4f95-9ba8-772644b0a127 None admin] RBAC: Adding query filter params (role.id=ce7268982b3046a08a5a58a49d928fc6, scope.project.id=f230a12ca6234faabf984e4a58a0d2e8, user.id=60b3ca8694ab4a169a3c36561290d8c5) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:35.099368 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8b900-8726-4f95-9ba8-772644b0a127 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:35.100818 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8b900-8726-4f95-9ba8-772644b0a127 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:35.106618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 475/937] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:03:34 2022] GET /identity/v3/role_assignments?user.id=60b3ca8694ab4a169a3c36561290d8c5&scope.project.id=f230a12ca6234faabf984e4a58a0d2e8&role.id=ce7268982b3046a08a5a58a49d928fc6 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:37.404206 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7369e-c7cd-49af-8f46-db6392db9461 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:37.404775 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7369e-c7cd-49af-8f46-db6392db9461 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:37.404775 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7369e-c7cd-49af-8f46-db6392db9461 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:37.406079 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 463/938] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:03:37.411710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c482be-04b0-488a-b0e3-ca24f5281a9d None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:37.412202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c482be-04b0-488a-b0e3-ca24f5281a9d None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:37.412297 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c482be-04b0-488a-b0e3-ca24f5281a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:37.430762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-f9c482be-04b0-488a-b0e3-ca24f5281a9d None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:03:37.431994 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f9c482be-04b0-488a-b0e3-ca24f5281a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:03:37.434882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:37.506368 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 476/939] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:03:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:03:37.793125 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7369e-c7cd-49af-8f46-db6392db9461 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:37.903848 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7369e-c7cd-49af-8f46-db6392db9461 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:37.935532 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:37.942162 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5731b1-fcd5-4ccf-a53b-45fe5ec36520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:37.942787 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5731b1-fcd5-4ccf-a53b-45fe5ec36520 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:37.943059 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5731b1-fcd5-4ccf-a53b-45fe5ec36520 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:37.943320 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5731b1-fcd5-4ccf-a53b-45fe5ec36520 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:37.955336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5731b1-fcd5-4ccf-a53b-45fe5ec36520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:03:37.960694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-0f5731b1-fcd5-4ccf-a53b-45fe5ec36520 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:03:37.960694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:37.960694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:37.960694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:37.960694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:37.960694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:37.960694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:37.960694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:37.960694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:37.960694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:37.960694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:37.960694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:37.960694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:03:37.960694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:03:37.960694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:03:37.960694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:03:37.961734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:03:37.961734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:03:37.961734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:03:37.961734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:03:37.961734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:37.961734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:37.961734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:37.961734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:37.961734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:37.961734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:37.961734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:37.961734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:37.961734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:37.961734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:37.961734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:37.961734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:37.962587 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:37.962587 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:37.962587 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:37.962587 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:37.962587 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:03:37.962587 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:03:37.962587 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:03:37.962587 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:03:37.962587 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:03:37.962587 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:03:37.962587 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:03:37.962587 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:03:37.962587 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 464/940] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 24 13:03:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:03:37.968755 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c482be-04b0-488a-b0e3-ca24f5281a9d None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:38.080099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c482be-04b0-488a-b0e3-ca24f5281a9d None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:38.115222 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d98f89-6bcd-4f2e-8cea-449ff74f7a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:38.115861 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d98f89-6bcd-4f2e-8cea-449ff74f7a5f None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:38.116166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d98f89-6bcd-4f2e-8cea-449ff74f7a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:38.116440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d98f89-6bcd-4f2e-8cea-449ff74f7a5f None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:38.117097 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d98f89-6bcd-4f2e-8cea-449ff74f7a5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:38.117404 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d98f89-6bcd-4f2e-8cea-449ff74f7a5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:38.118759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d98f89-6bcd-4f2e-8cea-449ff74f7a5f None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:38.127489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 477/941] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:03:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:38.135053 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5731b1-fcd5-4ccf-a53b-45fe5ec36520 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:38.255043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5731b1-fcd5-4ccf-a53b-45fe5ec36520 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:38.296411 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336431a4-caa7-47a2-8c96-60c77d5eb9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:38.297068 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336431a4-caa7-47a2-8c96-60c77d5eb9d9 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:38.297322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336431a4-caa7-47a2-8c96-60c77d5eb9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:38.297695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336431a4-caa7-47a2-8c96-60c77d5eb9d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:38.309823 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336431a4-caa7-47a2-8c96-60c77d5eb9d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:38.311243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336431a4-caa7-47a2-8c96-60c77d5eb9d9 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:38.326429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-336431a4-caa7-47a2-8c96-60c77d5eb9d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:03:38.326429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:38.326429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:38.326429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:38.326429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:38.326429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:38.326429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:38.326429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:38.326429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:38.326429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:38.326429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:38.326429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:38.326429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:03:38.326429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:03:38.326429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:03:38.326429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:03:38.327721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:38.327721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:38.327721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:38.327721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:38.327721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:38.327721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:38.327721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:38.327721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:38.327721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:38.327721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:38.327721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:38.327721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:38.327721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:38.327721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:38.327721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:38.327721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:38.327721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:03:38.329066 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:03:38.329066 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:03:38.329066 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:03:38.329066 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 465/942] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:03:38.334467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d98f89-6bcd-4f2e-8cea-449ff74f7a5f None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:38.337362 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:38.447754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d98f89-6bcd-4f2e-8cea-449ff74f7a5f None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:38.481369 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863436cc-8783-4f6d-beab-425b9413fc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:38.481963 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863436cc-8783-4f6d-beab-425b9413fc29 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:38.482236 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863436cc-8783-4f6d-beab-425b9413fc29 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:38.482502 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863436cc-8783-4f6d-beab-425b9413fc29 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:38.483129 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863436cc-8783-4f6d-beab-425b9413fc29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:38.483445 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863436cc-8783-4f6d-beab-425b9413fc29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:38.484907 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863436cc-8783-4f6d-beab-425b9413fc29 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:38.496819 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 478/943] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:38.503500 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336431a4-caa7-47a2-8c96-60c77d5eb9d9 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:38.551475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:38.613507 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336431a4-caa7-47a2-8c96-60c77d5eb9d9 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:38.649551 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db2d96-3d1f-407f-9047-91362db5cab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:38.650197 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db2d96-3d1f-407f-9047-91362db5cab6 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:38.650456 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db2d96-3d1f-407f-9047-91362db5cab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:38.650707 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db2d96-3d1f-407f-9047-91362db5cab6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:38.659026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db2d96-3d1f-407f-9047-91362db5cab6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:38.660498 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db2d96-3d1f-407f-9047-91362db5cab6 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:38.671682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-43db2d96-3d1f-407f-9047-91362db5cab6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 24 13:03:38.671682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:38.671682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:38.671682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:38.671682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:38.671682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:38.671682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:38.671682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:38.671682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:38.671682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:38.671682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:38.671682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:38.671682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:03:38.671682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:03:38.671682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:03:38.671682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:03:38.673046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:38.673046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:38.673046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:03:38.673046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:03:38.673046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:03:38.673046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:03:38.673046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:38.673046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:38.673046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:38.673046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:38.673046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:38.673046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:38.673046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:38.673046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:38.673046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:38.673046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:38.673046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:38.673046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:38.674177 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:38.674177 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:38.674177 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:03:38.674177 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:03:38.674177 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:03:38.674177 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:03:38.674177 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:03:38.674177 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:03:38.674177 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 24 13:03:38.674177 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:03:38.674177 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 466/944] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:03:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:03:38.678824 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863436cc-8783-4f6d-beab-425b9413fc29 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:38.743164 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:38.785041 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863436cc-8783-4f6d-beab-425b9413fc29 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:38.826689 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b974729-4d8e-4e60-b8c6-26c47213cf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:38.827385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b974729-4d8e-4e60-b8c6-26c47213cf8b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:38.827836 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b974729-4d8e-4e60-b8c6-26c47213cf8b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:38.828148 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b974729-4d8e-4e60-b8c6-26c47213cf8b None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:38.829146 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b974729-4d8e-4e60-b8c6-26c47213cf8b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:38.829673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b974729-4d8e-4e60-b8c6-26c47213cf8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:38.831521 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b974729-4d8e-4e60-b8c6-26c47213cf8b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:38.851732 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 479/945] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Oct 24 13:03:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:38.857627 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db2d96-3d1f-407f-9047-91362db5cab6 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:38.972871 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db2d96-3d1f-407f-9047-91362db5cab6 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:38.974541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:39.010528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373cdf4-4344-4ed4-a4e4-f5045ee6fcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:39.011191 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373cdf4-4344-4ed4-a4e4-f5045ee6fcbb None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:39.011503 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373cdf4-4344-4ed4-a4e4-f5045ee6fcbb None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:39.011775 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373cdf4-4344-4ed4-a4e4-f5045ee6fcbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:39.024574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373cdf4-4344-4ed4-a4e4-f5045ee6fcbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:39.026086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373cdf4-4344-4ed4-a4e4-f5045ee6fcbb None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:39.042487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-a373cdf4-4344-4ed4-a4e4-f5045ee6fcbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:03:39.042487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:39.042487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:39.042487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:39.042487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:39.042487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:39.042487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:39.042487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:39.042487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:39.042487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:39.042487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:39.042487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:39.042487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:03:39.042487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:03:39.042487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:03:39.042487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:03:39.043661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:39.043661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:39.043661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:39.043661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:39.043661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:39.043661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:39.043661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:39.043661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:39.043661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:39.043661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:39.043661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:39.043661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:39.043661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:39.043661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:39.043661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:39.043661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:39.043661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:03:39.044820 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:03:39.044820 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:03:39.044820 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:03:39.044820 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 467/946] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:03:39.049822 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b974729-4d8e-4e60-b8c6-26c47213cf8b None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:39.157921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b974729-4d8e-4e60-b8c6-26c47213cf8b None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:39.179821 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:39.195673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cca07-bafc-40cc-ad24-e5bfc2fe98b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:39.196283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cca07-bafc-40cc-ad24-e5bfc2fe98b9 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:39.196554 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cca07-bafc-40cc-ad24-e5bfc2fe98b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:39.197103 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cca07-bafc-40cc-ad24-e5bfc2fe98b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:39.197740 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cca07-bafc-40cc-ad24-e5bfc2fe98b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:39.198038 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cca07-bafc-40cc-ad24-e5bfc2fe98b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:39.199401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cca07-bafc-40cc-ad24-e5bfc2fe98b9 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:39.212586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 480/947] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:39.218530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373cdf4-4344-4ed4-a4e4-f5045ee6fcbb None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:39.344570 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373cdf4-4344-4ed4-a4e4-f5045ee6fcbb None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:39.383270 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfaba3-1f13-4fa0-9591-62c20eb76377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:39.384011 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfaba3-1f13-4fa0-9591-62c20eb76377 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:39.384288 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfaba3-1f13-4fa0-9591-62c20eb76377 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:39.384557 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfaba3-1f13-4fa0-9591-62c20eb76377 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:39.391345 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cfaba3-1f13-4fa0-9591-62c20eb76377 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:39.393511 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cfaba3-1f13-4fa0-9591-62c20eb76377 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:39.404957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-03cfaba3-1f13-4fa0-9591-62c20eb76377 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:03:39.404957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:39.404957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:39.404957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:39.404957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:39.404957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:39.404957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:39.404957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:39.404957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:39.404957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:39.404957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:39.404957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:39.404957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:03:39.404957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:03:39.404957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:03:39.406048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:03:39.406048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:39.406048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:39.406048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:39.406048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:39.406048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:39.406048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:39.406048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:39.406048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:39.406048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:39.406048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:39.406048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:39.406048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:39.406048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:39.406048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:39.406048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:39.406048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:39.407152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:03:39.407152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:03:39.407152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:03:39.407152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:03:39.407152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:03:39.407152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:03:39.407152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:03:39.407152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:03:39.407152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 468/948] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:03:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:03:39.412297 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cca07-bafc-40cc-ad24-e5bfc2fe98b9 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:39.527333 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cca07-bafc-40cc-ad24-e5bfc2fe98b9 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:39.566142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19a347-8c56-42c4-8c64-9a890a58e81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:39.566749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19a347-8c56-42c4-8c64-9a890a58e81b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:39.567027 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19a347-8c56-42c4-8c64-9a890a58e81b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:39.567296 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19a347-8c56-42c4-8c64-9a890a58e81b None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:39.568035 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19a347-8c56-42c4-8c64-9a890a58e81b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:39.568336 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19a347-8c56-42c4-8c64-9a890a58e81b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:39.569790 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19a347-8c56-42c4-8c64-9a890a58e81b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:39.583392 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 481/949] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 24 13:03:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:39.589706 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfaba3-1f13-4fa0-9591-62c20eb76377 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:39.608513 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:39.702213 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfaba3-1f13-4fa0-9591-62c20eb76377 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:39.740874 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c9e35-2e36-4a16-919e-e4477ec9bf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:39.741792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c9e35-2e36-4a16-919e-e4477ec9bf01 None admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:39.742079 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c9e35-2e36-4a16-919e-e4477ec9bf01 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:39.742346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c9e35-2e36-4a16-919e-e4477ec9bf01 None admin] PATH_INFO: `/v3/projects/f230a12ca6234faabf984e4a58a0d2e8/users/60b3ca8694ab4a169a3c36561290d8c5/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:39.744352 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c9e35-2e36-4a16-919e-e4477ec9bf01 None admin] RBAC: Authorizing `identity:create_grant(project_id=f230a12ca6234faabf984e4a58a0d2e8, user_id=60b3ca8694ab4a169a3c36561290d8c5, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:39.745792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c9e35-2e36-4a16-919e-e4477ec9bf01 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:39.759431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 469/950] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 24 13:03:39 2022] PUT /identity/v3/projects/f230a12ca6234faabf984e4a58a0d2e8/users/60b3ca8694ab4a169a3c36561290d8c5/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:03:42.129720 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c41af4-6824-4de4-b615-74f9ed2155d5 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:42.130257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c41af4-6824-4de4-b615-74f9ed2155d5 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:42.130257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c41af4-6824-4de4-b615-74f9ed2155d5 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:42.131614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 482/951] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:03:42.137012 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5529c3-4836-4696-85b5-9bcef9d74fe9 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:42.137468 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5529c3-4836-4696-85b5-9bcef9d74fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:42.137670 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5529c3-4836-4696-85b5-9bcef9d74fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:42.158209 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-1a5529c3-4836-4696-85b5-9bcef9d74fe9 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:03:42.159628 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-1a5529c3-4836-4696-85b5-9bcef9d74fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:03:42.238192 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 470/952] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:03:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:03:42.550624 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c41af4-6824-4de4-b615-74f9ed2155d5 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:42.595800 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:42.656470 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c41af4-6824-4de4-b615-74f9ed2155d5 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:42.696210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ccb19-e91b-4d9c-a292-15ad44b831f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:42.697314 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ccb19-e91b-4d9c-a292-15ad44b831f3 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:42.697614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ccb19-e91b-4d9c-a292-15ad44b831f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:42.698037 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ccb19-e91b-4d9c-a292-15ad44b831f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:42.710740 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ccb19-e91b-4d9c-a292-15ad44b831f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:03:42.717070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-d77ccb19-e91b-4d9c-a292-15ad44b831f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:03:42.717070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:42.717070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:42.717070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:42.717070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:42.717070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:42.717070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:42.717070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:42.717070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:42.717070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:42.717070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:42.717070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:42.717070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:03:42.717070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:03:42.717070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:03:42.717070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:03:42.718103 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:03:42.718103 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:03:42.718103 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:03:42.718103 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:03:42.718103 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:42.718103 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:42.718103 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:42.718103 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:42.718103 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:42.718103 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:42.718103 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:42.718103 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:42.718103 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:42.718103 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:42.718103 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:42.718103 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:42.718967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:42.718967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:42.718967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:42.718967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:42.718967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:03:42.718967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:03:42.718967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:03:42.718967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:03:42.718967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:03:42.718967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:03:42.718967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:03:42.718967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:03:42.718967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 483/953] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 24 13:03:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:03:42.725229 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5529c3-4836-4696-85b5-9bcef9d74fe9 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:42.728322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:42.835570 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5529c3-4836-4696-85b5-9bcef9d74fe9 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:42.870994 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237f312-6121-4602-bc30-f71e3b9905e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:42.871622 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237f312-6121-4602-bc30-f71e3b9905e7 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:42.871922 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237f312-6121-4602-bc30-f71e3b9905e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:42.872182 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237f312-6121-4602-bc30-f71e3b9905e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:42.872839 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237f312-6121-4602-bc30-f71e3b9905e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:42.873133 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237f312-6121-4602-bc30-f71e3b9905e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:42.874497 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237f312-6121-4602-bc30-f71e3b9905e7 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:42.884767 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 471/954] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 24 13:03:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:42.891533 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ccb19-e91b-4d9c-a292-15ad44b831f3 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:43.005253 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:43.008398 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ccb19-e91b-4d9c-a292-15ad44b831f3 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:43.043676 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893028d-e886-4217-bb1a-1a2f0607c35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:43.044304 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893028d-e886-4217-bb1a-1a2f0607c35f None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:43.044579 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893028d-e886-4217-bb1a-1a2f0607c35f None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:43.044843 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893028d-e886-4217-bb1a-1a2f0607c35f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:43.056365 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893028d-e886-4217-bb1a-1a2f0607c35f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:43.057804 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893028d-e886-4217-bb1a-1a2f0607c35f None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:43.072438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-5893028d-e886-4217-bb1a-1a2f0607c35f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:03:43.072438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:43.072438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:43.072438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:43.072438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:43.072438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:43.072438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:43.072438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:43.072438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:43.072438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:43.072438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:43.072438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:43.072438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:03:43.072438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:03:43.072438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:03:43.072438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:03:43.073629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:43.073629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:43.073629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:43.073629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:43.073629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:43.073629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:43.073629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:43.073629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:43.073629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:43.073629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:43.073629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:43.073629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:43.073629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:43.073629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:43.073629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:43.073629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:43.073629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:03:43.074550 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:03:43.074550 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:03:43.074550 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:03:43.074550 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 484/955] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:03:43.079517 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237f312-6121-4602-bc30-f71e3b9905e7 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:43.150447 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:43.187037 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237f312-6121-4602-bc30-f71e3b9905e7 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:43.225400 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59387fe-84ed-4883-8457-3b66fc95f5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:43.226080 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59387fe-84ed-4883-8457-3b66fc95f5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:43.226412 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59387fe-84ed-4883-8457-3b66fc95f5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:43.226684 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59387fe-84ed-4883-8457-3b66fc95f5e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:43.227332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59387fe-84ed-4883-8457-3b66fc95f5e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:43.227710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59387fe-84ed-4883-8457-3b66fc95f5e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:43.229219 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59387fe-84ed-4883-8457-3b66fc95f5e7 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:43.244261 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 472/956] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:43.249712 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893028d-e886-4217-bb1a-1a2f0607c35f None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:43.367405 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893028d-e886-4217-bb1a-1a2f0607c35f None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:43.404227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a144de5-8b73-4dcb-8203-dfbe7673c703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:43.405386 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a144de5-8b73-4dcb-8203-dfbe7673c703 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:43.405784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a144de5-8b73-4dcb-8203-dfbe7673c703 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:43.406085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a144de5-8b73-4dcb-8203-dfbe7673c703 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:43.414775 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a144de5-8b73-4dcb-8203-dfbe7673c703 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:43.416483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a144de5-8b73-4dcb-8203-dfbe7673c703 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:43.429753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-1a144de5-8b73-4dcb-8203-dfbe7673c703 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 24 13:03:43.429753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:43.429753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:43.429753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:43.429753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:43.429753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:43.429753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:43.429753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:43.429753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:43.429753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:43.429753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:43.429753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:43.429753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:03:43.429753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:03:43.429753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:03:43.429753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:03:43.430921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:43.430921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:43.430921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:03:43.430921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:03:43.430921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:03:43.430921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:03:43.430921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:43.430921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:43.430921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:43.430921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:43.430921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:43.430921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:43.430921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:43.430921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:43.430921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:43.430921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:43.430921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:43.430921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:43.432142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:43.432142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:43.432142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:03:43.432142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:03:43.432142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:03:43.432142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:03:43.432142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:03:43.432142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:03:43.432142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 24 13:03:43.432142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:03:43.432142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 485/957] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:03:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:03:43.437187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59387fe-84ed-4883-8457-3b66fc95f5e7 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:43.552293 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59387fe-84ed-4883-8457-3b66fc95f5e7 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:43.582464 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:43.591783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bdbe52-ec91-43c2-98e4-f6a895bf9a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:43.592359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdbe52-ec91-43c2-98e4-f6a895bf9a65 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:43.592636 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdbe52-ec91-43c2-98e4-f6a895bf9a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:43.592898 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdbe52-ec91-43c2-98e4-f6a895bf9a65 None admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:43.593617 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bdbe52-ec91-43c2-98e4-f6a895bf9a65 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:43.593923 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bdbe52-ec91-43c2-98e4-f6a895bf9a65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:43.596412 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bdbe52-ec91-43c2-98e4-f6a895bf9a65 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:43.616963 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 473/958] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Oct 24 13:03:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:43.623234 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a144de5-8b73-4dcb-8203-dfbe7673c703 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:43.640546 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:43.732027 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a144de5-8b73-4dcb-8203-dfbe7673c703 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:43.768270 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb310c5-1020-4272-9a34-68a7e46a1a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:43.768881 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb310c5-1020-4272-9a34-68a7e46a1a20 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:43.769154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb310c5-1020-4272-9a34-68a7e46a1a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:43.769424 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb310c5-1020-4272-9a34-68a7e46a1a20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:43.839610 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb310c5-1020-4272-9a34-68a7e46a1a20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:43.841075 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb310c5-1020-4272-9a34-68a7e46a1a20 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:43.855583 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:43.943722 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 486/959] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 24 13:03:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:03:43.950109 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bdbe52-ec91-43c2-98e4-f6a895bf9a65 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:44.053031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bdbe52-ec91-43c2-98e4-f6a895bf9a65 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:44.087243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a089516-619c-48fa-b51e-65502876ddeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:44.089955 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a089516-619c-48fa-b51e-65502876ddeb None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:44.089955 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a089516-619c-48fa-b51e-65502876ddeb None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:44.089955 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a089516-619c-48fa-b51e-65502876ddeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:44.099570 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a089516-619c-48fa-b51e-65502876ddeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:44.101029 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a089516-619c-48fa-b51e-65502876ddeb None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:44.116438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-3a089516-619c-48fa-b51e-65502876ddeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:03:44.116438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:44.116438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:44.116438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:44.116438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:44.116438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:44.116438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:44.116438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:44.116438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:44.116438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:44.116438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:44.116438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:44.116438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:03:44.116438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:03:44.116438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:03:44.116438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:03:44.117598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:44.117598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:44.117598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:44.117598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:44.117598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:44.117598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:44.117598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:44.117598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:44.117598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:44.117598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:44.117598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:44.117598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:44.117598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:44.117598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:44.117598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:44.117598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:44.117598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:03:44.118875 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:03:44.118875 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:03:44.118875 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:03:44.118875 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 474/960] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:03:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:03:44.123476 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb310c5-1020-4272-9a34-68a7e46a1a20 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:44.226756 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb310c5-1020-4272-9a34-68a7e46a1a20 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:44.244633 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:44.270934 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e97503-8ea8-4086-b5c4-c88b3cef3ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:44.271679 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e97503-8ea8-4086-b5c4-c88b3cef3ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:44.272009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e97503-8ea8-4086-b5c4-c88b3cef3ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:44.272368 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e97503-8ea8-4086-b5c4-c88b3cef3ec2 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:44.273051 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e97503-8ea8-4086-b5c4-c88b3cef3ec2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:44.273494 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e97503-8ea8-4086-b5c4-c88b3cef3ec2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:44.275232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e97503-8ea8-4086-b5c4-c88b3cef3ec2 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:44.290188 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 487/961] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 24 13:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:44.296618 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a089516-619c-48fa-b51e-65502876ddeb None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:44.331974 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:44.394494 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a089516-619c-48fa-b51e-65502876ddeb None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:44.427366 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7653410-20cd-44eb-a20b-01efb59f4e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:44.427993 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7653410-20cd-44eb-a20b-01efb59f4e0d None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:44.428267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7653410-20cd-44eb-a20b-01efb59f4e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:44.428533 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7653410-20cd-44eb-a20b-01efb59f4e0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:44.434960 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7653410-20cd-44eb-a20b-01efb59f4e0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:44.436411 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7653410-20cd-44eb-a20b-01efb59f4e0d None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:44.448508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application [None req-d7653410-20cd-44eb-a20b-01efb59f4e0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:03:44.448508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:44.448508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:44.448508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:44.448508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:44.448508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:44.448508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:44.448508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:44.448508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:44.448508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:44.448508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:44.448508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:44.448508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:03:44.448508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:03:44.448508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:03:44.449541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:03:44.449541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:44.449541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:44.449541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:44.449541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:44.449541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:44.449541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:44.449541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:44.449541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:44.449541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:44.449541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:44.449541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:44.449541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:44.449541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:44.449541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:44.449541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:44.449541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:44.450616 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:03:44.450616 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:03:44.450616 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:03:44.450616 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:03:44.450616 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:03:44.450616 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:03:44.450616 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:03:44.450616 dv-cinder-862491-1-smb devstack@keystone.service[81600]: ERROR keystone.server.flask.application Oct 24 13:03:44.450616 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 475/962] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 24 13:03:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:03:44.455464 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e97503-8ea8-4086-b5c4-c88b3cef3ec2 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:44.557182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e97503-8ea8-4086-b5c4-c88b3cef3ec2 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:44.590803 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d58163-32e0-40f3-9f21-d38b25698575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:44.591335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d58163-32e0-40f3-9f21-d38b25698575 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:44.591640 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d58163-32e0-40f3-9f21-d38b25698575 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:44.591908 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d58163-32e0-40f3-9f21-d38b25698575 None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:44.592582 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d58163-32e0-40f3-9f21-d38b25698575 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:44.592882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d58163-32e0-40f3-9f21-d38b25698575 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:44.594294 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d58163-32e0-40f3-9f21-d38b25698575 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:44.605608 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 488/963] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 24 13:03:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:03:44.611768 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7653410-20cd-44eb-a20b-01efb59f4e0d None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:44.702187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:44.708595 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7653410-20cd-44eb-a20b-01efb59f4e0d None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:44.740298 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084463f-e78d-45a3-b7f5-046a7e6603bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:44.740873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084463f-e78d-45a3-b7f5-046a7e6603bd None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:44.741146 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084463f-e78d-45a3-b7f5-046a7e6603bd None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:44.741410 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084463f-e78d-45a3-b7f5-046a7e6603bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:44.742114 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084463f-e78d-45a3-b7f5-046a7e6603bd None admin] RBAC: Adding query filter params (role.id=23ca6ecd60b2470cba913daeaf54f0f7, scope.project.id=f230a12ca6234faabf984e4a58a0d2e8, user.id=60b3ca8694ab4a169a3c36561290d8c5) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:44.742415 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084463f-e78d-45a3-b7f5-046a7e6603bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:44.743863 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084463f-e78d-45a3-b7f5-046a7e6603bd None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:44.749312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 476/964] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 24 13:03:44 2022] GET /identity/v3/role_assignments?user.id=60b3ca8694ab4a169a3c36561290d8c5&scope.project.id=f230a12ca6234faabf984e4a58a0d2e8&role.id=23ca6ecd60b2470cba913daeaf54f0f7 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:03:46.904578 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3beab1-4c5b-4372-ad24-b7fbb2c04007 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:46.905129 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3beab1-4c5b-4372-ad24-b7fbb2c04007 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:46.905129 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3beab1-4c5b-4372-ad24-b7fbb2c04007 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:46.906324 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 489/965] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:03:46.912261 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb851f7-2da7-40cb-840f-5fed4f9d862d None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:46.912688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb851f7-2da7-40cb-840f-5fed4f9d862d None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:46.912814 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb851f7-2da7-40cb-840f-5fed4f9d862d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:46.931102 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-1eb851f7-2da7-40cb-840f-5fed4f9d862d None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:03:46.932303 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-1eb851f7-2da7-40cb-840f-5fed4f9d862d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:03:46.996800 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 477/966] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:03:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:03:47.269436 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3beab1-4c5b-4372-ad24-b7fbb2c04007 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:47.303911 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:47.373687 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3beab1-4c5b-4372-ad24-b7fbb2c04007 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:47.405988 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122610b-1103-4e83-8307-806005eb0ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:47.406600 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122610b-1103-4e83-8307-806005eb0ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:47.406876 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122610b-1103-4e83-8307-806005eb0ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:47.407146 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122610b-1103-4e83-8307-806005eb0ab0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:47.408270 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122610b-1103-4e83-8307-806005eb0ab0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:47.409612 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122610b-1103-4e83-8307-806005eb0ab0 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:47.418176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-5122610b-1103-4e83-8307-806005eb0ab0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:03:47.418176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:47.418176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:03:47.418176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:03:47.418176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:03:47.418176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:03:47.418176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:03:47.418176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:03:47.418176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:03:47.418176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:03:47.418176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:03:47.418176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:03:47.418176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:47.418176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:47.418176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:47.418176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:47.418176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:47.419521 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:47.419521 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:47.419521 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:47.419521 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:47.419521 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:47.419521 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:47.419521 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:03:47.419521 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:03:47.419521 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:03:47.419521 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:03:47.419521 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:47.419521 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:47.419521 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:47.419521 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:47.419521 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:47.419521 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:47.420729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:47.420729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:47.420729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:47.420729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:47.420729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:47.420729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:47.420729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:47.420729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:47.420729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:47.420729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:47.420729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:03:47.420729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:03:47.420729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:03:47.420729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:03:47.420729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 490/967] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Oct 24 13:03:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:03:47.425921 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb851f7-2da7-40cb-840f-5fed4f9d862d None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:47.512454 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:47.522417 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb851f7-2da7-40cb-840f-5fed4f9d862d None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:47.555868 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa966b0e-6eb0-4dd1-b57d-b749dd38cf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:47.556463 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa966b0e-6eb0-4dd1-b57d-b749dd38cf5d None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:47.556734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa966b0e-6eb0-4dd1-b57d-b749dd38cf5d None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:47.557000 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa966b0e-6eb0-4dd1-b57d-b749dd38cf5d None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:47.557609 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa966b0e-6eb0-4dd1-b57d-b749dd38cf5d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:47.557902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa966b0e-6eb0-4dd1-b57d-b749dd38cf5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:47.559261 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa966b0e-6eb0-4dd1-b57d-b749dd38cf5d None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:47.564058 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 478/968] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Oct 24 13:03:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:47.570123 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122610b-1103-4e83-8307-806005eb0ab0 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:47.660610 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:47.666457 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122610b-1103-4e83-8307-806005eb0ab0 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:47.698626 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add49bdc-6342-45a7-b812-b9dbb5bd1fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:47.699208 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add49bdc-6342-45a7-b812-b9dbb5bd1fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:47.699510 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add49bdc-6342-45a7-b812-b9dbb5bd1fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:47.699783 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add49bdc-6342-45a7-b812-b9dbb5bd1fc3 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:47.700397 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add49bdc-6342-45a7-b812-b9dbb5bd1fc3 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:47.700694 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add49bdc-6342-45a7-b812-b9dbb5bd1fc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:47.702041 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add49bdc-6342-45a7-b812-b9dbb5bd1fc3 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:47.706259 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 491/969] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Oct 24 13:03:47 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:49.832649 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e7983-e602-4b66-9c75-88f4417ff320 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:49.833177 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e7983-e602-4b66-9c75-88f4417ff320 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:49.833177 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e7983-e602-4b66-9c75-88f4417ff320 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:49.834453 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 479/970] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:03:49.839539 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf339a-7ab6-4193-befc-e7b07e38f6dd None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:49.839938 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf339a-7ab6-4193-befc-e7b07e38f6dd None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:49.840086 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf339a-7ab6-4193-befc-e7b07e38f6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:49.858544 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b0bf339a-7ab6-4193-befc-e7b07e38f6dd None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:03:49.859751 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b0bf339a-7ab6-4193-befc-e7b07e38f6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:03:49.924307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 492/971] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:03:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:03:50.194654 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e7983-e602-4b66-9c75-88f4417ff320 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:50.303667 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e7983-e602-4b66-9c75-88f4417ff320 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:50.337412 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d694fca-8b7e-4948-9ea5-8c9e435ecc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:50.338005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d694fca-8b7e-4948-9ea5-8c9e435ecc57 None admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:50.338281 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d694fca-8b7e-4948-9ea5-8c9e435ecc57 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:50.338550 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d694fca-8b7e-4948-9ea5-8c9e435ecc57 None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:50.339205 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d694fca-8b7e-4948-9ea5-8c9e435ecc57 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:50.340600 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d694fca-8b7e-4948-9ea5-8c9e435ecc57 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:50.354137 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 480/972] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 24 13:03:50 2022] POST /identity/v3/services => generated 246 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:03:52.492994 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703118fc-7559-44ab-b6bf-88471fbdb8d0 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:52.493526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703118fc-7559-44ab-b6bf-88471fbdb8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:52.493526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703118fc-7559-44ab-b6bf-88471fbdb8d0 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:52.494835 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 493/973] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:03:52.499948 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae6683-fc50-466a-9033-27e4bb0f32a2 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:52.500389 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae6683-fc50-466a-9033-27e4bb0f32a2 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:52.500499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae6683-fc50-466a-9033-27e4bb0f32a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:52.518817 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-7aae6683-fc50-466a-9033-27e4bb0f32a2 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:03:52.520018 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-7aae6683-fc50-466a-9033-27e4bb0f32a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:03:52.529053 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:52.596427 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 481/974] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:03:52 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:03:52.861977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703118fc-7559-44ab-b6bf-88471fbdb8d0 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:52.949244 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:52.960533 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703118fc-7559-44ab-b6bf-88471fbdb8d0 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:52.992770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c717a5-15cd-41a9-8357-23f168fca3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:52.993444 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c717a5-15cd-41a9-8357-23f168fca3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:52.993654 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c717a5-15cd-41a9-8357-23f168fca3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:52.993923 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c717a5-15cd-41a9-8357-23f168fca3d4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:52.994494 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c717a5-15cd-41a9-8357-23f168fca3d4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:52.995878 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c717a5-15cd-41a9-8357-23f168fca3d4 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:53.005326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-09c717a5-15cd-41a9-8357-23f168fca3d4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:03:53.005326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:53.005326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:03:53.005326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:03:53.005326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:03:53.005326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:03:53.005326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:03:53.005326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:03:53.005326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:03:53.005326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:03:53.005326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:03:53.005326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:03:53.005326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:53.005326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:53.005326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:53.005326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:53.005326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:53.006483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:53.006483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:53.006483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:53.006483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:53.006483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:53.006483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:53.006483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:03:53.006483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:03:53.006483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:03:53.006483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:03:53.006483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:53.006483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:53.006483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:53.006483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:53.006483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:53.006483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:53.007703 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:53.007703 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:53.007703 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:53.007703 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:53.007703 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:53.007703 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:53.007703 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:53.007703 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:53.007703 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:53.007703 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:53.007703 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:03:53.007703 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:03:53.007703 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:03:53.007703 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:03:53.007703 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 494/975] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Oct 24 13:03:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:03:53.012350 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae6683-fc50-466a-9033-27e4bb0f32a2 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:53.109489 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae6683-fc50-466a-9033-27e4bb0f32a2 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:53.143689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326343b-37ee-4c31-a7b3-260a28108800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:53.144212 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326343b-37ee-4c31-a7b3-260a28108800 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:53.144485 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326343b-37ee-4c31-a7b3-260a28108800 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:53.144751 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326343b-37ee-4c31-a7b3-260a28108800 None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:53.145363 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326343b-37ee-4c31-a7b3-260a28108800 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:53.145657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326343b-37ee-4c31-a7b3-260a28108800 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:53.147010 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326343b-37ee-4c31-a7b3-260a28108800 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:53.151901 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 482/976] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Oct 24 13:03:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:53.157905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c717a5-15cd-41a9-8357-23f168fca3d4 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:53.256292 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c717a5-15cd-41a9-8357-23f168fca3d4 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:53.293552 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1982c0d-a580-4571-a0ae-a8096278fee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:53.294251 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1982c0d-a580-4571-a0ae-a8096278fee7 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:53.294622 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1982c0d-a580-4571-a0ae-a8096278fee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:53.294893 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1982c0d-a580-4571-a0ae-a8096278fee7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:53.295806 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1982c0d-a580-4571-a0ae-a8096278fee7 None admin] RBAC: Adding query filter params (interface=public, service_id=8dbc920dc7584f32a0b2b3f4f0665f00, region_id=RegionOne) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:53.296129 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1982c0d-a580-4571-a0ae-a8096278fee7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:53.298357 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1982c0d-a580-4571-a0ae-a8096278fee7 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:53.304675 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 495/977] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Oct 24 13:03:53 2022] GET /identity/v3/endpoints?service_id=8dbc920dc7584f32a0b2b3f4f0665f00&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:53.310842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326343b-37ee-4c31-a7b3-260a28108800 None admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:53.315884 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:53.412042 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326343b-37ee-4c31-a7b3-260a28108800 None admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:53.444368 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7075e3-60ab-443c-b29e-e65f1d8458d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:53.444959 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7075e3-60ab-443c-b29e-e65f1d8458d8 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:53.445237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7075e3-60ab-443c-b29e-e65f1d8458d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:53.445506 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7075e3-60ab-443c-b29e-e65f1d8458d8 None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:53.446099 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7075e3-60ab-443c-b29e-e65f1d8458d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:53.447768 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7075e3-60ab-443c-b29e-e65f1d8458d8 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:53.454537 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 483/978] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Oct 24 13:03:53 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:03:55.605483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba919030-c93e-4a8e-89e2-58ed4ad6de67 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:55.606001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba919030-c93e-4a8e-89e2-58ed4ad6de67 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:55.606001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba919030-c93e-4a8e-89e2-58ed4ad6de67 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:55.607371 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 496/979] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:03:55.613193 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb52b9c-7de7-4518-9f07-30355db3ff0a None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:55.613608 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb52b9c-7de7-4518-9f07-30355db3ff0a None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:55.613742 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb52b9c-7de7-4518-9f07-30355db3ff0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:55.632080 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-3fb52b9c-7de7-4518-9f07-30355db3ff0a None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:03:55.633254 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-3fb52b9c-7de7-4518-9f07-30355db3ff0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:03:55.694608 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:55.700606 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 484/980] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:03:55 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:03:55.973054 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba919030-c93e-4a8e-89e2-58ed4ad6de67 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:55.991955 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:56.071134 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba919030-c93e-4a8e-89e2-58ed4ad6de67 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:56.103676 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd4b78-4716-46e9-a4e3-8e95a87adf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:56.104286 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd4b78-4716-46e9-a4e3-8e95a87adf05 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:56.104561 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd4b78-4716-46e9-a4e3-8e95a87adf05 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:56.104826 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd4b78-4716-46e9-a4e3-8e95a87adf05 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:56.105387 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd4b78-4716-46e9-a4e3-8e95a87adf05 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:56.106724 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd4b78-4716-46e9-a4e3-8e95a87adf05 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:56.115765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-c3dd4b78-4716-46e9-a4e3-8e95a87adf05 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:03:56.115765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:56.115765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:03:56.115765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:03:56.115765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:03:56.115765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:03:56.115765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:03:56.115765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:03:56.115765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:03:56.115765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:03:56.115765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:03:56.115765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:03:56.115765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:56.115765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:56.115765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:56.115765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:56.115765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:56.116909 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:56.116909 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:56.116909 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:56.116909 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:56.116909 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:56.116909 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:56.116909 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:03:56.116909 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:03:56.116909 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:03:56.116909 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:03:56.116909 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:56.116909 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:56.116909 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:56.116909 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:56.116909 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:56.116909 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:56.118108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:56.118108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:56.118108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:56.118108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:56.118108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:56.118108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:56.118108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:56.118108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:56.118108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:56.118108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:56.118108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:03:56.118108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:03:56.118108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:03:56.118108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Oct 24 13:03:56.118108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 497/981] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Oct 24 13:03:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:03:56.122805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb52b9c-7de7-4518-9f07-30355db3ff0a None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:56.219720 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb52b9c-7de7-4518-9f07-30355db3ff0a None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:56.257723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577f71c-24c6-4603-8de1-c3654afe5fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:56.258326 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577f71c-24c6-4603-8de1-c3654afe5fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:56.258745 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577f71c-24c6-4603-8de1-c3654afe5fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:56.259082 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577f71c-24c6-4603-8de1-c3654afe5fb0 None admin] PATH_INFO: `/v3/services` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:56.259868 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577f71c-24c6-4603-8de1-c3654afe5fb0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:56.260244 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577f71c-24c6-4603-8de1-c3654afe5fb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:56.261901 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577f71c-24c6-4603-8de1-c3654afe5fb0 None admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:56.267638 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 485/982] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Oct 24 13:03:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:56.273876 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd4b78-4716-46e9-a4e3-8e95a87adf05 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:56.358219 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:56.375802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd4b78-4716-46e9-a4e3-8e95a87adf05 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:56.408040 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc725343-e684-4a59-86fc-ec7a02b35769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:56.408620 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc725343-e684-4a59-86fc-ec7a02b35769 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:56.408894 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc725343-e684-4a59-86fc-ec7a02b35769 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:56.409164 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc725343-e684-4a59-86fc-ec7a02b35769 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:56.409816 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc725343-e684-4a59-86fc-ec7a02b35769 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:56.411158 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc725343-e684-4a59-86fc-ec7a02b35769 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:56.429605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 498/983] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:03:56 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:04:06.264395 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=69 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:06.425483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:00.338138 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cb21c-74be-4e4c-8f11-503fe9f2a2ee None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:00.339192 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cb21c-74be-4e4c-8f11-503fe9f2a2ee None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:00.339895 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cb21c-74be-4e4c-8f11-503fe9f2a2ee None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:00.346222 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 486/984] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:05:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:00.347649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4a8ea-e8fd-4abc-93a8-6484493807ab None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:00.348065 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4a8ea-e8fd-4abc-93a8-6484493807ab None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:00.348193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4a8ea-e8fd-4abc-93a8-6484493807ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:00.519570 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-fda4a8ea-e8fd-4abc-93a8-6484493807ab None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:00.521672 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-fda4a8ea-e8fd-4abc-93a8-6484493807ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:00.763312 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 499/985] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:05:01.059966 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85f95f-e8e9-44a0-9f6f-579d28aeacca None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:01.060656 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85f95f-e8e9-44a0-9f6f-579d28aeacca None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:01.061073 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85f95f-e8e9-44a0-9f6f-579d28aeacca None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:01.062806 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 487/986] 10.222.0.18 () {54 vars in 964 bytes} [Mon Oct 24 13:05:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:01.069160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640566a2-a9b2-4919-9eaa-e22b671f3cd8 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:01.069673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640566a2-a9b2-4919-9eaa-e22b671f3cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:01.070058 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640566a2-a9b2-4919-9eaa-e22b671f3cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:01.157850 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-640566a2-a9b2-4919-9eaa-e22b671f3cd8 None None] MFA Rules not processed for user `0f2295659f2e467d8d798bf93f731330`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:01.159135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-640566a2-a9b2-4919-9eaa-e22b671f3cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:01.193449 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:01.257935 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 500/987] 10.222.0.18 () {58 vars in 1061 bytes} [Mon Oct 24 13:05:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:01.268740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85f95f-e8e9-44a0-9f6f-579d28aeacca None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:01.270683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-3b85f95f-e8e9-44a0-9f6f-579d28aeacca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:01.413094 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85f95f-e8e9-44a0-9f6f-579d28aeacca None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:01.501000 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430dea1-74ab-4cb2-8f6a-49e30d785847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:01.502744 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430dea1-74ab-4cb2-8f6a-49e30d785847 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:01.503173 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430dea1-74ab-4cb2-8f6a-49e30d785847 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:01.503617 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430dea1-74ab-4cb2-8f6a-49e30d785847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:01.505388 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d430dea1-74ab-4cb2-8f6a-49e30d785847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:01.565674 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:01.624619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430dea1-74ab-4cb2-8f6a-49e30d785847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:01.627116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430dea1-74ab-4cb2-8f6a-49e30d785847 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:01.647494 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 488/988] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:04.108188 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5befa8-d87b-4a23-bee8-7cef23a714c8 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:04.108739 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5befa8-d87b-4a23-bee8-7cef23a714c8 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:04.108739 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5befa8-d87b-4a23-bee8-7cef23a714c8 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:04.110043 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 501/989] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:04.115928 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6ea18-03d6-4a17-a144-cefbbbd4752b None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:04.116371 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6ea18-03d6-4a17-a144-cefbbbd4752b None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:04.116467 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6ea18-03d6-4a17-a144-cefbbbd4752b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:04.191045 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-f4d6ea18-03d6-4a17-a144-cefbbbd4752b None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:04.192280 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f4d6ea18-03d6-4a17-a144-cefbbbd4752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:04.292089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 489/990] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:04.574073 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5befa8-d87b-4a23-bee8-7cef23a714c8 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:04.575645 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7e5befa8-d87b-4a23-bee8-7cef23a714c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:04.677389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5befa8-d87b-4a23-bee8-7cef23a714c8 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:04.748002 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:04.750251 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89ebe0-6452-4d9c-9c2e-30160f907f7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:04.750944 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89ebe0-6452-4d9c-9c2e-30160f907f7a service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:04.751230 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89ebe0-6452-4d9c-9c2e-30160f907f7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:04.751774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89ebe0-6452-4d9c-9c2e-30160f907f7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:04.753780 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2f89ebe0-6452-4d9c-9c2e-30160f907f7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:04.860247 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89ebe0-6452-4d9c-9c2e-30160f907f7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:04.862139 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89ebe0-6452-4d9c-9c2e-30160f907f7a service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:04.879218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 502/991] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:07.345647 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10044e70-f20d-4d44-85db-dc22b6b3aa32 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:07.346213 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10044e70-f20d-4d44-85db-dc22b6b3aa32 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:07.346213 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10044e70-f20d-4d44-85db-dc22b6b3aa32 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:07.347538 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 490/992] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:07.352940 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8b7e3-e66e-4904-92d5-0d493a670b38 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:07.353382 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8b7e3-e66e-4904-92d5-0d493a670b38 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:07.353509 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8b7e3-e66e-4904-92d5-0d493a670b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:07.418832 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-f3d8b7e3-e66e-4904-92d5-0d493a670b38 None None] MFA Rules not processed for user `085a4df4c8f84be3b428ea5d8d6cc167`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:07.420053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f3d8b7e3-e66e-4904-92d5-0d493a670b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:07.471212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:07.515281 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 503/993] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:07 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:05:07.801229 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10044e70-f20d-4d44-85db-dc22b6b3aa32 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:07.802740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-10044e70-f20d-4d44-85db-dc22b6b3aa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:07.812469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:07.903986 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10044e70-f20d-4d44-85db-dc22b6b3aa32 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:07.977490 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86565ecc-cc81-4e42-8b69-ea694091d5f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:07.978083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86565ecc-cc81-4e42-8b69-ea694091d5f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:07.978360 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86565ecc-cc81-4e42-8b69-ea694091d5f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:07.978631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86565ecc-cc81-4e42-8b69-ea694091d5f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:07.980231 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-86565ecc-cc81-4e42-8b69-ea694091d5f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:08.042827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:08.089321 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86565ecc-cc81-4e42-8b69-ea694091d5f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:08.090689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86565ecc-cc81-4e42-8b69-ea694091d5f9 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:08.108412 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 491/994] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:07 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:10.826350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da7e97-3e9e-4220-9a2f-92d7d9aebd4b None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:10.826859 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da7e97-3e9e-4220-9a2f-92d7d9aebd4b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:10.826859 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da7e97-3e9e-4220-9a2f-92d7d9aebd4b None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:10.828196 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 504/995] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:10.833494 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c854d-1111-4e9b-aa34-590d3a48a65d None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:10.833953 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c854d-1111-4e9b-aa34-590d3a48a65d None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:10.834045 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c854d-1111-4e9b-aa34-590d3a48a65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:10.899827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-286c854d-1111-4e9b-aa34-590d3a48a65d None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:10.901021 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-286c854d-1111-4e9b-aa34-590d3a48a65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:10.996961 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 492/996] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:11.303993 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f538a-724d-4606-8a4d-1b99e01af8e1 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:11.304280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f538a-724d-4606-8a4d-1b99e01af8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:11.304555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f538a-724d-4606-8a4d-1b99e01af8e1 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:11.305874 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 505/997] 10.222.0.18 () {54 vars in 964 bytes} [Mon Oct 24 13:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:11.311803 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6f2be-1e45-45db-a02d-d701d751751b None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:11.312085 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6f2be-1e45-45db-a02d-d701d751751b None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:11.312354 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6f2be-1e45-45db-a02d-d701d751751b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:11.335378 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:11.389393 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-6fd6f2be-1e45-45db-a02d-d701d751751b None None] MFA Rules not processed for user `0f2295659f2e467d8d798bf93f731330`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:11.390584 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-6fd6f2be-1e45-45db-a02d-d701d751751b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:11.464682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 493/998] 10.222.0.18 () {58 vars in 1061 bytes} [Mon Oct 24 13:05:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:11.473650 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f538a-724d-4606-8a4d-1b99e01af8e1 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:11.475254 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ce3f538a-724d-4606-8a4d-1b99e01af8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:11.580807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f538a-724d-4606-8a4d-1b99e01af8e1 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:11.652698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8044c39-9ca8-4d2e-a420-2aa79ddbe402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:11.653340 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8044c39-9ca8-4d2e-a420-2aa79ddbe402 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:11.653600 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8044c39-9ca8-4d2e-a420-2aa79ddbe402 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:11.653870 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8044c39-9ca8-4d2e-a420-2aa79ddbe402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:11.655623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c8044c39-9ca8-4d2e-a420-2aa79ddbe402 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:11.662386 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:11.763718 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8044c39-9ca8-4d2e-a420-2aa79ddbe402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:11.765161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8044c39-9ca8-4d2e-a420-2aa79ddbe402 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:11.783925 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 506/999] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:15.150603 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ae077-34ad-461b-8a11-69133a44cbbb None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:15.151173 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ae077-34ad-461b-8a11-69133a44cbbb None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:15.151173 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ae077-34ad-461b-8a11-69133a44cbbb None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:15.152560 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 494/1000] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:15.158637 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a07e7d-9e50-41bc-ba92-7b366cfca96b None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:15.159184 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a07e7d-9e50-41bc-ba92-7b366cfca96b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:15.159184 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a07e7d-9e50-41bc-ba92-7b366cfca96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:15.231472 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-38a07e7d-9e50-41bc-ba92-7b366cfca96b None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:15.232715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-38a07e7d-9e50-41bc-ba92-7b366cfca96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:15.296420 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:15.338690 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 507/1001] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:15.623333 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ae077-34ad-461b-8a11-69133a44cbbb None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:15.624884 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-286ae077-34ad-461b-8a11-69133a44cbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:15.731688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ae077-34ad-461b-8a11-69133a44cbbb None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:15.744990 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:15.807392 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce72c4e-d940-48c3-91c4-b52323ff9a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:15.807942 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce72c4e-d940-48c3-91c4-b52323ff9a2f service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:15.808215 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce72c4e-d940-48c3-91c4-b52323ff9a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:15.808484 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce72c4e-d940-48c3-91c4-b52323ff9a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:15.810078 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-dce72c4e-d940-48c3-91c4-b52323ff9a2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:15.917889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce72c4e-d940-48c3-91c4-b52323ff9a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:15.919319 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce72c4e-d940-48c3-91c4-b52323ff9a2f service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:15.937910 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 495/1002] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:18.178024 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedf2c7-e564-4de3-9851-9bbfce372642 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:18.178661 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedf2c7-e564-4de3-9851-9bbfce372642 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:18.178661 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedf2c7-e564-4de3-9851-9bbfce372642 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:18.179926 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 508/1003] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:18.185310 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ba9cf-93c0-46d7-bfdb-bc3a18324293 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:18.185788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ba9cf-93c0-46d7-bfdb-bc3a18324293 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:18.185873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ba9cf-93c0-46d7-bfdb-bc3a18324293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:18.241001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:18.262241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-1d9ba9cf-93c0-46d7-bfdb-bc3a18324293 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:18.263551 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-1d9ba9cf-93c0-46d7-bfdb-bc3a18324293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:18.362246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 496/1004] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:05:18.647997 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aedf2c7-e564-4de3-9851-9bbfce372642 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:18.649650 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0aedf2c7-e564-4de3-9851-9bbfce372642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:18.754562 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aedf2c7-e564-4de3-9851-9bbfce372642 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:18.827239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914371fc-59b0-48f9-bbe9-b23032d6c7f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:18.827783 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914371fc-59b0-48f9-bbe9-b23032d6c7f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:18.828058 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914371fc-59b0-48f9-bbe9-b23032d6c7f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:18.828327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914371fc-59b0-48f9-bbe9-b23032d6c7f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:18.830694 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-914371fc-59b0-48f9-bbe9-b23032d6c7f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:18.848330 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:18.941285 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914371fc-59b0-48f9-bbe9-b23032d6c7f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:18.942847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914371fc-59b0-48f9-bbe9-b23032d6c7f0 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:18.961939 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 509/1005] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:21.168908 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07a5a8-d70b-4545-b5e7-3550458e3e3a None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:21.169438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07a5a8-d70b-4545-b5e7-3550458e3e3a None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:21.169438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07a5a8-d70b-4545-b5e7-3550458e3e3a None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:21.170802 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 497/1006] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:21.177158 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfea33-34c3-49fe-b194-9d98f88df9b4 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:21.177615 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfea33-34c3-49fe-b194-9d98f88df9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:21.177701 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfea33-34c3-49fe-b194-9d98f88df9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:21.244244 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-1bdfea33-34c3-49fe-b194-9d98f88df9b4 None None] MFA Rules not processed for user `085a4df4c8f84be3b428ea5d8d6cc167`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:21.245438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1bdfea33-34c3-49fe-b194-9d98f88df9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:21.309955 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:21.342517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 510/1007] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:21 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:21.624709 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07a5a8-d70b-4545-b5e7-3550458e3e3a None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:21.626977 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-eb07a5a8-d70b-4545-b5e7-3550458e3e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:21.732715 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07a5a8-d70b-4545-b5e7-3550458e3e3a None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:21.756071 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:21.809554 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d4f31-d08a-4444-903d-3cda1e899b90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:21.810156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d4f31-d08a-4444-903d-3cda1e899b90 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:21.810432 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d4f31-d08a-4444-903d-3cda1e899b90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:21.810701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d4f31-d08a-4444-903d-3cda1e899b90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:21.812378 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-723d4f31-d08a-4444-903d-3cda1e899b90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:21.921734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d4f31-d08a-4444-903d-3cda1e899b90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:21.923733 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d4f31-d08a-4444-903d-3cda1e899b90 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:21.941460 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 498/1008] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:21 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:24.351451 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ce232-a849-4d18-afa4-91f0c123e10e None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:24.351958 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ce232-a849-4d18-afa4-91f0c123e10e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:24.352064 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ce232-a849-4d18-afa4-91f0c123e10e None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:24.353329 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 511/1009] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:24.359022 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7dcb7-25cf-4061-8d8b-6d42e8ee7fde None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:24.359484 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7dcb7-25cf-4061-8d8b-6d42e8ee7fde None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:24.359604 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7dcb7-25cf-4061-8d8b-6d42e8ee7fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:24.424686 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:24.427620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-78d7dcb7-25cf-4061-8d8b-6d42e8ee7fde None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:24.429526 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-78d7dcb7-25cf-4061-8d8b-6d42e8ee7fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:24.526568 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 499/1010] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:24.806024 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ce232-a849-4d18-afa4-91f0c123e10e None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:24.807556 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7a7ce232-a849-4d18-afa4-91f0c123e10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:24.911880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ce232-a849-4d18-afa4-91f0c123e10e None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:24.982898 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb1020-e043-4474-b279-ff6f8118809b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:24.983541 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb1020-e043-4474-b279-ff6f8118809b service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:24.983815 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb1020-e043-4474-b279-ff6f8118809b service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:24.984085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb1020-e043-4474-b279-ff6f8118809b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:24.986275 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7fbb1020-e043-4474-b279-ff6f8118809b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:25.012519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:25.095436 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb1020-e043-4474-b279-ff6f8118809b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:25.096762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb1020-e043-4474-b279-ff6f8118809b service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:25.115005 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 512/1011] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:27.328014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b5d49-0477-40e6-bd39-dbf8be4f3f18 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:27.328543 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b5d49-0477-40e6-bd39-dbf8be4f3f18 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:27.328543 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b5d49-0477-40e6-bd39-dbf8be4f3f18 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:27.330448 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 500/1012] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:05:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:27.335655 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd70b4-dee2-4ae4-976c-7cd2adf105ff None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:27.336036 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd70b4-dee2-4ae4-976c-7cd2adf105ff None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:27.336199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd70b4-dee2-4ae4-976c-7cd2adf105ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:27.399724 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-1fcd70b4-dee2-4ae4-976c-7cd2adf105ff None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:27.400904 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1fcd70b4-dee2-4ae4-976c-7cd2adf105ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:27.473721 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:27.495166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 513/1013] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:27.783602 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b5d49-0477-40e6-bd39-dbf8be4f3f18 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:27.785124 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-1c8b5d49-0477-40e6-bd39-dbf8be4f3f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:27.887467 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b5d49-0477-40e6-bd39-dbf8be4f3f18 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:27.915347 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:27.960710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d01d25-f527-4941-a658-3ebd6c2ea91e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:27.961293 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d01d25-f527-4941-a658-3ebd6c2ea91e service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:27.961563 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d01d25-f527-4941-a658-3ebd6c2ea91e service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:27.961829 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d01d25-f527-4941-a658-3ebd6c2ea91e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:27.963358 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-41d01d25-f527-4941-a658-3ebd6c2ea91e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:28.069738 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d01d25-f527-4941-a658-3ebd6c2ea91e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:28.071096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d01d25-f527-4941-a658-3ebd6c2ea91e service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:28.089607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 501/1014] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:30.614193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3ab9f-f221-48da-b245-5ed9d1d0a035 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:30.614715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3ab9f-f221-48da-b245-5ed9d1d0a035 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:30.614715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3ab9f-f221-48da-b245-5ed9d1d0a035 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:30.616094 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 514/1015] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:30.621284 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e29037-c79c-4d46-a042-6d54a83cbd91 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:30.621734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e29037-c79c-4d46-a042-6d54a83cbd91 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:30.621836 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e29037-c79c-4d46-a042-6d54a83cbd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:30.691934 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-39e29037-c79c-4d46-a042-6d54a83cbd91 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:30.693155 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-39e29037-c79c-4d46-a042-6d54a83cbd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:30.702659 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:30.791944 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 502/1016] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:31.075780 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3ab9f-f221-48da-b245-5ed9d1d0a035 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:31.077294 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f4d3ab9f-f221-48da-b245-5ed9d1d0a035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:31.177931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3ab9f-f221-48da-b245-5ed9d1d0a035 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:31.248721 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f277d-f077-424f-a4ec-da87b4fbddc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:31.249371 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f277d-f077-424f-a4ec-da87b4fbddc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:31.249657 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f277d-f077-424f-a4ec-da87b4fbddc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:31.249896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f277d-f077-424f-a4ec-da87b4fbddc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:31.252261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ee9f277d-f077-424f-a4ec-da87b4fbddc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:31.289502 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:31.362067 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f277d-f077-424f-a4ec-da87b4fbddc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:31.363433 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f277d-f077-424f-a4ec-da87b4fbddc0 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:31.381454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 515/1017] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:35.430543 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b04140-1bb9-4ea3-8353-f7788d9e39de None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:35.431070 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b04140-1bb9-4ea3-8353-f7788d9e39de None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:35.431070 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b04140-1bb9-4ea3-8353-f7788d9e39de None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:35.432444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 503/1018] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:35.437683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b772ddc-3336-46a7-86ab-73cc3ba613c3 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:35.438110 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b772ddc-3336-46a7-86ab-73cc3ba613c3 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:35.438213 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b772ddc-3336-46a7-86ab-73cc3ba613c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:35.505167 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-9b772ddc-3336-46a7-86ab-73cc3ba613c3 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:35.506277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9b772ddc-3336-46a7-86ab-73cc3ba613c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:35.596635 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:35.608625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 516/1019] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:35.889441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b04140-1bb9-4ea3-8353-f7788d9e39de None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:35.891008 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-58b04140-1bb9-4ea3-8353-f7788d9e39de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:35.995587 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b04140-1bb9-4ea3-8353-f7788d9e39de None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:36.034392 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:36.072156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c5b9a-9806-4a9b-85ec-e19f0e7a92cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:36.072758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c5b9a-9806-4a9b-85ec-e19f0e7a92cb service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:36.073036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c5b9a-9806-4a9b-85ec-e19f0e7a92cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:36.073307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c5b9a-9806-4a9b-85ec-e19f0e7a92cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:36.075134 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-c97c5b9a-9806-4a9b-85ec-e19f0e7a92cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:36.187318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c5b9a-9806-4a9b-85ec-e19f0e7a92cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:36.189398 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c5b9a-9806-4a9b-85ec-e19f0e7a92cb service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:36.208795 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 504/1020] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:38.984669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11329860-e8fc-4b3f-8df8-af243e4c305c None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:38.985206 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11329860-e8fc-4b3f-8df8-af243e4c305c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:38.985206 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11329860-e8fc-4b3f-8df8-af243e4c305c None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:38.987046 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 517/1021] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:38.992326 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aef80b-f627-4e92-a6af-aa1af2f90a35 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:38.992804 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aef80b-f627-4e92-a6af-aa1af2f90a35 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:38.992997 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aef80b-f627-4e92-a6af-aa1af2f90a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:39.059347 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-66aef80b-f627-4e92-a6af-aa1af2f90a35 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:39.060645 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-66aef80b-f627-4e92-a6af-aa1af2f90a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:39.080036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:39.158402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 505/1022] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:39.456934 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11329860-e8fc-4b3f-8df8-af243e4c305c None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:39.458476 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-11329860-e8fc-4b3f-8df8-af243e4c305c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:39.568711 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11329860-e8fc-4b3f-8df8-af243e4c305c None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:39.647410 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c49469-3116-4d15-8401-7550d49e9847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:39.648037 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c49469-3116-4d15-8401-7550d49e9847 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:39.648386 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c49469-3116-4d15-8401-7550d49e9847 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:39.648631 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c49469-3116-4d15-8401-7550d49e9847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:39.650174 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-66c49469-3116-4d15-8401-7550d49e9847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:39.694037 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:39.763309 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c49469-3116-4d15-8401-7550d49e9847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:39.764727 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c49469-3116-4d15-8401-7550d49e9847 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:39.784146 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 518/1023] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:43.995636 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b8b46-b1e1-49ac-842e-4618c02e7227 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:43.996135 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b8b46-b1e1-49ac-842e-4618c02e7227 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:43.996235 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b8b46-b1e1-49ac-842e-4618c02e7227 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:43.997519 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 506/1024] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:44.003131 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be167e-84ab-479a-b9f1-250f5b516cc5 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:44.003683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be167e-84ab-479a-b9f1-250f5b516cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:44.003776 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be167e-84ab-479a-b9f1-250f5b516cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:44.071288 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-49be167e-84ab-479a-b9f1-250f5b516cc5 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:44.072533 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-49be167e-84ab-479a-b9f1-250f5b516cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:44.167599 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:44.171566 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 519/1025] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:44.460131 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b8b46-b1e1-49ac-842e-4618c02e7227 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:44.461638 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d16b8b46-b1e1-49ac-842e-4618c02e7227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:44.573325 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b8b46-b1e1-49ac-842e-4618c02e7227 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:44.620788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:44.647672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38b6f0-61b9-47bb-8df6-6fa7e8da22a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:44.648269 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38b6f0-61b9-47bb-8df6-6fa7e8da22a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:44.648544 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38b6f0-61b9-47bb-8df6-6fa7e8da22a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:44.648812 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38b6f0-61b9-47bb-8df6-6fa7e8da22a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:44.650408 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-ce38b6f0-61b9-47bb-8df6-6fa7e8da22a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:44.758416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38b6f0-61b9-47bb-8df6-6fa7e8da22a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:44.759889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38b6f0-61b9-47bb-8df6-6fa7e8da22a9 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:44.777796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 507/1026] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:49.707054 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e3ce0-0e06-4d35-8a52-7f77aec14eb6 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:49.707541 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e3ce0-0e06-4d35-8a52-7f77aec14eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:49.707631 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e3ce0-0e06-4d35-8a52-7f77aec14eb6 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:49.709212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 520/1027] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 24 13:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:49.714626 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d623c-7877-4b31-be69-1a6d9310e11f None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:49.715077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d623c-7877-4b31-be69-1a6d9310e11f None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:49.715164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d623c-7877-4b31-be69-1a6d9310e11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:49.863446 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-9a1d623c-7877-4b31-be69-1a6d9310e11f None None] MFA Rules not processed for user `60b3ca8694ab4a169a3c36561290d8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:49.863446 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-9a1d623c-7877-4b31-be69-1a6d9310e11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:49.893915 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:49.996848 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 508/1028] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 24 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:54.090221 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b807b-3f85-4019-ab31-3c7cce339a51 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:54.090802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b807b-3f85-4019-ab31-3c7cce339a51 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:54.090889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b807b-3f85-4019-ab31-3c7cce339a51 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:54.092640 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 521/1029] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 24 13:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:54.097816 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14da727-c53c-432b-bded-d94579d99b57 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:54.098233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14da727-c53c-432b-bded-d94579d99b57 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:54.098411 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14da727-c53c-432b-bded-d94579d99b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:54.179701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-d14da727-c53c-432b-bded-d94579d99b57 None None] MFA Rules not processed for user `60b3ca8694ab4a169a3c36561290d8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:54.180903 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d14da727-c53c-432b-bded-d94579d99b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:54.256961 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:54.295698 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 509/1030] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 24 13:05:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:55.774140 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a13e3-a2f6-4aa7-8330-5e587e070d9d None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:55.774664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a13e3-a2f6-4aa7-8330-5e587e070d9d None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:55.774664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a13e3-a2f6-4aa7-8330-5e587e070d9d None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:55.776045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 522/1031] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 24 13:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:55.781074 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66379e-32d5-4ac8-bf11-56154491111c None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:55.781488 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66379e-32d5-4ac8-bf11-56154491111c None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:55.781781 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66379e-32d5-4ac8-bf11-56154491111c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:55.863917 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-fe66379e-32d5-4ac8-bf11-56154491111c None None] MFA Rules not processed for user `60b3ca8694ab4a169a3c36561290d8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:55.865224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-fe66379e-32d5-4ac8-bf11-56154491111c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:55.971983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 510/1032] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 24 13:05:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:59.512781 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358ce7c-79bb-47eb-8c8c-1d334c047c17 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:59.513297 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358ce7c-79bb-47eb-8c8c-1d334c047c17 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:59.513297 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358ce7c-79bb-47eb-8c8c-1d334c047c17 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:59.514634 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 523/1033] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:59.520478 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d806e7a-b67e-4c76-9316-ce51f5b5a6e2 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:59.522119 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d806e7a-b67e-4c76-9316-ce51f5b5a6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:59.522601 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d806e7a-b67e-4c76-9316-ce51f5b5a6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:59.567871 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:59.604997 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-8d806e7a-b67e-4c76-9316-ce51f5b5a6e2 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:59.606180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-8d806e7a-b67e-4c76-9316-ce51f5b5a6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:59.711496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 511/1034] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:00.019589 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59733f-e92e-4d8a-9418-3f086dbeedb9 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:00.020680 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59733f-e92e-4d8a-9418-3f086dbeedb9 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:00.021304 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59733f-e92e-4d8a-9418-3f086dbeedb9 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:00.025864 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 524/1035] 10.222.0.18 () {54 vars in 961 bytes} [Mon Oct 24 13:06:00 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:00.031857 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6023f-2291-4611-81dc-ff2578b0f207 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:00.033016 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6023f-2291-4611-81dc-ff2578b0f207 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:00.033016 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6023f-2291-4611-81dc-ff2578b0f207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:00.111434 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-dcd6023f-2291-4611-81dc-ff2578b0f207 None None] MFA Rules not processed for user `4f6b27c7d052437a949a371169fb48ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:00.112654 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-dcd6023f-2291-4611-81dc-ff2578b0f207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:00.165604 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:00.237681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 512/1036] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Oct 24 13:06:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:00.254223 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59733f-e92e-4d8a-9418-3f086dbeedb9 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:00.255649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9b59733f-e92e-4d8a-9418-3f086dbeedb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:00.409294 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59733f-e92e-4d8a-9418-3f086dbeedb9 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:00.485337 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:00.525692 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaafac5d-9588-4ae3-8db3-b083ed74f670 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:00.526315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafac5d-9588-4ae3-8db3-b083ed74f670 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:00.526568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafac5d-9588-4ae3-8db3-b083ed74f670 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:00.526789 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafac5d-9588-4ae3-8db3-b083ed74f670 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:00.528293 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-eaafac5d-9588-4ae3-8db3-b083ed74f670 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:00.628233 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaafac5d-9588-4ae3-8db3-b083ed74f670 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:00.629828 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaafac5d-9588-4ae3-8db3-b083ed74f670 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:00.649737 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 525/1037] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:03.062826 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c8ff5-1fd7-4404-ac11-df283b0ffed8 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:03.062826 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c8ff5-1fd7-4404-ac11-df283b0ffed8 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:03.062826 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c8ff5-1fd7-4404-ac11-df283b0ffed8 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:03.069473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9265fd-4ca7-46e1-8389-558d4a05aefd None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:03.070076 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9265fd-4ca7-46e1-8389-558d4a05aefd None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:03.070076 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9265fd-4ca7-46e1-8389-558d4a05aefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:03.071975 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 513/1038] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:06:03 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:03.151930 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-5a9265fd-4ca7-46e1-8389-558d4a05aefd None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:03.153205 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5a9265fd-4ca7-46e1-8389-558d4a05aefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:03.196602 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:03.260088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 526/1039] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:06:03.552593 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c8ff5-1fd7-4404-ac11-df283b0ffed8 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:03.554115 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d88c8ff5-1fd7-4404-ac11-df283b0ffed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:03.736625 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c8ff5-1fd7-4404-ac11-df283b0ffed8 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:03.749593 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:03.878640 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebb28a-7bed-48a4-9ef4-867851e66379 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:03.879246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebb28a-7bed-48a4-9ef4-867851e66379 service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:03.879566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebb28a-7bed-48a4-9ef4-867851e66379 service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:03.879839 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebb28a-7bed-48a4-9ef4-867851e66379 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:03.881430 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-69ebb28a-7bed-48a4-9ef4-867851e66379 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:03.974218 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebb28a-7bed-48a4-9ef4-867851e66379 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:03.975889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebb28a-7bed-48a4-9ef4-867851e66379 service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:03.994517 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 514/1040] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:06.505178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b72368-cf52-4a5a-b36f-6bfdd2e7b8a8 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:06.505695 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b72368-cf52-4a5a-b36f-6bfdd2e7b8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:06.505695 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b72368-cf52-4a5a-b36f-6bfdd2e7b8a8 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:06.507110 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 527/1041] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:06:06.512292 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb832b3-ec6a-4cb8-aefe-2bfb269888e4 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:06.512681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb832b3-ec6a-4cb8-aefe-2bfb269888e4 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:06.512861 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb832b3-ec6a-4cb8-aefe-2bfb269888e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:06.528733 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:06.586121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-0bb832b3-ec6a-4cb8-aefe-2bfb269888e4 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:06.587798 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-0bb832b3-ec6a-4cb8-aefe-2bfb269888e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:06.706584 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 515/1042] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:07.006605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb359e9-a754-4f36-ba90-0b2d4119c531 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:07.007065 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb359e9-a754-4f36-ba90-0b2d4119c531 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:07.007464 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb359e9-a754-4f36-ba90-0b2d4119c531 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:07.009042 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 528/1043] 10.222.0.18 () {54 vars in 961 bytes} [Mon Oct 24 13:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:07.014481 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4883ac-d914-4e91-b1a2-6acce5d66179 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:07.014775 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4883ac-d914-4e91-b1a2-6acce5d66179 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:07.015047 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4883ac-d914-4e91-b1a2-6acce5d66179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:07.094346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-3f4883ac-d914-4e91-b1a2-6acce5d66179 None None] MFA Rules not processed for user `4f6b27c7d052437a949a371169fb48ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:07.095915 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-3f4883ac-d914-4e91-b1a2-6acce5d66179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:07.132694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:07.221144 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 516/1044] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Oct 24 13:06:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:07.229082 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb359e9-a754-4f36-ba90-0b2d4119c531 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:07.230579 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6eb359e9-a754-4f36-ba90-0b2d4119c531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:07.384648 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb359e9-a754-4f36-ba90-0b2d4119c531 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:07.406089 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:07.509897 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700052d-c5ab-4216-9abb-5abdf21f7623 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:07.510551 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700052d-c5ab-4216-9abb-5abdf21f7623 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:07.510814 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700052d-c5ab-4216-9abb-5abdf21f7623 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:07.511058 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700052d-c5ab-4216-9abb-5abdf21f7623 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:07.513378 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7700052d-c5ab-4216-9abb-5abdf21f7623 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:07.621211 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700052d-c5ab-4216-9abb-5abdf21f7623 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:07.622889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700052d-c5ab-4216-9abb-5abdf21f7623 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:07.643322 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 529/1045] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:07.783286 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944e6cf-f4b0-4af3-87a1-5ed73ea1eb7b None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:07.784023 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944e6cf-f4b0-4af3-87a1-5ed73ea1eb7b None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:07.784230 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944e6cf-f4b0-4af3-87a1-5ed73ea1eb7b None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:07.785837 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 517/1046] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:07.791778 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc21a55-2015-44ac-a7c0-f6240d098e1b None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:07.792067 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc21a55-2015-44ac-a7c0-f6240d098e1b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:07.792343 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc21a55-2015-44ac-a7c0-f6240d098e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:07.830291 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:07.880424 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-3fc21a55-2015-44ac-a7c0-f6240d098e1b None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:07.881837 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3fc21a55-2015-44ac-a7c0-f6240d098e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:07.997853 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 530/1047] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:08.336293 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d92cc-80eb-485c-9f1b-6bc829243576 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:08.336687 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d92cc-80eb-485c-9f1b-6bc829243576 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:08.337098 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d92cc-80eb-485c-9f1b-6bc829243576 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:08.338871 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 518/1048] 10.222.0.18 () {54 vars in 963 bytes} [Mon Oct 24 13:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:06:08.343913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22ee5b-0dc0-47e2-b6f2-f213ea2914b7 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:08.344206 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22ee5b-0dc0-47e2-b6f2-f213ea2914b7 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:08.344483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22ee5b-0dc0-47e2-b6f2-f213ea2914b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:08.429190 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-ed22ee5b-0dc0-47e2-b6f2-f213ea2914b7 None None] MFA Rules not processed for user `171146d5235b4af8aff6f502e478f2df`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:08.430398 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ed22ee5b-0dc0-47e2-b6f2-f213ea2914b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:08.482636 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:08.514533 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 531/1049] 10.222.0.18 () {58 vars in 1060 bytes} [Mon Oct 24 13:06:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:08.522339 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d92cc-80eb-485c-9f1b-6bc829243576 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:08.524103 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b74d92cc-80eb-485c-9f1b-6bc829243576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:08.653252 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d92cc-80eb-485c-9f1b-6bc829243576 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:08.702435 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:08.744929 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf000b80-2800-40e6-92eb-3f45da0520ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:08.745529 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf000b80-2800-40e6-92eb-3f45da0520ce service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:08.745835 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf000b80-2800-40e6-92eb-3f45da0520ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:08.746072 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf000b80-2800-40e6-92eb-3f45da0520ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:08.747711 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-cf000b80-2800-40e6-92eb-3f45da0520ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:08.879677 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf000b80-2800-40e6-92eb-3f45da0520ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:08.881135 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf000b80-2800-40e6-92eb-3f45da0520ce service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:08.901163 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 519/1050] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:06:09.953923 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9096d0-bae1-401f-aa67-c453a1bc96a8 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:09.955080 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9096d0-bae1-401f-aa67-c453a1bc96a8 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:09.955199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9096d0-bae1-401f-aa67-c453a1bc96a8 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:09.956994 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 532/1051] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:06:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:06:09.962283 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab047b-84cd-441e-b810-4ef155c49769 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:09.962728 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab047b-84cd-441e-b810-4ef155c49769 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:09.962845 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab047b-84cd-441e-b810-4ef155c49769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:10.029316 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-9cab047b-84cd-441e-b810-4ef155c49769 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:10.030518 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-9cab047b-84cd-441e-b810-4ef155c49769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:10.050887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:10.132112 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 520/1052] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:10.431935 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9096d0-bae1-401f-aa67-c453a1bc96a8 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:10.433529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8a9096d0-bae1-401f-aa67-c453a1bc96a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:10.602200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9096d0-bae1-401f-aa67-c453a1bc96a8 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:10.657164 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:10.722372 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed430ae-a2a5-480b-90eb-e24124b575d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:10.722981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed430ae-a2a5-480b-90eb-e24124b575d3 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:10.723260 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed430ae-a2a5-480b-90eb-e24124b575d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:10.723569 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed430ae-a2a5-480b-90eb-e24124b575d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:10.725161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-eed430ae-a2a5-480b-90eb-e24124b575d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:10.819878 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed430ae-a2a5-480b-90eb-e24124b575d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:10.821489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed430ae-a2a5-480b-90eb-e24124b575d3 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:10.840604 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 533/1053] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:13.108836 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89a743-544b-4744-baa5-ffb45d18d01b None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:13.109416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89a743-544b-4744-baa5-ffb45d18d01b None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:13.109416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89a743-544b-4744-baa5-ffb45d18d01b None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:13.115184 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 521/1054] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:06:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:13.117190 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7eb2a-ac6e-451f-bf39-4907cabdb5c9 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:13.117637 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7eb2a-ac6e-451f-bf39-4907cabdb5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:13.117741 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7eb2a-ac6e-451f-bf39-4907cabdb5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:13.187847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-1dc7eb2a-ac6e-451f-bf39-4907cabdb5c9 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:13.189975 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1dc7eb2a-ac6e-451f-bf39-4907cabdb5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:13.197544 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:13.306184 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 534/1055] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:13.606874 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89a743-544b-4744-baa5-ffb45d18d01b None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:13.608382 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-aa89a743-544b-4744-baa5-ffb45d18d01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:13.762131 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89a743-544b-4744-baa5-ffb45d18d01b None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:13.766043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:13.882225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26408f-d770-4f6f-a49d-e4d3630dbf1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:13.882742 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26408f-d770-4f6f-a49d-e4d3630dbf1c service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:13.883019 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26408f-d770-4f6f-a49d-e4d3630dbf1c service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:13.883286 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26408f-d770-4f6f-a49d-e4d3630dbf1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:13.884880 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-9d26408f-d770-4f6f-a49d-e4d3630dbf1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:13.983202 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26408f-d770-4f6f-a49d-e4d3630dbf1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:13.984869 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26408f-d770-4f6f-a49d-e4d3630dbf1c service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:14.006039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 522/1056] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:16.497453 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5af462-d0f9-42b7-9134-be2f2ed75013 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:16.497936 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5af462-d0f9-42b7-9134-be2f2ed75013 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:16.497936 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5af462-d0f9-42b7-9134-be2f2ed75013 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:16.500847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 535/1057] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:16.505963 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e2124-fa4a-4b98-86bc-326bbcbfd30d None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:16.506356 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e2124-fa4a-4b98-86bc-326bbcbfd30d None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:16.506586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e2124-fa4a-4b98-86bc-326bbcbfd30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:16.527072 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:16.624864 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-794e2124-fa4a-4b98-86bc-326bbcbfd30d None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:16.626855 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-794e2124-fa4a-4b98-86bc-326bbcbfd30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:16.742209 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 523/1058] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:06:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:17.038429 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5af462-d0f9-42b7-9134-be2f2ed75013 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:17.039961 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ef5af462-d0f9-42b7-9134-be2f2ed75013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:17.183011 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:17.194288 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5af462-d0f9-42b7-9134-be2f2ed75013 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:17.310548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988ce61-099e-454a-88cf-f97c23032845 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:17.311102 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988ce61-099e-454a-88cf-f97c23032845 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:17.311382 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988ce61-099e-454a-88cf-f97c23032845 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:17.311700 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988ce61-099e-454a-88cf-f97c23032845 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:17.313329 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d988ce61-099e-454a-88cf-f97c23032845 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:17.406377 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988ce61-099e-454a-88cf-f97c23032845 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:17.408080 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988ce61-099e-454a-88cf-f97c23032845 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:17.418035 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:17.426960 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 536/1059] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:19.712956 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61277608-9f8c-4061-8aa6-4e94689c9f4c None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:19.713598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61277608-9f8c-4061-8aa6-4e94689c9f4c None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:19.713801 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61277608-9f8c-4061-8aa6-4e94689c9f4c None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:19.715758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 524/1060] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:06:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:06:19.721817 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d24953-03ad-4649-a9bd-5bce9f03bba9 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:19.722316 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d24953-03ad-4649-a9bd-5bce9f03bba9 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:19.722424 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d24953-03ad-4649-a9bd-5bce9f03bba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:19.808524 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d9d24953-03ad-4649-a9bd-5bce9f03bba9 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:19.810137 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d9d24953-03ad-4649-a9bd-5bce9f03bba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:19.945498 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 537/1061] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:20.363970 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61277608-9f8c-4061-8aa6-4e94689c9f4c None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:20.365527 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-61277608-9f8c-4061-8aa6-4e94689c9f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:20.456777 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:20.529926 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61277608-9f8c-4061-8aa6-4e94689c9f4c None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:20.657416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff58e5-e209-4c8b-b3f4-a5aa48755474 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:20.658268 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff58e5-e209-4c8b-b3f4-a5aa48755474 service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:20.658672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff58e5-e209-4c8b-b3f4-a5aa48755474 service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:20.658898 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff58e5-e209-4c8b-b3f4-a5aa48755474 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:20.660598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-66ff58e5-e209-4c8b-b3f4-a5aa48755474 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:20.716314 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:20.758720 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff58e5-e209-4c8b-b3f4-a5aa48755474 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:20.760516 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff58e5-e209-4c8b-b3f4-a5aa48755474 service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:20.781890 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 525/1062] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:22.978725 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41114471-cabd-440f-946c-40f048541763 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:22.979316 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41114471-cabd-440f-946c-40f048541763 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:22.979316 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41114471-cabd-440f-946c-40f048541763 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:22.980774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 538/1063] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:22.985976 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ca25c-da33-435a-a668-2bab56579cab None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:22.986494 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ca25c-da33-435a-a668-2bab56579cab None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:22.986813 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ca25c-da33-435a-a668-2bab56579cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:23.054175 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-e25ca25c-da33-435a-a668-2bab56579cab None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:23.055375 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-e25ca25c-da33-435a-a668-2bab56579cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:23.154086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 526/1064] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:23.446402 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41114471-cabd-440f-946c-40f048541763 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:23.447940 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-41114471-cabd-440f-946c-40f048541763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:23.529397 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:23.599275 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41114471-cabd-440f-946c-40f048541763 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:23.712384 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3036dc-4662-4dd9-b3b8-203bbc8f2fc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:23.712870 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3036dc-4662-4dd9-b3b8-203bbc8f2fc2 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:23.713143 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3036dc-4662-4dd9-b3b8-203bbc8f2fc2 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:23.713408 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3036dc-4662-4dd9-b3b8-203bbc8f2fc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:23.714996 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6a3036dc-4662-4dd9-b3b8-203bbc8f2fc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:23.753536 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:23.805392 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3036dc-4662-4dd9-b3b8-203bbc8f2fc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:23.806990 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3036dc-4662-4dd9-b3b8-203bbc8f2fc2 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:23.824776 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 539/1065] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:24.682136 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e862d1e-6694-4d9d-b618-20d2dc117a9b None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:24.682679 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e862d1e-6694-4d9d-b618-20d2dc117a9b None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:24.682679 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e862d1e-6694-4d9d-b618-20d2dc117a9b None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:24.684296 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 527/1066] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:24.689494 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7bd1f-9155-4652-9d31-40c872759fa1 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:24.689965 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7bd1f-9155-4652-9d31-40c872759fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:24.690074 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7bd1f-9155-4652-9d31-40c872759fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:24.759628 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-02b7bd1f-9155-4652-9d31-40c872759fa1 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:24.760860 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-02b7bd1f-9155-4652-9d31-40c872759fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:24.858296 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 540/1067] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:25.161887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1062f2-c8f8-4c4b-8126-531e3c793f72 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:25.162271 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1062f2-c8f8-4c4b-8126-531e3c793f72 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:25.162599 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1062f2-c8f8-4c4b-8126-531e3c793f72 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:25.164074 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 528/1068] 10.222.0.18 () {54 vars in 962 bytes} [Mon Oct 24 13:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:25.169273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c085827-dc8c-48cc-8c2b-30b6bdde3ed1 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:25.169562 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c085827-dc8c-48cc-8c2b-30b6bdde3ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:25.169839 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c085827-dc8c-48cc-8c2b-30b6bdde3ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:25.186589 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:25.248275 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-0c085827-dc8c-48cc-8c2b-30b6bdde3ed1 None None] MFA Rules not processed for user `dd0866de4d4e46d5b26719faf385d7a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:25.249453 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0c085827-dc8c-48cc-8c2b-30b6bdde3ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:25.323608 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 541/1069] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Oct 24 13:06:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:25.331805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1062f2-c8f8-4c4b-8126-531e3c793f72 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:25.333266 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-3b1062f2-c8f8-4c4b-8126-531e3c793f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:25.364305 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:25.435687 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1062f2-c8f8-4c4b-8126-531e3c793f72 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:25.513650 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbf3c6-4ef0-4c52-aefd-a28c06b2500a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0866de4d4e46d5b26719faf385d7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:25.514743 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbf3c6-4ef0-4c52-aefd-a28c06b2500a service glance] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:25.515022 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbf3c6-4ef0-4c52-aefd-a28c06b2500a service glance] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:25.515346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbf3c6-4ef0-4c52-aefd-a28c06b2500a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:25.517305 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-8dfbf3c6-4ef0-4c52-aefd-a28c06b2500a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:25.601997 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:25.634682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfbf3c6-4ef0-4c52-aefd-a28c06b2500a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:25.636174 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfbf3c6-4ef0-4c52-aefd-a28c06b2500a service glance] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:25.654924 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 529/1070] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:26.060442 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfed3c8-facc-4e09-b885-2e961e7ee63c None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:26.060967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfed3c8-facc-4e09-b885-2e961e7ee63c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:26.060967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfed3c8-facc-4e09-b885-2e961e7ee63c None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:26.062234 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 542/1071] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:26.067868 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1885d00-b920-4aac-966b-d3e7dd991aad None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:26.068289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1885d00-b920-4aac-966b-d3e7dd991aad None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:26.068463 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1885d00-b920-4aac-966b-d3e7dd991aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:26.138944 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-e1885d00-b920-4aac-966b-d3e7dd991aad None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:26.140155 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-e1885d00-b920-4aac-966b-d3e7dd991aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:26.246987 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 530/1072] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:26.404668 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a5616-ac42-4eb1-b92f-c9229f33bb91 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:26.404956 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a5616-ac42-4eb1-b92f-c9229f33bb91 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:26.405231 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a5616-ac42-4eb1-b92f-c9229f33bb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:26.473072 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-527a5616-ac42-4eb1-b92f-c9229f33bb91 None None] MFA Rules not processed for user `f3254b4fddaa4f099c6c44f4c139ee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:26.474272 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-527a5616-ac42-4eb1-b92f-c9229f33bb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:26.540306 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:26.548932 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1885d00-b920-4aac-966b-d3e7dd991aad None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:26.550176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-e1885d00-b920-4aac-966b-d3e7dd991aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:26.577136 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 543/1073] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 24 13:06:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:26.597913 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:26.625720 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee10c6-1363-47c1-8d70-9baa10893ab7 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:26.625969 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee10c6-1363-47c1-8d70-9baa10893ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:26.626214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee10c6-1363-47c1-8d70-9baa10893ab7 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:26.628350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 544/1074] 10.222.0.18 () {54 vars in 943 bytes} [Mon Oct 24 13:06:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:06:26.635723 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c16ffd-af14-4594-bb1e-0ed4935b1dc6 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:26.636220 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c16ffd-af14-4594-bb1e-0ed4935b1dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:26.636484 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c16ffd-af14-4594-bb1e-0ed4935b1dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:26.684263 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1885d00-b920-4aac-966b-d3e7dd991aad None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:26.723352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b1c16ffd-af14-4594-bb1e-0ed4935b1dc6 None None] MFA Rules not processed for user `768c71ab4ab241e4bfed9f7561ae3d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:26.724602 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b1c16ffd-af14-4594-bb1e-0ed4935b1dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:26.804459 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b67f4-055d-4c21-b081-122de4c5d644 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:26.805063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b67f4-055d-4c21-b081-122de4c5d644 service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:26.805347 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b67f4-055d-4c21-b081-122de4c5d644 service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:26.805612 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b67f4-055d-4c21-b081-122de4c5d644 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:26.807184 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-596b67f4-055d-4c21-b081-122de4c5d644 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:26.833626 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 545/1075] 10.222.0.18 () {58 vars in 1040 bytes} [Mon Oct 24 13:06:26 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:26.842869 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c16ffd-af14-4594-bb1e-0ed4935b1dc6 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:26.843929 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:26.853916 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c16ffd-af14-4594-bb1e-0ed4935b1dc6 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:26.879106 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:26.903184 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b67f4-055d-4c21-b081-122de4c5d644 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:26.904821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b67f4-055d-4c21-b081-122de4c5d644 service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:26.924160 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 531/1076] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:06:26.958529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b4878-bd26-4c67-a4bf-2183e777435a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '768c71ab4ab241e4bfed9f7561ae3d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:26.959136 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b4878-bd26-4c67-a4bf-2183e777435a service swift] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:26.959413 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b4878-bd26-4c67-a4bf-2183e777435a service swift] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:26.959708 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b4878-bd26-4c67-a4bf-2183e777435a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:26.961318 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f50b4878-bd26-4c67-a4bf-2183e777435a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:27.065445 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b4878-bd26-4c67-a4bf-2183e777435a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:27.067112 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b4878-bd26-4c67-a4bf-2183e777435a service swift] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:27.077756 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 546/1077] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 24 13:06:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 13:06:29.181009 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a33a5-0229-41c1-8289-0a663b57082b None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:29.181575 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a33a5-0229-41c1-8289-0a663b57082b None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:29.181575 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a33a5-0229-41c1-8289-0a663b57082b None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:29.183038 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 532/1078] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:29.188786 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50342697-6dab-4a16-9e05-6620b675f7dd None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:29.189341 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50342697-6dab-4a16-9e05-6620b675f7dd None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:29.189341 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50342697-6dab-4a16-9e05-6620b675f7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:29.293131 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-50342697-6dab-4a16-9e05-6620b675f7dd None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:29.295132 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-50342697-6dab-4a16-9e05-6620b675f7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:29.305546 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:29.406207 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 547/1079] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:29.704846 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a33a5-0229-41c1-8289-0a663b57082b None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:29.706755 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-846a33a5-0229-41c1-8289-0a663b57082b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:29.875938 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a33a5-0229-41c1-8289-0a663b57082b None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:29.889540 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:30.002899 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510d232-48be-4f54-9df1-d4bf01db52e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:30.003546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510d232-48be-4f54-9df1-d4bf01db52e9 service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:30.003821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510d232-48be-4f54-9df1-d4bf01db52e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:30.004099 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510d232-48be-4f54-9df1-d4bf01db52e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:30.005677 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b510d232-48be-4f54-9df1-d4bf01db52e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:30.113036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510d232-48be-4f54-9df1-d4bf01db52e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:30.114792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510d232-48be-4f54-9df1-d4bf01db52e9 service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:30.134521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 533/1080] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:32.391919 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916a513-6422-4430-96f5-af3934c4778c None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:32.396862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916a513-6422-4430-96f5-af3934c4778c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:32.397142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916a513-6422-4430-96f5-af3934c4778c None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:32.399230 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 548/1081] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:06:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:32.404480 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffab3b5-9446-4dc3-840f-cf4c0ab80def None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:32.404938 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffab3b5-9446-4dc3-840f-cf4c0ab80def None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:32.405031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffab3b5-9446-4dc3-840f-cf4c0ab80def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:32.430343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:32.492606 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-3ffab3b5-9446-4dc3-840f-cf4c0ab80def None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:32.493905 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-3ffab3b5-9446-4dc3-840f-cf4c0ab80def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:32.621644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 534/1082] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:06:32.921461 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916a513-6422-4430-96f5-af3934c4778c None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:32.922960 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f916a513-6422-4430-96f5-af3934c4778c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:33.075134 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:33.086765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916a513-6422-4430-96f5-af3934c4778c None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:33.238036 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ff77b-a72f-488e-a8c5-b4c9c517de65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:33.238873 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ff77b-a72f-488e-a8c5-b4c9c517de65 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:33.239397 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ff77b-a72f-488e-a8c5-b4c9c517de65 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:33.239791 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ff77b-a72f-488e-a8c5-b4c9c517de65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:33.241695 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-068ff77b-a72f-488e-a8c5-b4c9c517de65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:33.387332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ff77b-a72f-488e-a8c5-b4c9c517de65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:33.387332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ff77b-a72f-488e-a8c5-b4c9c517de65 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:33.405540 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:33.415494 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 549/1083] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:35.705280 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834b255-bc2f-4b17-af3c-65d2fe0b5c32 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:35.705988 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834b255-bc2f-4b17-af3c-65d2fe0b5c32 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:35.705988 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834b255-bc2f-4b17-af3c-65d2fe0b5c32 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:35.707311 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 535/1084] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:06:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:35.712716 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588336f2-1271-4584-9e7a-dc7bf6ccb1b2 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:35.713151 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588336f2-1271-4584-9e7a-dc7bf6ccb1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:35.713257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588336f2-1271-4584-9e7a-dc7bf6ccb1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:35.785465 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-588336f2-1271-4584-9e7a-dc7bf6ccb1b2 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:35.786689 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-588336f2-1271-4584-9e7a-dc7bf6ccb1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:35.893430 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 550/1085] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:36.183753 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834b255-bc2f-4b17-af3c-65d2fe0b5c32 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:36.185246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f834b255-bc2f-4b17-af3c-65d2fe0b5c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:36.294572 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:36.362175 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834b255-bc2f-4b17-af3c-65d2fe0b5c32 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:36.496322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d0997-4ce6-49db-acfd-eb37a26998e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:36.497139 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d0997-4ce6-49db-acfd-eb37a26998e3 service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:36.497428 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d0997-4ce6-49db-acfd-eb37a26998e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:36.497700 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d0997-4ce6-49db-acfd-eb37a26998e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:36.499322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-228d0997-4ce6-49db-acfd-eb37a26998e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:36.580164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:36.613959 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d0997-4ce6-49db-acfd-eb37a26998e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:36.615598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d0997-4ce6-49db-acfd-eb37a26998e3 service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:36.635055 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 536/1086] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:45.891698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=67 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:46.632496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=20 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:49.658739 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d70cd-a76e-42c1-9b86-2d4e50251217 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:49.659297 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d70cd-a76e-42c1-9b86-2d4e50251217 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:49.659297 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d70cd-a76e-42c1-9b86-2d4e50251217 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:49.660653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 551/1087] 10.222.0.18 () {54 vars in 918 bytes} [Mon Oct 24 13:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:49.665921 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0ca60-5612-4a48-959a-18c2df002f5e None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:49.666353 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0ca60-5612-4a48-959a-18c2df002f5e None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:49.666464 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0ca60-5612-4a48-959a-18c2df002f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:49.741661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-93a0ca60-5612-4a48-959a-18c2df002f5e None None] MFA Rules not processed for user `60b3ca8694ab4a169a3c36561290d8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:49.742868 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-93a0ca60-5612-4a48-959a-18c2df002f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:49.852872 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 537/1088] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Oct 24 13:06:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:49.867496 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f3920-3faf-4a3b-bfe3-4d30a7deb726 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:49.867859 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f3920-3faf-4a3b-bfe3-4d30a7deb726 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:49.870245 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f3920-3faf-4a3b-bfe3-4d30a7deb726 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:49.871575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 552/1089] 10.222.0.18 () {54 vars in 918 bytes} [Mon Oct 24 13:06:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:49.877428 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328cd05-f6f9-4193-8520-921a40c10d46 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:49.877758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328cd05-f6f9-4193-8520-921a40c10d46 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:49.878033 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328cd05-f6f9-4193-8520-921a40c10d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:49.950129 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:49.953714 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-1328cd05-f6f9-4193-8520-921a40c10d46 None None] MFA Rules not processed for user `4f6b27c7d052437a949a371169fb48ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:49.956194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-1328cd05-f6f9-4193-8520-921a40c10d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:50.068572 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 538/1090] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Oct 24 13:06:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:52.625263 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca36ff-d986-47d0-a896-51611b1a28e0 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:52.625781 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca36ff-d986-47d0-a896-51611b1a28e0 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:52.625781 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca36ff-d986-47d0-a896-51611b1a28e0 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:52.627872 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 553/1091] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:06:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:52.633103 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995de5b7-bc13-4aef-b4ff-1629f3b456d8 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:52.633546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995de5b7-bc13-4aef-b4ff-1629f3b456d8 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:52.633684 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995de5b7-bc13-4aef-b4ff-1629f3b456d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:52.700399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-995de5b7-bc13-4aef-b4ff-1629f3b456d8 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:52.701599 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-995de5b7-bc13-4aef-b4ff-1629f3b456d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:52.756989 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:52.797874 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 539/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:53.090383 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca36ff-d986-47d0-a896-51611b1a28e0 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:53.091972 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-87ca36ff-d986-47d0-a896-51611b1a28e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:53.233232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca36ff-d986-47d0-a896-51611b1a28e0 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:53.305134 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:53.347246 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006eec25-ba04-4930-b577-84104a7b2223 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:53.347807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006eec25-ba04-4930-b577-84104a7b2223 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:53.348083 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006eec25-ba04-4930-b577-84104a7b2223 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:53.348351 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006eec25-ba04-4930-b577-84104a7b2223 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:53.349931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-006eec25-ba04-4930-b577-84104a7b2223 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:53.439540 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006eec25-ba04-4930-b577-84104a7b2223 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:53.441117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006eec25-ba04-4930-b577-84104a7b2223 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:53.458603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 554/1093] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:54.592555 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c87696-a182-439c-a88b-b35f3e7cf61b None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:54.593040 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c87696-a182-439c-a88b-b35f3e7cf61b None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:54.593040 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c87696-a182-439c-a88b-b35f3e7cf61b None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:54.594421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 540/1094] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:54.599756 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6c4a7-ea5c-45ee-b3ac-1ce5d5cb03f9 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:54.600195 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6c4a7-ea5c-45ee-b3ac-1ce5d5cb03f9 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:54.600302 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6c4a7-ea5c-45ee-b3ac-1ce5d5cb03f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:54.674626 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-dfc6c4a7-ea5c-45ee-b3ac-1ce5d5cb03f9 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:54.675838 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-dfc6c4a7-ea5c-45ee-b3ac-1ce5d5cb03f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:54.701574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:54.772038 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 555/1095] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:06:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:54.924637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c87696-a182-439c-a88b-b35f3e7cf61b None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:54.926077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-60c87696-a182-439c-a88b-b35f3e7cf61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:55.072242 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c87696-a182-439c-a88b-b35f3e7cf61b None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:55.112418 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:55.183238 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e477940-a646-42bd-803b-ffd1b090b6a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:55.183866 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e477940-a646-42bd-803b-ffd1b090b6a8 service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:55.184143 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e477940-a646-42bd-803b-ffd1b090b6a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:55.184407 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e477940-a646-42bd-803b-ffd1b090b6a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:55.185967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-8e477940-a646-42bd-803b-ffd1b090b6a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:55.274620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e477940-a646-42bd-803b-ffd1b090b6a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:55.276264 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e477940-a646-42bd-803b-ffd1b090b6a8 service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:55.293778 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 541/1096] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:56.419552 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853587e-3494-4f73-8a74-23d95469de5f None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:56.420115 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853587e-3494-4f73-8a74-23d95469de5f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:56.420115 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853587e-3494-4f73-8a74-23d95469de5f None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:56.421426 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 556/1097] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:56.426843 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed03b2-c918-433c-8c66-6e08b7f36d09 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:56.427225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed03b2-c918-433c-8c66-6e08b7f36d09 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:56.427386 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed03b2-c918-433c-8c66-6e08b7f36d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:56.482976 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:56.505446 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-c6ed03b2-c918-433c-8c66-6e08b7f36d09 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:56.506636 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-c6ed03b2-c918-433c-8c66-6e08b7f36d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:56.603408 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 542/1098] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:06:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:56.757166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853587e-3494-4f73-8a74-23d95469de5f None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:56.758647 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9853587e-3494-4f73-8a74-23d95469de5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:56.902164 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853587e-3494-4f73-8a74-23d95469de5f None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:56.913807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:57.014500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1ea26-0917-41a7-bf4a-03024dcaede6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:57.015109 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1ea26-0917-41a7-bf4a-03024dcaede6 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:57.015384 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1ea26-0917-41a7-bf4a-03024dcaede6 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:57.015688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1ea26-0917-41a7-bf4a-03024dcaede6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:57.017309 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-13e1ea26-0917-41a7-bf4a-03024dcaede6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:57.108178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1ea26-0917-41a7-bf4a-03024dcaede6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:57.109761 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1ea26-0917-41a7-bf4a-03024dcaede6 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:57.128916 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 557/1099] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:58.223520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a6cb3-e19c-4d72-b7be-62961a54c7a8 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:58.224114 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a6cb3-e19c-4d72-b7be-62961a54c7a8 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:58.224114 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a6cb3-e19c-4d72-b7be-62961a54c7a8 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:58.225399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 543/1100] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:58.230299 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a6605-5124-46dc-b831-4f7b5d85db5f None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:58.230716 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a6605-5124-46dc-b831-4f7b5d85db5f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:58.230824 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a6605-5124-46dc-b831-4f7b5d85db5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:58.250431 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:58.311181 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-613a6605-5124-46dc-b831-4f7b5d85db5f None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:58.312422 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-613a6605-5124-46dc-b831-4f7b5d85db5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:58.407752 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 558/1101] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:58.559115 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a6cb3-e19c-4d72-b7be-62961a54c7a8 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:58.560639 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-1c0a6cb3-e19c-4d72-b7be-62961a54c7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:58.673380 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:58.709459 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a6cb3-e19c-4d72-b7be-62961a54c7a8 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:58.819226 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a9946-5ac4-4514-a1a2-e50ee6766a2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:58.819764 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a9946-5ac4-4514-a1a2-e50ee6766a2e service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:58.820034 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a9946-5ac4-4514-a1a2-e50ee6766a2e service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:58.820297 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a9946-5ac4-4514-a1a2-e50ee6766a2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:58.821854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-a39a9946-5ac4-4514-a1a2-e50ee6766a2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:58.899406 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:58.913119 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a9946-5ac4-4514-a1a2-e50ee6766a2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:58.914727 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a9946-5ac4-4514-a1a2-e50ee6766a2e service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:58.932267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 544/1102] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:07:00.029659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d276d-5e98-4d6a-a4be-ea6ca109af58 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:00.030234 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d276d-5e98-4d6a-a4be-ea6ca109af58 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:00.030234 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d276d-5e98-4d6a-a4be-ea6ca109af58 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:00.031601 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 559/1103] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:07:00.037396 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a3465-64dd-4ef7-94ef-5dc4001350dd None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:00.037826 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a3465-64dd-4ef7-94ef-5dc4001350dd None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:00.037938 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a3465-64dd-4ef7-94ef-5dc4001350dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:00.112163 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-535a3465-64dd-4ef7-94ef-5dc4001350dd None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:00.113342 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-535a3465-64dd-4ef7-94ef-5dc4001350dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:00.213978 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 545/1104] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:07:00.365030 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d276d-5e98-4d6a-a4be-ea6ca109af58 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:07:00.366545 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-069d276d-5e98-4d6a-a4be-ea6ca109af58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:00.450046 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:00.511472 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d276d-5e98-4d6a-a4be-ea6ca109af58 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:07:00.625338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62824d57-1812-4d64-8f1f-baec139bc501 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:07:00.625882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62824d57-1812-4d64-8f1f-baec139bc501 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:00.626155 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62824d57-1812-4d64-8f1f-baec139bc501 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:00.626416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62824d57-1812-4d64-8f1f-baec139bc501 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:00.628578 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-62824d57-1812-4d64-8f1f-baec139bc501 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:00.676070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:00.719058 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62824d57-1812-4d64-8f1f-baec139bc501 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:07:00.720815 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62824d57-1812-4d64-8f1f-baec139bc501 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:07:00.739263 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 560/1105] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:07:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:07:01.782072 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e57871-1dbf-4217-9b06-4f35c3d66a4a None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:01.782663 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e57871-1dbf-4217-9b06-4f35c3d66a4a None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:01.782663 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e57871-1dbf-4217-9b06-4f35c3d66a4a None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:01.784825 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 546/1106] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:07:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:07:01.789887 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ee332-c19e-4798-b755-f77798155d18 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:01.790319 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ee332-c19e-4798-b755-f77798155d18 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:01.790469 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ee332-c19e-4798-b755-f77798155d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:01.869518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-a34ee332-c19e-4798-b755-f77798155d18 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:01.870718 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a34ee332-c19e-4798-b755-f77798155d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:01.971155 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 561/1107] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:07:02.123824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e57871-1dbf-4217-9b06-4f35c3d66a4a None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:07:02.125242 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-27e57871-1dbf-4217-9b06-4f35c3d66a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:02.173514 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:02.272395 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e57871-1dbf-4217-9b06-4f35c3d66a4a None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:07:02.386533 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53144b78-86e2-491c-959a-8786f08750ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:07:02.387061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53144b78-86e2-491c-959a-8786f08750ab service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:02.387339 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53144b78-86e2-491c-959a-8786f08750ab service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:02.387713 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53144b78-86e2-491c-959a-8786f08750ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:02.389287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-53144b78-86e2-491c-959a-8786f08750ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:02.396201 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:02.482352 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53144b78-86e2-491c-959a-8786f08750ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:07:02.484026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53144b78-86e2-491c-959a-8786f08750ab service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:07:02.502331 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 547/1108] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:07:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:07:03.559839 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c68e4a-d8c6-47e9-a743-4629fbc1dd67 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:03.560338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c68e4a-d8c6-47e9-a743-4629fbc1dd67 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:03.560527 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c68e4a-d8c6-47e9-a743-4629fbc1dd67 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:03.561860 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 562/1109] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:07:03.567034 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90c7e5-106c-4daf-a29f-d85a59656b73 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:03.567482 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90c7e5-106c-4daf-a29f-d85a59656b73 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:03.567629 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90c7e5-106c-4daf-a29f-d85a59656b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:03.643699 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-6e90c7e5-106c-4daf-a29f-d85a59656b73 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:03.644892 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-6e90c7e5-106c-4daf-a29f-d85a59656b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:03.713706 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:03.743186 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 548/1110] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:07:03.892993 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c68e4a-d8c6-47e9-a743-4629fbc1dd67 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:07:03.894430 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a7c68e4a-d8c6-47e9-a743-4629fbc1dd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:03.911835 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:04.037342 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c68e4a-d8c6-47e9-a743-4629fbc1dd67 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:07:04.123382 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:04.150149 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c947736-4885-40d5-b576-4b2ea6986055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:07:04.150678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c947736-4885-40d5-b576-4b2ea6986055 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:04.150952 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c947736-4885-40d5-b576-4b2ea6986055 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:04.151221 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c947736-4885-40d5-b576-4b2ea6986055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:04.152821 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1c947736-4885-40d5-b576-4b2ea6986055 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:04.238847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c947736-4885-40d5-b576-4b2ea6986055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:07:04.240460 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c947736-4885-40d5-b576-4b2ea6986055 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:07:04.258602 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 563/1111] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:07:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:07:05.304367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48844881-687a-42a7-902b-2646f8c29b08 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:05.304974 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48844881-687a-42a7-902b-2646f8c29b08 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:05.304974 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48844881-687a-42a7-902b-2646f8c29b08 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:05.306243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 549/1112] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:07:05.311071 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de16ef-29d2-4baa-8ad9-9be0ab3367ba None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:05.311527 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de16ef-29d2-4baa-8ad9-9be0ab3367ba None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:05.311635 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de16ef-29d2-4baa-8ad9-9be0ab3367ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:05.387924 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-e4de16ef-29d2-4baa-8ad9-9be0ab3367ba None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:05.389106 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e4de16ef-29d2-4baa-8ad9-9be0ab3367ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:05.429136 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:05.482634 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 564/1113] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:07:05.637190 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48844881-687a-42a7-902b-2646f8c29b08 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:07:05.638871 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-48844881-687a-42a7-902b-2646f8c29b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:05.781714 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48844881-687a-42a7-902b-2646f8c29b08 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:07:05.836050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:05.895202 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787b7cc-684d-4648-9e22-100a9f924732 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:07:05.895753 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787b7cc-684d-4648-9e22-100a9f924732 service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:05.896032 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787b7cc-684d-4648-9e22-100a9f924732 service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:05.896304 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787b7cc-684d-4648-9e22-100a9f924732 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:05.897880 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f787b7cc-684d-4648-9e22-100a9f924732 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:05.986867 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787b7cc-684d-4648-9e22-100a9f924732 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:07:05.988495 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787b7cc-684d-4648-9e22-100a9f924732 service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:07:06.006475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 550/1114] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:07:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:07:07.058017 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74785c89-e8fa-44d0-adb0-739d53fe8c5e None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:07.058655 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74785c89-e8fa-44d0-adb0-739d53fe8c5e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:07.058655 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74785c89-e8fa-44d0-adb0-739d53fe8c5e None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:07.059954 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 565/1115] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:07:07.065323 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5931c-5cec-4cba-b8c3-8be18f64abf6 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:07.065756 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5931c-5cec-4cba-b8c3-8be18f64abf6 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:07.065941 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5931c-5cec-4cba-b8c3-8be18f64abf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:07.141314 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-d8c5931c-5cec-4cba-b8c3-8be18f64abf6 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:07.143134 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d8c5931c-5cec-4cba-b8c3-8be18f64abf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:07.145263 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:07.237799 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 551/1116] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:07:07.386977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74785c89-e8fa-44d0-adb0-739d53fe8c5e None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:07:07.388525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-74785c89-e8fa-44d0-adb0-739d53fe8c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:07.532146 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74785c89-e8fa-44d0-adb0-739d53fe8c5e None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:07:07.562575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:07.650889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1ce7f-f4ed-4413-b043-0972a4fea1d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:07:07.651392 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1ce7f-f4ed-4413-b043-0972a4fea1d2 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:07.651697 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1ce7f-f4ed-4413-b043-0972a4fea1d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:07.651964 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1ce7f-f4ed-4413-b043-0972a4fea1d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:07.653543 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-22c1ce7f-f4ed-4413-b043-0972a4fea1d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:07.741411 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1ce7f-f4ed-4413-b043-0972a4fea1d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:07:07.743002 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1ce7f-f4ed-4413-b043-0972a4fea1d2 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:07:07.761353 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 566/1117] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:07:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:07:09.807794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87116806-0e17-4117-80c8-94479b579db9 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:09.808321 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87116806-0e17-4117-80c8-94479b579db9 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:09.808321 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87116806-0e17-4117-80c8-94479b579db9 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:09.809569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 552/1118] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:07:09.814984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad93fc2-a4b9-476f-b41f-58217be6e31d None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:09.815381 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad93fc2-a4b9-476f-b41f-58217be6e31d None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:09.815563 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad93fc2-a4b9-476f-b41f-58217be6e31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:09.860205 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:09.886299 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-aad93fc2-a4b9-476f-b41f-58217be6e31d None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:09.887535 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-aad93fc2-a4b9-476f-b41f-58217be6e31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:09.987885 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 567/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:07:10.270631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87116806-0e17-4117-80c8-94479b579db9 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:07:10.272232 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-87116806-0e17-4117-80c8-94479b579db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:10.375727 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87116806-0e17-4117-80c8-94479b579db9 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:07:10.410432 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:10.452245 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a56018-74c7-46bb-9225-a778439a95d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:07:10.452849 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a56018-74c7-46bb-9225-a778439a95d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:10.453127 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a56018-74c7-46bb-9225-a778439a95d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:10.453642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a56018-74c7-46bb-9225-a778439a95d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:10.455247 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-15a56018-74c7-46bb-9225-a778439a95d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:10.565488 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a56018-74c7-46bb-9225-a778439a95d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:07:10.566943 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a56018-74c7-46bb-9225-a778439a95d6 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:07:10.584916 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 553/1120] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:07:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:07:12.896580 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289592a4-bd42-4913-a7c5-bd21d95063bc None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:12.897146 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289592a4-bd42-4913-a7c5-bd21d95063bc None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:12.897146 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289592a4-bd42-4913-a7c5-bd21d95063bc None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:12.898445 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 568/1121] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:07:12.903716 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955d0b7-4ff6-46e1-88f3-1d8271e7d73c None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:12.904156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955d0b7-4ff6-46e1-88f3-1d8271e7d73c None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:12.904260 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955d0b7-4ff6-46e1-88f3-1d8271e7d73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:12.972686 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-5955d0b7-4ff6-46e1-88f3-1d8271e7d73c None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:12.973880 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-5955d0b7-4ff6-46e1-88f3-1d8271e7d73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:12.987112 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:13.072673 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 554/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:07:13.355099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289592a4-bd42-4913-a7c5-bd21d95063bc None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:07:13.356675 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-289592a4-bd42-4913-a7c5-bd21d95063bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:13.460252 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289592a4-bd42-4913-a7c5-bd21d95063bc None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:07:13.473806 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:13.533285 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262c2b5-f849-43dd-b75a-2a874928c2d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:07:13.533902 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262c2b5-f849-43dd-b75a-2a874928c2d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:13.534199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262c2b5-f849-43dd-b75a-2a874928c2d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:13.534466 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262c2b5-f849-43dd-b75a-2a874928c2d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:13.536058 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7262c2b5-f849-43dd-b75a-2a874928c2d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:13.644683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262c2b5-f849-43dd-b75a-2a874928c2d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:07:13.646045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262c2b5-f849-43dd-b75a-2a874928c2d7 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:07:13.664007 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 569/1123] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:07:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:07:16.143655 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199eafbe-db3e-4a11-8934-3dc636da312b None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:16.144200 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199eafbe-db3e-4a11-8934-3dc636da312b None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:16.144200 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199eafbe-db3e-4a11-8934-3dc636da312b None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:16.145539 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 555/1124] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:07:16.150998 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef215081-5cd7-48e0-a624-84d05c08b5da None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:16.151515 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef215081-5cd7-48e0-a624-84d05c08b5da None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:16.151619 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef215081-5cd7-48e0-a624-84d05c08b5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:16.199054 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:16.217344 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-ef215081-5cd7-48e0-a624-84d05c08b5da None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:16.218545 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ef215081-5cd7-48e0-a624-84d05c08b5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:16.314305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 570/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:07:16.597740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199eafbe-db3e-4a11-8934-3dc636da312b None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:07:16.599312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-199eafbe-db3e-4a11-8934-3dc636da312b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:16.702281 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199eafbe-db3e-4a11-8934-3dc636da312b None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:07:16.743226 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:16.777846 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac0634-68d4-4a04-9b3a-6c70e988af67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:07:16.778419 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac0634-68d4-4a04-9b3a-6c70e988af67 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:16.778691 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac0634-68d4-4a04-9b3a-6c70e988af67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:16.778953 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac0634-68d4-4a04-9b3a-6c70e988af67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:16.780546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d7ac0634-68d4-4a04-9b3a-6c70e988af67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:16.888624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac0634-68d4-4a04-9b3a-6c70e988af67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:07:16.889987 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac0634-68d4-4a04-9b3a-6c70e988af67 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:07:16.907953 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 556/1126] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:07:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:07:19.213168 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d2f64-91d6-4305-a97e-603df77242ce None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:19.213742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d2f64-91d6-4305-a97e-603df77242ce None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:19.213884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d2f64-91d6-4305-a97e-603df77242ce None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:19.215202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 571/1127] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:07:19.221165 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3df96-a17d-4da5-9d27-5f785969d32b None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:19.221663 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3df96-a17d-4da5-9d27-5f785969d32b None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:19.221770 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3df96-a17d-4da5-9d27-5f785969d32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:19.289614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-71d3df96-a17d-4da5-9d27-5f785969d32b None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:19.290810 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-71d3df96-a17d-4da5-9d27-5f785969d32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:19.311178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:19.387964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 557/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:07:19.679521 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d2f64-91d6-4305-a97e-603df77242ce None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:07:19.681085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-376d2f64-91d6-4305-a97e-603df77242ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:19.782555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d2f64-91d6-4305-a97e-603df77242ce None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:07:19.804402 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:19.859340 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f446ce-c61a-48ed-a435-b6da76eead5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:07:19.859970 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f446ce-c61a-48ed-a435-b6da76eead5c service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:19.860245 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f446ce-c61a-48ed-a435-b6da76eead5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:19.860514 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f446ce-c61a-48ed-a435-b6da76eead5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:19.862691 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-12f446ce-c61a-48ed-a435-b6da76eead5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:19.969729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f446ce-c61a-48ed-a435-b6da76eead5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:07:19.971761 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f446ce-c61a-48ed-a435-b6da76eead5c service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:07:19.989966 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 572/1129] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:07:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:07:22.192082 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c99193-1260-4a0f-8e76-d2e8a44d05a5 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:22.192707 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c99193-1260-4a0f-8e76-d2e8a44d05a5 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:22.192707 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c99193-1260-4a0f-8e76-d2e8a44d05a5 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:22.193973 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 558/1130] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:07:22.199309 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c407e9-b016-42fc-bb28-9a6e95ec7264 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:22.199765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c407e9-b016-42fc-bb28-9a6e95ec7264 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:22.199871 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c407e9-b016-42fc-bb28-9a6e95ec7264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:22.263740 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:22.266574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-03c407e9-b016-42fc-bb28-9a6e95ec7264 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:22.268765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-03c407e9-b016-42fc-bb28-9a6e95ec7264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:22.362594 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 573/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:07:22.647787 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c99193-1260-4a0f-8e76-d2e8a44d05a5 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:07:22.649283 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-99c99193-1260-4a0f-8e76-d2e8a44d05a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:22.753130 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c99193-1260-4a0f-8e76-d2e8a44d05a5 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:07:22.801799 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:22.825449 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a024c8-084e-41f2-9df4-588c4e3aaa84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:07:22.826053 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a024c8-084e-41f2-9df4-588c4e3aaa84 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:22.826330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a024c8-084e-41f2-9df4-588c4e3aaa84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:22.826601 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a024c8-084e-41f2-9df4-588c4e3aaa84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:22.828207 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-87a024c8-084e-41f2-9df4-588c4e3aaa84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:22.937003 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a024c8-084e-41f2-9df4-588c4e3aaa84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:07:22.938429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a024c8-084e-41f2-9df4-588c4e3aaa84 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:07:22.957145 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 559/1132] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:07:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:07:25.142526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16894c70-2a04-4ec1-88b0-eb88d0c557b0 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:25.143652 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16894c70-2a04-4ec1-88b0-eb88d0c557b0 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:25.143750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16894c70-2a04-4ec1-88b0-eb88d0c557b0 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:25.145016 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 574/1133] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:07:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:07:25.150408 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de12738-2216-467b-a573-aedeee1ef002 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:25.150878 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de12738-2216-467b-a573-aedeee1ef002 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:25.150977 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de12738-2216-467b-a573-aedeee1ef002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:25.216317 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-9de12738-2216-467b-a573-aedeee1ef002 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:25.217493 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-9de12738-2216-467b-a573-aedeee1ef002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:25.245754 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:25.312720 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 560/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:07:25.597310 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16894c70-2a04-4ec1-88b0-eb88d0c557b0 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:07:25.598941 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-16894c70-2a04-4ec1-88b0-eb88d0c557b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:25.701229 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16894c70-2a04-4ec1-88b0-eb88d0c557b0 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:07:25.729986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:25.775122 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58cd51-6ecb-411c-a42a-ec70eecb3cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:07:25.775791 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58cd51-6ecb-411c-a42a-ec70eecb3cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:25.776066 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58cd51-6ecb-411c-a42a-ec70eecb3cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:25.776333 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58cd51-6ecb-411c-a42a-ec70eecb3cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:25.777883 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3c58cd51-6ecb-411c-a42a-ec70eecb3cd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:25.886162 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58cd51-6ecb-411c-a42a-ec70eecb3cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:07:25.887540 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58cd51-6ecb-411c-a42a-ec70eecb3cd2 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:07:25.905433 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 575/1135] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:07:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:07:28.106151 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde8426-0ea5-42af-8525-661651db092b None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:28.106740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde8426-0ea5-42af-8525-661651db092b None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:28.106740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde8426-0ea5-42af-8525-661651db092b None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:28.108070 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 561/1136] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:07:28.113527 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb6305-c4ac-4743-967f-38bb2832a850 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:28.113953 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb6305-c4ac-4743-967f-38bb2832a850 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:28.114056 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb6305-c4ac-4743-967f-38bb2832a850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:28.179275 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-17bb6305-c4ac-4743-967f-38bb2832a850 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:28.180531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-17bb6305-c4ac-4743-967f-38bb2832a850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:28.188733 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:28.276591 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 576/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:07:28.559387 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde8426-0ea5-42af-8525-661651db092b None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:07:28.560928 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-fdde8426-0ea5-42af-8525-661651db092b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:28.665598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde8426-0ea5-42af-8525-661651db092b None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:07:28.720505 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:28.739739 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7f047-bb58-4cd3-8ca6-500a6f24126b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:07:28.740342 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7f047-bb58-4cd3-8ca6-500a6f24126b service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:28.740622 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7f047-bb58-4cd3-8ca6-500a6f24126b service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:28.740890 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7f047-bb58-4cd3-8ca6-500a6f24126b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:28.742455 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b3e7f047-bb58-4cd3-8ca6-500a6f24126b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:28.849760 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7f047-bb58-4cd3-8ca6-500a6f24126b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:07:28.851200 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7f047-bb58-4cd3-8ca6-500a6f24126b service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:07:28.869872 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 562/1138] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:07:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:07:31.098405 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011444f-9d87-48d2-9503-28cdf1ab69ab None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:31.099077 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011444f-9d87-48d2-9503-28cdf1ab69ab None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:31.099077 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011444f-9d87-48d2-9503-28cdf1ab69ab None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:31.100321 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 577/1139] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:07:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:07:31.105602 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3382e4-875f-4432-b808-41841dbbce3d None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:31.106048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3382e4-875f-4432-b808-41841dbbce3d None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:31.106164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3382e4-875f-4432-b808-41841dbbce3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:31.172252 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-2f3382e4-875f-4432-b808-41841dbbce3d None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:31.173449 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-2f3382e4-875f-4432-b808-41841dbbce3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:31.211671 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:31.270948 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 563/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:07:31.559512 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011444f-9d87-48d2-9503-28cdf1ab69ab None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:07:31.561051 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0011444f-9d87-48d2-9503-28cdf1ab69ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:31.665057 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011444f-9d87-48d2-9503-28cdf1ab69ab None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:07:31.702386 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:31.738673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0781b1d-e8df-4ae5-9e18-6756b39b3303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:07:31.739271 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0781b1d-e8df-4ae5-9e18-6756b39b3303 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:31.739578 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0781b1d-e8df-4ae5-9e18-6756b39b3303 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:31.739851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0781b1d-e8df-4ae5-9e18-6756b39b3303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:31.741432 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c0781b1d-e8df-4ae5-9e18-6756b39b3303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:31.849545 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0781b1d-e8df-4ae5-9e18-6756b39b3303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:07:31.850970 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0781b1d-e8df-4ae5-9e18-6756b39b3303 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:07:31.868539 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 578/1141] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:07:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:07:34.094083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e048c18-dbec-427d-84d9-4c7f3ac7e6cb None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:34.094671 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e048c18-dbec-427d-84d9-4c7f3ac7e6cb None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:34.094671 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e048c18-dbec-427d-84d9-4c7f3ac7e6cb None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:34.096252 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 564/1142] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:07:34.101788 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2df18-036d-487d-94e0-d4c1ef45df06 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:34.102237 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2df18-036d-487d-94e0-d4c1ef45df06 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:34.102358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2df18-036d-487d-94e0-d4c1ef45df06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:34.166599 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-5cf2df18-036d-487d-94e0-d4c1ef45df06 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:34.167832 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5cf2df18-036d-487d-94e0-d4c1ef45df06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:34.184982 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:34.264084 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 579/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:07:34.544529 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e048c18-dbec-427d-84d9-4c7f3ac7e6cb None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:07:34.546060 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-1e048c18-dbec-427d-84d9-4c7f3ac7e6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:34.649702 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e048c18-dbec-427d-84d9-4c7f3ac7e6cb None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:07:34.717377 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:34.724642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08aa7ad-844c-4ea5-a4e1-9c78649d85fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:07:34.725246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08aa7ad-844c-4ea5-a4e1-9c78649d85fd service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:34.725525 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08aa7ad-844c-4ea5-a4e1-9c78649d85fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:34.725797 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08aa7ad-844c-4ea5-a4e1-9c78649d85fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:34.727373 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-c08aa7ad-844c-4ea5-a4e1-9c78649d85fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:34.836122 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08aa7ad-844c-4ea5-a4e1-9c78649d85fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:07:34.837578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08aa7ad-844c-4ea5-a4e1-9c78649d85fd service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:07:34.855284 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 565/1144] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:07:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:07:37.025422 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389387c0-8e3c-4e1e-99b8-3318231d6c59 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:37.025997 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389387c0-8e3c-4e1e-99b8-3318231d6c59 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:37.025997 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389387c0-8e3c-4e1e-99b8-3318231d6c59 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:37.027283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 580/1145] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:07:37.032499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10790872-59a5-4292-a816-1c8379b7438b None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:37.032941 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10790872-59a5-4292-a816-1c8379b7438b None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:37.033045 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10790872-59a5-4292-a816-1c8379b7438b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:37.099884 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-10790872-59a5-4292-a816-1c8379b7438b None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:37.101085 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-10790872-59a5-4292-a816-1c8379b7438b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:37.149122 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:37.198369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 566/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:07:37.482117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389387c0-8e3c-4e1e-99b8-3318231d6c59 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:07:37.483726 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-389387c0-8e3c-4e1e-99b8-3318231d6c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:37.586871 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389387c0-8e3c-4e1e-99b8-3318231d6c59 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:07:37.634320 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:37.659825 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72781fc-576b-4e06-bde8-3348b3732de9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:07:37.660427 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72781fc-576b-4e06-bde8-3348b3732de9 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:37.660723 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72781fc-576b-4e06-bde8-3348b3732de9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:37.660984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72781fc-576b-4e06-bde8-3348b3732de9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:37.662539 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f72781fc-576b-4e06-bde8-3348b3732de9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:37.769119 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72781fc-576b-4e06-bde8-3348b3732de9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:07:37.770466 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72781fc-576b-4e06-bde8-3348b3732de9 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:07:37.787909 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 581/1147] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:07:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:07:47.196821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=22 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:47.785671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=66 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:57.836974 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c2515-dc2f-494b-977d-cbc340e96fa9 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:57.837542 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c2515-dc2f-494b-977d-cbc340e96fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:57.837542 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c2515-dc2f-494b-977d-cbc340e96fa9 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:57.838761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 567/1148] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:07:57.844170 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543afcc2-6d9f-4db9-824e-4d82c7dc0f4e None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:57.844573 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543afcc2-6d9f-4db9-824e-4d82c7dc0f4e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:57.844714 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543afcc2-6d9f-4db9-824e-4d82c7dc0f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:57.912209 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-543afcc2-6d9f-4db9-824e-4d82c7dc0f4e None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:57.913386 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-543afcc2-6d9f-4db9-824e-4d82c7dc0f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:58.006263 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 582/1149] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:07:58.303751 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1991fab-5bc8-474b-848f-f773f2059037 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:58.304029 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1991fab-5bc8-474b-848f-f773f2059037 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:58.304298 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1991fab-5bc8-474b-848f-f773f2059037 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:58.305906 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 568/1150] 10.222.0.18 () {54 vars in 962 bytes} [Mon Oct 24 13:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:07:58.310812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ea8e2-9834-4249-b704-06281ac0397c None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:58.311105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ea8e2-9834-4249-b704-06281ac0397c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:58.311384 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ea8e2-9834-4249-b704-06281ac0397c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:58.387518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-644ea8e2-9834-4249-b704-06281ac0397c None None] MFA Rules not processed for user `dd0866de4d4e46d5b26719faf385d7a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:58.388635 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-644ea8e2-9834-4249-b704-06281ac0397c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:58.408352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:58.465913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 583/1151] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Oct 24 13:07:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:07:58.474143 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1991fab-5bc8-474b-848f-f773f2059037 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:07:58.475669 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d1991fab-5bc8-474b-848f-f773f2059037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:58.578571 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1991fab-5bc8-474b-848f-f773f2059037 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:07:58.652585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc0ad2-505f-4fa4-908e-4265ea936f4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0866de4d4e46d5b26719faf385d7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:07:58.653178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc0ad2-505f-4fa4-908e-4265ea936f4a service glance] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:58.653448 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc0ad2-505f-4fa4-908e-4265ea936f4a service glance] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:58.653712 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc0ad2-505f-4fa4-908e-4265ea936f4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:58.655256 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-0ccc0ad2-505f-4fa4-908e-4265ea936f4a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:58.708505 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:58.763014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc0ad2-505f-4fa4-908e-4265ea936f4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:07:58.764535 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc0ad2-505f-4fa4-908e-4265ea936f4a service glance] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:07:58.782766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 569/1152] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:07:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:08:01.028845 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3e6ae-fc8e-4e07-89c7-e3da9f42ffd4 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:01.029373 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3e6ae-fc8e-4e07-89c7-e3da9f42ffd4 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:01.029373 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3e6ae-fc8e-4e07-89c7-e3da9f42ffd4 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:01.030670 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 584/1153] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:08:01.036781 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae4204-ee91-434d-901d-1d86ce1b723b None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:01.037185 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae4204-ee91-434d-901d-1d86ce1b723b None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:01.037331 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae4204-ee91-434d-901d-1d86ce1b723b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:01.103439 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-d4ae4204-ee91-434d-901d-1d86ce1b723b None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:08:01.104659 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d4ae4204-ee91-434d-901d-1d86ce1b723b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:01.201230 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 570/1154] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:08:01.477375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3e6ae-fc8e-4e07-89c7-e3da9f42ffd4 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:08:01.478909 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-fbe3e6ae-fc8e-4e07-89c7-e3da9f42ffd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:01.607359 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3e6ae-fc8e-4e07-89c7-e3da9f42ffd4 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:08:01.657964 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:08:01.702436 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915201cd-301f-449c-b5c0-999b1f8dcb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:08:01.703030 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915201cd-301f-449c-b5c0-999b1f8dcb3a admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:01.703303 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915201cd-301f-449c-b5c0-999b1f8dcb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:01.703598 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915201cd-301f-449c-b5c0-999b1f8dcb3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:01.704224 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915201cd-301f-449c-b5c0-999b1f8dcb3a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:08:01.705228 dv-cinder-862491-1-smb devstack@keystone.service[81601]: WARNING py.warnings [None req-915201cd-301f-449c-b5c0-999b1f8dcb3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:08:01.705228 dv-cinder-862491-1-smb devstack@keystone.service[81601]: warnings.warn(msg) Oct 24 13:08:01.705228 dv-cinder-862491-1-smb devstack@keystone.service[81601]: Oct 24 13:08:01.707201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915201cd-301f-449c-b5c0-999b1f8dcb3a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:08:01.725567 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 585/1155] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 24 13:08:01 2022] GET /identity/v3/projects => generated 2553 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:08:03.916980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67e722-cac9-45c3-862e-bd1bb4e24460 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:03.917519 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67e722-cac9-45c3-862e-bd1bb4e24460 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:03.917519 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67e722-cac9-45c3-862e-bd1bb4e24460 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:03.918786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 571/1156] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:08:03.924111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025e342-f742-455e-b854-597a67c91258 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:03.925100 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025e342-f742-455e-b854-597a67c91258 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:03.925373 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025e342-f742-455e-b854-597a67c91258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:03.991753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-f025e342-f742-455e-b854-597a67c91258 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:08:03.992948 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f025e342-f742-455e-b854-597a67c91258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:04.088712 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 586/1157] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:08:04.386065 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67e722-cac9-45c3-862e-bd1bb4e24460 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:08:04.387613 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-3a67e722-cac9-45c3-862e-bd1bb4e24460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:04.397932 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:08:04.530797 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67e722-cac9-45c3-862e-bd1bb4e24460 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:08:04.611280 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:08:04.646167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71616ed-735d-4104-840b-3782f386b68f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:08:04.647048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71616ed-735d-4104-840b-3782f386b68f service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:04.647554 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71616ed-735d-4104-840b-3782f386b68f service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:04.647982 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71616ed-735d-4104-840b-3782f386b68f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:04.650646 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-e71616ed-735d-4104-840b-3782f386b68f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:04.740106 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71616ed-735d-4104-840b-3782f386b68f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:08:04.741691 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71616ed-735d-4104-840b-3782f386b68f service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:08:04.759666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 572/1158] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:08:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:08:07.110002 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a8782-e066-4aef-95f7-500fad1bf352 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:07.110621 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a8782-e066-4aef-95f7-500fad1bf352 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:07.110621 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a8782-e066-4aef-95f7-500fad1bf352 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:07.111989 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 587/1159] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:08:07.117953 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f93b5d-5fb1-4c1a-bb96-3c630e317d2a None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:07.118400 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f93b5d-5fb1-4c1a-bb96-3c630e317d2a None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:07.118505 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f93b5d-5fb1-4c1a-bb96-3c630e317d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:07.184260 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-21f93b5d-5fb1-4c1a-bb96-3c630e317d2a None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:08:07.185451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-21f93b5d-5fb1-4c1a-bb96-3c630e317d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:07.231696 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:08:07.282683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 573/1160] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:08:07.578764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a8782-e066-4aef-95f7-500fad1bf352 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:08:07.580308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9b1a8782-e066-4aef-95f7-500fad1bf352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:07.603514 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:08:07.682598 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a8782-e066-4aef-95f7-500fad1bf352 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:08:07.755805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80dc8de-690b-4199-a95f-8c9742bc5df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:08:07.756420 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dc8de-690b-4199-a95f-8c9742bc5df8 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:07.756698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dc8de-690b-4199-a95f-8c9742bc5df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:07.756966 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dc8de-690b-4199-a95f-8c9742bc5df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:07.758550 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b80dc8de-690b-4199-a95f-8c9742bc5df8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:07.838802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:08:07.875229 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80dc8de-690b-4199-a95f-8c9742bc5df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:08:07.876689 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80dc8de-690b-4199-a95f-8c9742bc5df8 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:08:07.895472 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 588/1161] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:08:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:08:10.113169 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da37370-ed18-460d-bd10-a39beb855336 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:10.113768 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da37370-ed18-460d-bd10-a39beb855336 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:10.113768 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da37370-ed18-460d-bd10-a39beb855336 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:10.115114 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 574/1162] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:08:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:08:10.120661 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44077d77-4d03-4855-999b-12d7ee5f946b None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:10.121084 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44077d77-4d03-4855-999b-12d7ee5f946b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:10.121211 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44077d77-4d03-4855-999b-12d7ee5f946b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:10.186016 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-44077d77-4d03-4855-999b-12d7ee5f946b None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:08:10.187238 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-44077d77-4d03-4855-999b-12d7ee5f946b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:10.282610 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 589/1163] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:08:10.570470 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da37370-ed18-460d-bd10-a39beb855336 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:08:10.571990 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-0da37370-ed18-460d-bd10-a39beb855336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:10.675791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da37370-ed18-460d-bd10-a39beb855336 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:08:10.747582 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:08:10.749038 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f185179-5e18-44bc-b4a5-1c965e98d7c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:08:10.749837 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f185179-5e18-44bc-b4a5-1c965e98d7c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:10.750283 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f185179-5e18-44bc-b4a5-1c965e98d7c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:10.750597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f185179-5e18-44bc-b4a5-1c965e98d7c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:10.753140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-0f185179-5e18-44bc-b4a5-1c965e98d7c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:10.860208 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f185179-5e18-44bc-b4a5-1c965e98d7c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:08:10.861639 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f185179-5e18-44bc-b4a5-1c965e98d7c7 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:08:10.879531 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 575/1164] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:08:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:08:13.227290 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0325fca-e7ab-4b17-8939-1187c922a7e5 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:13.227852 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0325fca-e7ab-4b17-8939-1187c922a7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:13.227852 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0325fca-e7ab-4b17-8939-1187c922a7e5 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:13.229207 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 590/1165] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:08:13.234557 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fd011-6ce4-4105-a4ca-5d2abc6fe975 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:13.235019 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fd011-6ce4-4105-a4ca-5d2abc6fe975 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:13.235124 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fd011-6ce4-4105-a4ca-5d2abc6fe975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:13.300330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-224fd011-6ce4-4105-a4ca-5d2abc6fe975 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:08:13.301510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-224fd011-6ce4-4105-a4ca-5d2abc6fe975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:13.352938 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:08:13.396199 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 576/1166] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:08:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:08:13.691779 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0325fca-e7ab-4b17-8939-1187c922a7e5 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:08:13.693301 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d0325fca-e7ab-4b17-8939-1187c922a7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:13.728918 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:08:13.795966 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0325fca-e7ab-4b17-8939-1187c922a7e5 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:08:13.870315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431ef74-017f-4c30-8374-c9a17dbf54b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:08:13.870910 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431ef74-017f-4c30-8374-c9a17dbf54b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:13.871188 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431ef74-017f-4c30-8374-c9a17dbf54b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:13.871482 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431ef74-017f-4c30-8374-c9a17dbf54b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:13.873054 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a431ef74-017f-4c30-8374-c9a17dbf54b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:13.952272 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:08:13.981376 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431ef74-017f-4c30-8374-c9a17dbf54b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:08:13.982794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431ef74-017f-4c30-8374-c9a17dbf54b3 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:08:14.000978 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 591/1167] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:08:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:08:16.322045 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e9c43-77cc-451f-b761-70ec4a441620 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:16.322668 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e9c43-77cc-451f-b761-70ec4a441620 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:16.322668 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e9c43-77cc-451f-b761-70ec4a441620 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:16.324009 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 577/1168] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 24 13:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:08:16.329172 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ca497-b9c7-4789-b210-0e5c46005287 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:16.329624 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ca497-b9c7-4789-b210-0e5c46005287 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:16.329729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ca497-b9c7-4789-b210-0e5c46005287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:16.401031 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-a21ca497-b9c7-4789-b210-0e5c46005287 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:08:16.402251 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a21ca497-b9c7-4789-b210-0e5c46005287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:16.496728 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 592/1169] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 24 13:08:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:08:16.787831 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e9c43-77cc-451f-b761-70ec4a441620 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:08:16.789332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-085e9c43-77cc-451f-b761-70ec4a441620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:16.891708 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e9c43-77cc-451f-b761-70ec4a441620 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:08:16.964579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a7109-cc61-421d-a856-70e82aa05667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:08:16.965174 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a7109-cc61-421d-a856-70e82aa05667 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:16.965455 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a7109-cc61-421d-a856-70e82aa05667 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:16.965729 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a7109-cc61-421d-a856-70e82aa05667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:16.967289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-295a7109-cc61-421d-a856-70e82aa05667 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:16.976304 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:08:17.083354 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a7109-cc61-421d-a856-70e82aa05667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:08:17.084744 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a7109-cc61-421d-a856-70e82aa05667 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:08:17.102758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 578/1170] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:08:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:08:26.495231 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=82 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:08:27.100682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=50 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:09:30.494693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17149792-acb1-4d93-b5c6-173d45856e9c None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:09:30.495225 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17149792-acb1-4d93-b5c6-173d45856e9c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:09:30.495225 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17149792-acb1-4d93-b5c6-173d45856e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:09:30.573370 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-17149792-acb1-4d93-b5c6-173d45856e9c None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:09:30.574587 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-17149792-acb1-4d93-b5c6-173d45856e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:09:30.670033 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 593/1171] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:09:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:09:30.678813 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1b1a3-871e-4ce6-aaff-86cd7cf31da3 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:09:30.679350 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1b1a3-871e-4ce6-aaff-86cd7cf31da3 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:09:30.679350 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1b1a3-871e-4ce6-aaff-86cd7cf31da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:09:30.756329 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-abd1b1a3-871e-4ce6-aaff-86cd7cf31da3 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:09:30.757539 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-abd1b1a3-871e-4ce6-aaff-86cd7cf31da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:09:30.855116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 579/1172] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:09:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:09:30.859799 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17149792-acb1-4d93-b5c6-173d45856e9c None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:09:30.861019 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-17149792-acb1-4d93-b5c6-173d45856e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:09:30.873142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17149792-acb1-4d93-b5c6-173d45856e9c None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:09:30.933584 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:09:30.967692 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53d5f0-8cd2-49bf-920c-c7b1c5e8450a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:09:30.968287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53d5f0-8cd2-49bf-920c-c7b1c5e8450a admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:09:30.968564 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53d5f0-8cd2-49bf-920c-c7b1c5e8450a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:09:30.968833 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53d5f0-8cd2-49bf-920c-c7b1c5e8450a admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:09:30.969460 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53d5f0-8cd2-49bf-920c-c7b1c5e8450a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:09:30.969755 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53d5f0-8cd2-49bf-920c-c7b1c5e8450a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:09:30.970752 dv-cinder-862491-1-smb devstack@keystone.service[81601]: WARNING py.warnings [None req-dd53d5f0-8cd2-49bf-920c-c7b1c5e8450a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:09:30.970752 dv-cinder-862491-1-smb devstack@keystone.service[81601]: warnings.warn(msg) Oct 24 13:09:30.970752 dv-cinder-862491-1-smb devstack@keystone.service[81601]: Oct 24 13:09:30.971669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53d5f0-8cd2-49bf-920c-c7b1c5e8450a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:09:30.982987 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 594/1173] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:09:30.993025 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1b1a3-871e-4ce6-aaff-86cd7cf31da3 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:09:31.002192 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1b1a3-871e-4ce6-aaff-86cd7cf31da3 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:09:31.063442 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:09:31.095958 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbf3aa-a03c-42fd-a536-eca3e32e7303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:09:31.096549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbf3aa-a03c-42fd-a536-eca3e32e7303 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:09:31.096820 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbf3aa-a03c-42fd-a536-eca3e32e7303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:09:31.097081 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbf3aa-a03c-42fd-a536-eca3e32e7303 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:09:31.097700 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecbf3aa-a03c-42fd-a536-eca3e32e7303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:09:31.099378 dv-cinder-862491-1-smb devstack@keystone.service[81600]: WARNING py.warnings [None req-cecbf3aa-a03c-42fd-a536-eca3e32e7303 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:09:31.099378 dv-cinder-862491-1-smb devstack@keystone.service[81600]: warnings.warn(msg) Oct 24 13:09:31.099378 dv-cinder-862491-1-smb devstack@keystone.service[81600]: Oct 24 13:09:31.100580 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecbf3aa-a03c-42fd-a536-eca3e32e7303 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:09:31.157207 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 580/1174] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:09:30 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:09:31.161446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53d5f0-8cd2-49bf-920c-c7b1c5e8450a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:09:31.162939 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-dd53d5f0-8cd2-49bf-920c-c7b1c5e8450a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:09:31.195446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53d5f0-8cd2-49bf-920c-c7b1c5e8450a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:09:31.286304 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04ccf1-fa99-4abf-b32d-961d769f8e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:09:31.286891 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04ccf1-fa99-4abf-b32d-961d769f8e3a admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:09:31.287165 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04ccf1-fa99-4abf-b32d-961d769f8e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:09:31.287445 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04ccf1-fa99-4abf-b32d-961d769f8e3a admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:09:31.288081 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04ccf1-fa99-4abf-b32d-961d769f8e3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:09:31.289074 dv-cinder-862491-1-smb devstack@keystone.service[81601]: WARNING py.warnings [None req-8b04ccf1-fa99-4abf-b32d-961d769f8e3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:09:31.289074 dv-cinder-862491-1-smb devstack@keystone.service[81601]: warnings.warn(msg) Oct 24 13:09:31.289074 dv-cinder-862491-1-smb devstack@keystone.service[81601]: Oct 24 13:09:31.290273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04ccf1-fa99-4abf-b32d-961d769f8e3a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:09:31.331351 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 595/1175] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:09:31 2022] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:09:31.336007 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbf3aa-a03c-42fd-a536-eca3e32e7303 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:09:31.337507 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-cecbf3aa-a03c-42fd-a536-eca3e32e7303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:09:31.400670 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbf3aa-a03c-42fd-a536-eca3e32e7303 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:09:31.484465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:09:31.496701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc74c8-9e80-4b7c-8223-2e42277c90a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:09:31.497303 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc74c8-9e80-4b7c-8223-2e42277c90a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:09:31.497580 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc74c8-9e80-4b7c-8223-2e42277c90a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:09:31.497849 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc74c8-9e80-4b7c-8223-2e42277c90a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:09:31.498487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc74c8-9e80-4b7c-8223-2e42277c90a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:09:31.500172 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc74c8-9e80-4b7c-8223-2e42277c90a1 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:09:31.513409 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 581/1176] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:09:31.517508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04ccf1-fa99-4abf-b32d-961d769f8e3a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:09:31.518988 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8b04ccf1-fa99-4abf-b32d-961d769f8e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:09:31.530266 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04ccf1-fa99-4abf-b32d-961d769f8e3a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:09:31.557444 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:09:31.628418 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8067220-ad17-47ec-9102-15d7f0e19d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:09:31.629050 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8067220-ad17-47ec-9102-15d7f0e19d1a admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:09:31.629327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8067220-ad17-47ec-9102-15d7f0e19d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:09:31.630233 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8067220-ad17-47ec-9102-15d7f0e19d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:09:31.631226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8067220-ad17-47ec-9102-15d7f0e19d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:09:31.632858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8067220-ad17-47ec-9102-15d7f0e19d1a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:09:31.645035 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 596/1177] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:09:31.649321 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc74c8-9e80-4b7c-8223-2e42277c90a1 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:09:31.650861 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-05dc74c8-9e80-4b7c-8223-2e42277c90a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:09:31.684845 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc74c8-9e80-4b7c-8223-2e42277c90a1 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:09:31.777372 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5740945-372f-4847-8df3-dbbef3965f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:09:31.777982 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5740945-372f-4847-8df3-dbbef3965f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:09:31.778259 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5740945-372f-4847-8df3-dbbef3965f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:09:31.778530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5740945-372f-4847-8df3-dbbef3965f9b admin admin] PATH_INFO: `/v3/projects/1788d5a60a08417daf31033c6cbdfb59/users/03b499ddfe1f4e2db98f407fd5428b89/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:09:31.801113 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5740945-372f-4847-8df3-dbbef3965f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1788d5a60a08417daf31033c6cbdfb59, user_id=03b499ddfe1f4e2db98f407fd5428b89, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:09:31.804757 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5740945-372f-4847-8df3-dbbef3965f9b admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:09:31.828024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 582/1178] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:09:31 2022] PUT /identity/v3/projects/1788d5a60a08417daf31033c6cbdfb59/users/03b499ddfe1f4e2db98f407fd5428b89/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:09:31.839510 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847827c-6175-492d-b20d-7a212be4c5d8 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:09:31.839797 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847827c-6175-492d-b20d-7a212be4c5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:09:31.840067 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847827c-6175-492d-b20d-7a212be4c5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:09:31.897544 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-3847827c-6175-492d-b20d-7a212be4c5d8 None None] MFA Rules not processed for user `03b499ddfe1f4e2db98f407fd5428b89`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:09:31.898731 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3847827c-6175-492d-b20d-7a212be4c5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:09:31.974044 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 597/1179] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:09:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:09:31.987046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b4698-5b11-40dc-9fa3-4ab211e69625 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:09:31.987333 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b4698-5b11-40dc-9fa3-4ab211e69625 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:09:31.987638 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b4698-5b11-40dc-9fa3-4ab211e69625 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:09:31.988966 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 583/1180] 10.222.0.18 () {54 vars in 963 bytes} [Mon Oct 24 13:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:09:31.994692 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c33ea5-8183-4c58-90f6-738da44696ef None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:09:31.994995 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c33ea5-8183-4c58-90f6-738da44696ef None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:09:31.995248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c33ea5-8183-4c58-90f6-738da44696ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:09:32.027050 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:09:32.073264 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-84c33ea5-8183-4c58-90f6-738da44696ef None None] MFA Rules not processed for user `171146d5235b4af8aff6f502e478f2df`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:09:32.074395 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-84c33ea5-8183-4c58-90f6-738da44696ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:09:32.149233 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 598/1181] 10.222.0.18 () {58 vars in 1060 bytes} [Mon Oct 24 13:09:31 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:09:32.157202 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b4698-5b11-40dc-9fa3-4ab211e69625 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:09:32.158688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-885b4698-5b11-40dc-9fa3-4ab211e69625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:09:32.210199 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:09:32.267411 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b4698-5b11-40dc-9fa3-4ab211e69625 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:09:32.343510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c4f85-c465-404a-936a-209c185dce2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:09:32.344025 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c4f85-c465-404a-936a-209c185dce2c service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:09:32.344316 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c4f85-c465-404a-936a-209c185dce2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:09:32.344609 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c4f85-c465-404a-936a-209c185dce2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:09:32.346148 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-dc5c4f85-c465-404a-936a-209c185dce2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:09:32.446824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c4f85-c465-404a-936a-209c185dce2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:09:32.449300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c4f85-c465-404a-936a-209c185dce2c service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:09:32.452421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:09:32.468481 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 584/1182] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:09:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:09:32.514131 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb245fc-2de9-4ec1-af2d-85195f831c1d None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:09:32.514420 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb245fc-2de9-4ec1-af2d-85195f831c1d None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:09:32.514728 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb245fc-2de9-4ec1-af2d-85195f831c1d None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:09:32.516034 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 599/1183] 10.222.0.18 () {52 vars in 830 bytes} [Mon Oct 24 13:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:09:32.519503 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c4f85-c465-404a-936a-209c185dce2c service cinder] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:09:32.521389 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-dc5c4f85-c465-404a-936a-209c185dce2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:09:32.625998 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c4f85-c465-404a-936a-209c185dce2c service cinder] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:09:32.719494 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356a8ac-7bd5-4dd7-9070-80dc86377aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:09:32.720161 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356a8ac-7bd5-4dd7-9070-80dc86377aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:09:32.720366 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356a8ac-7bd5-4dd7-9070-80dc86377aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:09:32.720629 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356a8ac-7bd5-4dd7-9070-80dc86377aa9 admin admin] PATH_INFO: `/v3/users/03b499ddfe1f4e2db98f407fd5428b89` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:09:32.733309 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356a8ac-7bd5-4dd7-9070-80dc86377aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03b499ddfe1f4e2db98f407fd5428b89)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:09:32.734327 dv-cinder-862491-1-smb devstack@keystone.service[81600]: WARNING py.warnings [None req-9356a8ac-7bd5-4dd7-9070-80dc86377aa9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:09:32.734327 dv-cinder-862491-1-smb devstack@keystone.service[81600]: warnings.warn(msg) Oct 24 13:09:32.734327 dv-cinder-862491-1-smb devstack@keystone.service[81600]: Oct 24 13:09:32.735562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356a8ac-7bd5-4dd7-9070-80dc86377aa9 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:09:32.745609 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:09:32.805644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-9356a8ac-7bd5-4dd7-9070-80dc86377aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03b499ddfe1f4e2db98f407fd5428b89'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:09:32.820346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-9356a8ac-7bd5-4dd7-9070-80dc86377aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03b499ddfe1f4e2db98f407fd5428b89'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:09:32.829522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-9356a8ac-7bd5-4dd7-9070-80dc86377aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03b499ddfe1f4e2db98f407fd5428b89'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:09:32.852180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-9356a8ac-7bd5-4dd7-9070-80dc86377aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03b499ddfe1f4e2db98f407fd5428b89'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:09:32.852700 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-9356a8ac-7bd5-4dd7-9070-80dc86377aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03b499ddfe1f4e2db98f407fd5428b89'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:09:32.858393 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 585/1184] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:09:32 2022] DELETE /identity/v3/users/03b499ddfe1f4e2db98f407fd5428b89 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:09:32.862736 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377160b-4642-4109-9f11-a04dff7e185a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:09:32.863218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377160b-4642-4109-9f11-a04dff7e185a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:09:32.863324 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377160b-4642-4109-9f11-a04dff7e185a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:09:32.919557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b377160b-4642-4109-9f11-a04dff7e185a None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:09:32.920667 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b377160b-4642-4109-9f11-a04dff7e185a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:09:32.996626 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:09:33.009649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 600/1185] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:09:33.020413 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356a8ac-7bd5-4dd7-9070-80dc86377aa9 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:09:33.021677 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-9356a8ac-7bd5-4dd7-9070-80dc86377aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:09:33.122047 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356a8ac-7bd5-4dd7-9070-80dc86377aa9 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:09:33.183127 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:09:33.203474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c837cc-4cf6-4b03-9a3a-5f83fb77ecc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:09:33.204073 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c837cc-4cf6-4b03-9a3a-5f83fb77ecc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:09:33.204345 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c837cc-4cf6-4b03-9a3a-5f83fb77ecc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:09:33.204608 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c837cc-4cf6-4b03-9a3a-5f83fb77ecc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:09:33.206157 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-c0c837cc-4cf6-4b03-9a3a-5f83fb77ecc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:09:33.313852 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c837cc-4cf6-4b03-9a3a-5f83fb77ecc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:09:33.315285 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c837cc-4cf6-4b03-9a3a-5f83fb77ecc4 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:09:33.334294 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 586/1186] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:09:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:09:33.663400 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377160b-4642-4109-9f11-a04dff7e185a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:09:33.664663 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b377160b-4642-4109-9f11-a04dff7e185a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:09:33.677148 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377160b-4642-4109-9f11-a04dff7e185a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:09:33.779836 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a004d6-e6a1-405e-be44-93f905fa5b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:09:33.780411 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a004d6-e6a1-405e-be44-93f905fa5b9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:09:33.780683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a004d6-e6a1-405e-be44-93f905fa5b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:09:33.780952 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a004d6-e6a1-405e-be44-93f905fa5b9d admin admin] PATH_INFO: `/v3/projects/1788d5a60a08417daf31033c6cbdfb59` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:09:33.790793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a004d6-e6a1-405e-be44-93f905fa5b9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1788d5a60a08417daf31033c6cbdfb59)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:09:33.791837 dv-cinder-862491-1-smb devstack@keystone.service[81601]: WARNING py.warnings [None req-73a004d6-e6a1-405e-be44-93f905fa5b9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:09:33.791837 dv-cinder-862491-1-smb devstack@keystone.service[81601]: warnings.warn(msg) Oct 24 13:09:33.791837 dv-cinder-862491-1-smb devstack@keystone.service[81601]: Oct 24 13:09:33.793041 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a004d6-e6a1-405e-be44-93f905fa5b9d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:09:33.850997 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-73a004d6-e6a1-405e-be44-93f905fa5b9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1788d5a60a08417daf31033c6cbdfb59', 'request_id': 'req-73a004d6-e6a1-405e-be44-93f905fa5b9d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:09:33.860734 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-73a004d6-e6a1-405e-be44-93f905fa5b9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1788d5a60a08417daf31033c6cbdfb59', 'request_id': 'req-73a004d6-e6a1-405e-be44-93f905fa5b9d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:09:33.867559 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-73a004d6-e6a1-405e-be44-93f905fa5b9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1788d5a60a08417daf31033c6cbdfb59', 'request_id': 'req-73a004d6-e6a1-405e-be44-93f905fa5b9d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:09:33.898252 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-73a004d6-e6a1-405e-be44-93f905fa5b9d admin admin] The token cache is being invalidate because project 1788d5a60a08417daf31033c6cbdfb59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:09:33.898539 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-73a004d6-e6a1-405e-be44-93f905fa5b9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:09:33.899063 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-73a004d6-e6a1-405e-be44-93f905fa5b9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:09:33.900391 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 601/1187] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:09:33 2022] DELETE /identity/v3/projects/1788d5a60a08417daf31033c6cbdfb59 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:09:43.331521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=62 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:09:43.896116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:11:06.584641 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d81e4-0858-4d72-a49a-209866ab0467 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:06.585201 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d81e4-0858-4d72-a49a-209866ab0467 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:06.585201 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d81e4-0858-4d72-a49a-209866ab0467 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:06.586504 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 587/1188] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:11:06.592107 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef13b7-4091-406c-9550-acc030b92867 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:06.592536 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef13b7-4091-406c-9550-acc030b92867 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:06.592689 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef13b7-4091-406c-9550-acc030b92867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:06.672636 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-92ef13b7-4091-406c-9550-acc030b92867 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:11:06.673869 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-92ef13b7-4091-406c-9550-acc030b92867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:11:06.774995 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 602/1189] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:11:06.934525 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d81e4-0858-4d72-a49a-209866ab0467 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:11:06.936642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-181d81e4-0858-4d72-a49a-209866ab0467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:11:07.055984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d81e4-0858-4d72-a49a-209866ab0467 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:11:07.061813 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17c457-f414-43bd-8058-5389010a5fa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:11:07.062410 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17c457-f414-43bd-8058-5389010a5fa0 service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:07.062687 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17c457-f414-43bd-8058-5389010a5fa0 service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:07.062959 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17c457-f414-43bd-8058-5389010a5fa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:07.070863 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17c457-f414-43bd-8058-5389010a5fa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:11:07.073119 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17c457-f414-43bd-8058-5389010a5fa0 service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:11:07.082204 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 588/1190] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:11:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:11:08.171946 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc72f48-2480-4678-bcc3-8374e4760875 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:08.172528 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc72f48-2480-4678-bcc3-8374e4760875 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:08.172528 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc72f48-2480-4678-bcc3-8374e4760875 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:08.173818 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 603/1191] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:11:08.178951 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0011158-9bad-4ccf-9eca-f909ce256fac None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:08.179346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0011158-9bad-4ccf-9eca-f909ce256fac None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:08.179532 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0011158-9bad-4ccf-9eca-f909ce256fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:08.199710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-b0011158-9bad-4ccf-9eca-f909ce256fac None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:11:08.200913 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b0011158-9bad-4ccf-9eca-f909ce256fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:11:08.209268 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 589/1192] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:11:08.362851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc72f48-2480-4678-bcc3-8374e4760875 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:11:08.377433 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc72f48-2480-4678-bcc3-8374e4760875 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:11:08.382803 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f2f24-6ea9-4c2b-9be1-4034f6a19221 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:11:08.383395 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f2f24-6ea9-4c2b-9be1-4034f6a19221 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:08.383709 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f2f24-6ea9-4c2b-9be1-4034f6a19221 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:08.384009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f2f24-6ea9-4c2b-9be1-4034f6a19221 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:08.392472 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f2f24-6ea9-4c2b-9be1-4034f6a19221 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:11:08.394056 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f2f24-6ea9-4c2b-9be1-4034f6a19221 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:11:08.404068 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 604/1193] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:11:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:11:08.552927 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733b8f7-4a67-40bc-b40c-768a5801f262 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:08.553217 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733b8f7-4a67-40bc-b40c-768a5801f262 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:08.553493 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733b8f7-4a67-40bc-b40c-768a5801f262 None None] PATH_INFO: `/v3` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:08.554776 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 590/1194] 10.222.0.39 () {54 vars in 925 bytes} [Mon Oct 24 13:11:08 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:11:08.561051 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ec412-36ce-4e4b-a7fc-1ccff98a1e99 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:08.561338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ec412-36ce-4e4b-a7fc-1ccff98a1e99 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:08.561615 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ec412-36ce-4e4b-a7fc-1ccff98a1e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:08.621860 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-6b5ec412-36ce-4e4b-a7fc-1ccff98a1e99 None None] MFA Rules not processed for user `60b3ca8694ab4a169a3c36561290d8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:11:08.622985 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6b5ec412-36ce-4e4b-a7fc-1ccff98a1e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:11:08.640020 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:11:08.693663 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 605/1195] 10.222.0.39 () {58 vars in 1015 bytes} [Mon Oct 24 13:11:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:11:12.218232 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e74f10-2197-4e37-bf3e-58ca54b876a9 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:12.218673 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e74f10-2197-4e37-bf3e-58ca54b876a9 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:12.218778 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e74f10-2197-4e37-bf3e-58ca54b876a9 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:12.220122 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 591/1196] 10.222.0.18 () {54 vars in 961 bytes} [Mon Oct 24 13:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:11:12.225163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e631c-31fc-4b1d-b123-26951063fadc None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:12.225602 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e631c-31fc-4b1d-b123-26951063fadc None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:12.225705 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e631c-31fc-4b1d-b123-26951063fadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:12.246992 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-5d4e631c-31fc-4b1d-b123-26951063fadc None None] MFA Rules not processed for user `60b3ca8694ab4a169a3c36561290d8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:11:12.248308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5d4e631c-31fc-4b1d-b123-26951063fadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:11:12.256951 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 606/1197] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Oct 24 13:11:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:11:12.264639 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e74f10-2197-4e37-bf3e-58ca54b876a9 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:11:12.278795 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e74f10-2197-4e37-bf3e-58ca54b876a9 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:11:12.283744 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad15599-7714-4932-9130-32a5a56da11d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b3ca8694ab4a169a3c36561290d8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:11:12.284336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad15599-7714-4932-9130-32a5a56da11d service placement] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:12.284617 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad15599-7714-4932-9130-32a5a56da11d service placement] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:12.284888 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad15599-7714-4932-9130-32a5a56da11d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:12.293019 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad15599-7714-4932-9130-32a5a56da11d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:11:12.295226 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad15599-7714-4932-9130-32a5a56da11d service placement] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:11:12.304802 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 592/1198] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:11:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:11:19.868608 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57683447-0a77-4f36-a47a-ea1b3c29af07 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:19.869171 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57683447-0a77-4f36-a47a-ea1b3c29af07 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:19.869171 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57683447-0a77-4f36-a47a-ea1b3c29af07 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:19.870460 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 607/1199] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:11:19.875766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed593d-2919-45d6-b59a-1d58cc0a90d4 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:19.876174 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed593d-2919-45d6-b59a-1d58cc0a90d4 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:19.876302 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed593d-2919-45d6-b59a-1d58cc0a90d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:19.896312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-06ed593d-2919-45d6-b59a-1d58cc0a90d4 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:11:19.897501 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-06ed593d-2919-45d6-b59a-1d58cc0a90d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:11:19.905256 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 593/1200] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:11:20.069333 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57683447-0a77-4f36-a47a-ea1b3c29af07 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:11:20.084408 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57683447-0a77-4f36-a47a-ea1b3c29af07 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:11:20.089899 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d67def-d5c6-4bcf-827c-a8b01e43790f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:11:20.090519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d67def-d5c6-4bcf-827c-a8b01e43790f service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:20.090799 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d67def-d5c6-4bcf-827c-a8b01e43790f service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:20.091074 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d67def-d5c6-4bcf-827c-a8b01e43790f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:20.099001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d67def-d5c6-4bcf-827c-a8b01e43790f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:11:20.100637 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d67def-d5c6-4bcf-827c-a8b01e43790f service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:11:20.110321 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 608/1201] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:11:21.294935 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdcb02-15b7-43f1-b0cd-b12f34aa412a None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:21.295503 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdcb02-15b7-43f1-b0cd-b12f34aa412a None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:21.295503 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdcb02-15b7-43f1-b0cd-b12f34aa412a None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:21.296826 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 594/1202] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:11:21.301673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cef222-55b1-4836-9c22-cb2888c3dedd None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:21.302098 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cef222-55b1-4836-9c22-cb2888c3dedd None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:21.302292 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cef222-55b1-4836-9c22-cb2888c3dedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:21.322117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-09cef222-55b1-4836-9c22-cb2888c3dedd None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:11:21.323307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-09cef222-55b1-4836-9c22-cb2888c3dedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:11:21.331757 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 609/1203] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:11:21.483282 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdcb02-15b7-43f1-b0cd-b12f34aa412a None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:11:21.498459 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdcb02-15b7-43f1-b0cd-b12f34aa412a None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:11:21.503870 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c2ce9-6881-49ab-9b5e-3b94ea527af1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:11:21.504454 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c2ce9-6881-49ab-9b5e-3b94ea527af1 service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:21.504728 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c2ce9-6881-49ab-9b5e-3b94ea527af1 service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:21.504996 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c2ce9-6881-49ab-9b5e-3b94ea527af1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:21.513432 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c2ce9-6881-49ab-9b5e-3b94ea527af1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:11:21.515023 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c2ce9-6881-49ab-9b5e-3b94ea527af1 service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:11:21.524156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 595/1204] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:11:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:11:25.607117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dee38-0e6a-4fea-a3c7-2e92a723a585 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:25.607734 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dee38-0e6a-4fea-a3c7-2e92a723a585 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:25.607734 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dee38-0e6a-4fea-a3c7-2e92a723a585 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:25.609096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 610/1205] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:11:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:11:25.614428 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a6bb0-362d-4ea3-8d29-209227dc75d6 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:25.614863 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a6bb0-362d-4ea3-8d29-209227dc75d6 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:25.614978 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a6bb0-362d-4ea3-8d29-209227dc75d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:25.635187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-d84a6bb0-362d-4ea3-8d29-209227dc75d6 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:11:25.636426 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d84a6bb0-362d-4ea3-8d29-209227dc75d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:11:25.644445 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 596/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:11:25.939061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dee38-0e6a-4fea-a3c7-2e92a723a585 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:11:25.940825 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7a9dee38-0e6a-4fea-a3c7-2e92a723a585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:11:26.016699 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dee38-0e6a-4fea-a3c7-2e92a723a585 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:11:26.020314 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989978f7-774e-4d86-9dda-2cb0a7fc6a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:11:26.020909 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989978f7-774e-4d86-9dda-2cb0a7fc6a93 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:26.021185 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989978f7-774e-4d86-9dda-2cb0a7fc6a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:26.021455 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989978f7-774e-4d86-9dda-2cb0a7fc6a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:26.030936 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989978f7-774e-4d86-9dda-2cb0a7fc6a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:11:26.032389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989978f7-774e-4d86-9dda-2cb0a7fc6a93 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:11:26.041464 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 611/1207] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:11:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:11:28.181551 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118746a2-80cb-405b-91fc-e1be4dd33ebd None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:28.182127 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118746a2-80cb-405b-91fc-e1be4dd33ebd None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:28.182127 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118746a2-80cb-405b-91fc-e1be4dd33ebd None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:28.183408 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 597/1208] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:11:28.188811 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d852ff1-d35f-4887-a1c1-57dfaa40cba8 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:28.189218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d852ff1-d35f-4887-a1c1-57dfaa40cba8 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:28.189356 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d852ff1-d35f-4887-a1c1-57dfaa40cba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:28.211004 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-1d852ff1-d35f-4887-a1c1-57dfaa40cba8 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:11:28.212359 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1d852ff1-d35f-4887-a1c1-57dfaa40cba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:11:28.220747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 612/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:11:28.540871 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118746a2-80cb-405b-91fc-e1be4dd33ebd None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:11:28.555284 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118746a2-80cb-405b-91fc-e1be4dd33ebd None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:11:28.558872 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bcf7a8-a55b-4076-a1ac-87239dac8a56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:11:28.559488 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcf7a8-a55b-4076-a1ac-87239dac8a56 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:28.559761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcf7a8-a55b-4076-a1ac-87239dac8a56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:28.560029 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcf7a8-a55b-4076-a1ac-87239dac8a56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:28.571254 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bcf7a8-a55b-4076-a1ac-87239dac8a56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:11:28.572753 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bcf7a8-a55b-4076-a1ac-87239dac8a56 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:11:28.583584 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 598/1210] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:11:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:11:32.221740 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6d2f3-e02c-42bf-b6d6-7bbf5677347a None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:32.222290 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6d2f3-e02c-42bf-b6d6-7bbf5677347a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:32.222290 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6d2f3-e02c-42bf-b6d6-7bbf5677347a None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:32.223630 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 613/1211] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:11:32.228785 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad80f5-e5dd-4526-b4d5-e5c9e65a1ebf None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:32.229228 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad80f5-e5dd-4526-b4d5-e5c9e65a1ebf None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:32.229324 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad80f5-e5dd-4526-b4d5-e5c9e65a1ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:32.248590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-cdad80f5-e5dd-4526-b4d5-e5c9e65a1ebf None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:11:32.249760 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-cdad80f5-e5dd-4526-b4d5-e5c9e65a1ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:11:32.257342 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 599/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:11:32.567369 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6d2f3-e02c-42bf-b6d6-7bbf5677347a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:11:32.569023 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-cda6d2f3-e02c-42bf-b6d6-7bbf5677347a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:11:32.633564 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:11:32.647291 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6d2f3-e02c-42bf-b6d6-7bbf5677347a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:11:32.650754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1656e76-9a58-4956-b120-92f52c39cb2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:11:32.651348 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1656e76-9a58-4956-b120-92f52c39cb2e service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:32.651651 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1656e76-9a58-4956-b120-92f52c39cb2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:32.651918 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1656e76-9a58-4956-b120-92f52c39cb2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:32.660837 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1656e76-9a58-4956-b120-92f52c39cb2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:11:32.662349 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1656e76-9a58-4956-b120-92f52c39cb2e service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:11:32.671994 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 614/1213] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:11:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:11:34.813748 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f5fa0-9665-41f0-93c2-ef23718d48ef None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:34.814282 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f5fa0-9665-41f0-93c2-ef23718d48ef None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:34.814282 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f5fa0-9665-41f0-93c2-ef23718d48ef None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:34.815556 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 600/1214] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:11:34.820720 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e999f4-19f7-4d9f-8a8a-7886d7e41bfb None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:34.821162 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e999f4-19f7-4d9f-8a8a-7886d7e41bfb None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:34.821298 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e999f4-19f7-4d9f-8a8a-7886d7e41bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:34.841947 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-06e999f4-19f7-4d9f-8a8a-7886d7e41bfb None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:11:34.843125 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-06e999f4-19f7-4d9f-8a8a-7886d7e41bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:11:34.850778 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 615/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:11:35.155193 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f5fa0-9665-41f0-93c2-ef23718d48ef None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:11:35.156931 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-550f5fa0-9665-41f0-93c2-ef23718d48ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:11:35.164324 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=84 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:11:35.170811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f5fa0-9665-41f0-93c2-ef23718d48ef None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:11:35.174244 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b151530-09b9-4479-a827-176dbe04cee0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:11:35.174827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b151530-09b9-4479-a827-176dbe04cee0 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:11:35.175100 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b151530-09b9-4479-a827-176dbe04cee0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:11:35.175366 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b151530-09b9-4479-a827-176dbe04cee0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:11:35.184675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b151530-09b9-4479-a827-176dbe04cee0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:11:35.186104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b151530-09b9-4479-a827-176dbe04cee0 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:11:35.196010 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 601/1216] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:11:44.837031 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=11 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:11:45.191579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=5 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:02.285472 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d746d-ab3c-4385-a503-1021628799cc None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:02.287822 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d746d-ab3c-4385-a503-1021628799cc None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:02.287822 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d746d-ab3c-4385-a503-1021628799cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:02.314603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-6f1d746d-ab3c-4385-a503-1021628799cc None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:02.315891 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6f1d746d-ab3c-4385-a503-1021628799cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:02.320837 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b8bf7-fa1a-4d42-91ec-5057f2c38539 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:02.321454 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b8bf7-fa1a-4d42-91ec-5057f2c38539 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:02.321454 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b8bf7-fa1a-4d42-91ec-5057f2c38539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:02.329409 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 616/1217] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:02.347179 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684021d-9d03-4054-91dd-631fcf2e3593 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:02.347603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684021d-9d03-4054-91dd-631fcf2e3593 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:02.347887 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684021d-9d03-4054-91dd-631fcf2e3593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:02.356596 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-0c9b8bf7-fa1a-4d42-91ec-5057f2c38539 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:02.357838 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-0c9b8bf7-fa1a-4d42-91ec-5057f2c38539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:02.379815 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 602/1218] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:02.380907 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-4684021d-9d03-4054-91dd-631fcf2e3593 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:02.382285 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4684021d-9d03-4054-91dd-631fcf2e3593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:02.391033 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927c0d5-8534-4adf-a156-01699ff7361e None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:02.391483 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927c0d5-8534-4adf-a156-01699ff7361e None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:02.391615 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927c0d5-8534-4adf-a156-01699ff7361e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:02.397108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 617/1219] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:02.403004 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684021d-9d03-4054-91dd-631fcf2e3593 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:02.418898 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684021d-9d03-4054-91dd-631fcf2e3593 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:02.424534 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-9927c0d5-8534-4adf-a156-01699ff7361e None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:02.426041 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-9927c0d5-8534-4adf-a156-01699ff7361e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:02.431813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c514a1-7262-4ca5-bd8d-3518bdb37440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:02.431813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c514a1-7262-4ca5-bd8d-3518bdb37440 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:02.431813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c514a1-7262-4ca5-bd8d-3518bdb37440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:02.431813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c514a1-7262-4ca5-bd8d-3518bdb37440 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:02.432391 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c514a1-7262-4ca5-bd8d-3518bdb37440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:02.432391 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c514a1-7262-4ca5-bd8d-3518bdb37440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:02.433668 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c514a1-7262-4ca5-bd8d-3518bdb37440 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:02.445257 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 603/1220] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:02.450529 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927c0d5-8534-4adf-a156-01699ff7361e None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:02.454898 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 618/1221] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:02.468940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927c0d5-8534-4adf-a156-01699ff7361e None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:02.471737 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c514a1-7262-4ca5-bd8d-3518bdb37440 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:02.489694 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c514a1-7262-4ca5-bd8d-3518bdb37440 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:02.491596 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017c681-aae0-4ce9-a536-76f78a42c6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:02.492303 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017c681-aae0-4ce9-a536-76f78a42c6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:02.492586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017c681-aae0-4ce9-a536-76f78a42c6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:02.492895 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017c681-aae0-4ce9-a536-76f78a42c6d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:02.493556 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017c681-aae0-4ce9-a536-76f78a42c6d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:02.500643 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4dbf3-10d1-4821-a690-9378614c816e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:02.501284 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017c681-aae0-4ce9-a536-76f78a42c6d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:02.501422 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4dbf3-10d1-4821-a690-9378614c816e admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:02.501602 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4dbf3-10d1-4821-a690-9378614c816e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:02.501847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4dbf3-10d1-4821-a690-9378614c816e admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:02.502504 dv-cinder-862491-1-smb devstack@keystone.service[81600]: WARNING py.warnings [None req-c017c681-aae0-4ce9-a536-76f78a42c6d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:13:02.502504 dv-cinder-862491-1-smb devstack@keystone.service[81600]: warnings.warn(msg) Oct 24 13:13:02.502504 dv-cinder-862491-1-smb devstack@keystone.service[81600]: Oct 24 13:13:02.502750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4dbf3-10d1-4821-a690-9378614c816e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:02.503806 dv-cinder-862491-1-smb devstack@keystone.service[81601]: WARNING py.warnings [None req-5ca4dbf3-10d1-4821-a690-9378614c816e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:13:02.503806 dv-cinder-862491-1-smb devstack@keystone.service[81601]: warnings.warn(msg) Oct 24 13:13:02.503806 dv-cinder-862491-1-smb devstack@keystone.service[81601]: Oct 24 13:13:02.504856 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017c681-aae0-4ce9-a536-76f78a42c6d7 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:02.505151 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4dbf3-10d1-4821-a690-9378614c816e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:02.524106 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 604/1222] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:02.554453 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017c681-aae0-4ce9-a536-76f78a42c6d7 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:02.593966 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 619/1223] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:02 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:02.594414 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017c681-aae0-4ce9-a536-76f78a42c6d7 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:02.597094 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4dbf3-10d1-4821-a690-9378614c816e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:02.696207 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a44312-c902-4e61-b7e5-6e0065c9a6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:02.696840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a44312-c902-4e61-b7e5-6e0065c9a6af admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:02.697805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a44312-c902-4e61-b7e5-6e0065c9a6af admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:02.698081 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a44312-c902-4e61-b7e5-6e0065c9a6af admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:02.698721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a44312-c902-4e61-b7e5-6e0065c9a6af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:02.702797 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a44312-c902-4e61-b7e5-6e0065c9a6af admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:02.753275 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4dbf3-10d1-4821-a690-9378614c816e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:02.762712 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c605d-270a-4475-83e7-2d8d22d7a27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:02.764475 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c605d-270a-4475-83e7-2d8d22d7a27c admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:02.764766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c605d-270a-4475-83e7-2d8d22d7a27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:02.765041 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c605d-270a-4475-83e7-2d8d22d7a27c admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:02.766720 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 605/1224] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:02 2022] POST /identity/v3/projects => generated 371 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:02.768025 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b0b78-fdd8-4a43-a9e9-9a41a7790238 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:02.768237 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c605d-270a-4475-83e7-2d8d22d7a27c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:02.770445 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b0b78-fdd8-4a43-a9e9-9a41a7790238 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:02.770728 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b0b78-fdd8-4a43-a9e9-9a41a7790238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:02.774754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c605d-270a-4475-83e7-2d8d22d7a27c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:02.805824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-9a2b0b78-fdd8-4a43-a9e9-9a41a7790238 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:02.808627 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-9a2b0b78-fdd8-4a43-a9e9-9a41a7790238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:02.812424 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 620/1225] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:02 2022] POST /identity/v3/users => generated 294 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:02.816491 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054785af-ae6f-45f6-a406-0a72673f65cc None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:02.816491 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054785af-ae6f-45f6-a406-0a72673f65cc None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:02.816491 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054785af-ae6f-45f6-a406-0a72673f65cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:02.843632 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-054785af-ae6f-45f6-a406-0a72673f65cc None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:02.844177 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-054785af-ae6f-45f6-a406-0a72673f65cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:02.887702 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 606/1226] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:02.889811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4597e-b0bd-47fb-beb4-22565e6c61fd None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:02.890944 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4597e-b0bd-47fb-beb4-22565e6c61fd None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:02.891460 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4597e-b0bd-47fb-beb4-22565e6c61fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:02.914930 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-12c4597e-b0bd-47fb-beb4-22565e6c61fd None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:02.915940 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 621/1227] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:02.916211 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-12c4597e-b0bd-47fb-beb4-22565e6c61fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:02.916849 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054785af-ae6f-45f6-a406-0a72673f65cc None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:02.925392 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 607/1228] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:02.926609 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee6b65-fe0b-42f8-916f-bd474521b2ba None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:02.926745 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054785af-ae6f-45f6-a406-0a72673f65cc None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:02.926924 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee6b65-fe0b-42f8-916f-bd474521b2ba None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:02.927178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee6b65-fe0b-42f8-916f-bd474521b2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:02.935463 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c19766-1fe3-4dd5-867e-fb8f634f2da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:02.936079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c19766-1fe3-4dd5-867e-fb8f634f2da8 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:02.936589 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c19766-1fe3-4dd5-867e-fb8f634f2da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:02.936865 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c19766-1fe3-4dd5-867e-fb8f634f2da8 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:02.938498 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c19766-1fe3-4dd5-867e-fb8f634f2da8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:02.940452 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c19766-1fe3-4dd5-867e-fb8f634f2da8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:02.948571 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-20ee6b65-fe0b-42f8-916f-bd474521b2ba None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:02.949758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-20ee6b65-fe0b-42f8-916f-bd474521b2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:02.959136 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 608/1229] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:02.964516 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee6b65-fe0b-42f8-916f-bd474521b2ba None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:02.965058 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 622/1230] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:02 2022] POST /identity/v3/users => generated 286 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:02.966428 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bbc4c-eed6-4671-9838-4ecd945c2568 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:02.966723 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bbc4c-eed6-4671-9838-4ecd945c2568 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:02.967004 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bbc4c-eed6-4671-9838-4ecd945c2568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:02.975060 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee6b65-fe0b-42f8-916f-bd474521b2ba None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:02.980551 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f8f5a-111d-441c-9d7b-d92d04347494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:02.981152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f8f5a-111d-441c-9d7b-d92d04347494 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:02.981458 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f8f5a-111d-441c-9d7b-d92d04347494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:02.981723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f8f5a-111d-441c-9d7b-d92d04347494 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:02.982842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f8f5a-111d-441c-9d7b-d92d04347494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:02.984503 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f8f5a-111d-441c-9d7b-d92d04347494 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:02.987248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-fc9bbc4c-eed6-4671-9838-4ecd945c2568 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:02.988487 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-fc9bbc4c-eed6-4671-9838-4ecd945c2568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:02.998126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 609/1231] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:02.998126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92bf7d-ed30-450c-bff3-ddc8f54db0ef None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:02.998126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92bf7d-ed30-450c-bff3-ddc8f54db0ef None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:02.998126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92bf7d-ed30-450c-bff3-ddc8f54db0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:02.999973 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 623/1232] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:03.001208 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd28d7-06d5-4296-9561-8860b138d184 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.001492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd28d7-06d5-4296-9561-8860b138d184 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.001774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd28d7-06d5-4296-9561-8860b138d184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.020925 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-8c92bf7d-ed30-450c-bff3-ddc8f54db0ef None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:03.021821 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-60fd28d7-06d5-4296-9561-8860b138d184 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:03.022127 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-8c92bf7d-ed30-450c-bff3-ddc8f54db0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:03.022983 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-60fd28d7-06d5-4296-9561-8860b138d184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:03.030645 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 610/1233] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:03.031623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 624/1234] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:03.031853 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ab87b-731b-4e8a-83c3-abca43a3a6ca None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.032133 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ab87b-731b-4e8a-83c3-abca43a3a6ca None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.032408 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ab87b-731b-4e8a-83c3-abca43a3a6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.032598 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7837a6-0e67-4e2e-bad4-f14fd606bf6c None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.032878 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7837a6-0e67-4e2e-bad4-f14fd606bf6c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.033149 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7837a6-0e67-4e2e-bad4-f14fd606bf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.041108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:03.054057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-402ab87b-731b-4e8a-83c3-abca43a3a6ca None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:03.055252 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-402ab87b-731b-4e8a-83c3-abca43a3a6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:03.055927 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-ff7837a6-0e67-4e2e-bad4-f14fd606bf6c None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:03.057221 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ff7837a6-0e67-4e2e-bad4-f14fd606bf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:03.063308 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 611/1235] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:03.064533 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd23a0-dacd-4c45-83f1-cfe56131367c None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.064810 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd23a0-dacd-4c45-83f1-cfe56131367c None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.065075 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd23a0-dacd-4c45-83f1-cfe56131367c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.068616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 625/1236] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:03.069334 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7837a6-0e67-4e2e-bad4-f14fd606bf6c None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.079507 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7837a6-0e67-4e2e-bad4-f14fd606bf6c None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.084415 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e1548-1d87-48c6-9c19-f9fa0f9b5bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.084855 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-3bbd23a0-dacd-4c45-83f1-cfe56131367c None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:03.085003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e1548-1d87-48c6-9c19-f9fa0f9b5bac admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.085285 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e1548-1d87-48c6-9c19-f9fa0f9b5bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.085559 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e1548-1d87-48c6-9c19-f9fa0f9b5bac admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.086012 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-3bbd23a0-dacd-4c45-83f1-cfe56131367c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:03.086194 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e1548-1d87-48c6-9c19-f9fa0f9b5bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.088453 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e1548-1d87-48c6-9c19-f9fa0f9b5bac admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.094420 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 612/1237] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:03.098031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd23a0-dacd-4c45-83f1-cfe56131367c None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.101540 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 626/1238] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:03.101540 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86d9f2-5a98-4424-815f-d7bc412fd732 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.101540 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86d9f2-5a98-4424-815f-d7bc412fd732 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.101540 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86d9f2-5a98-4424-815f-d7bc412fd732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.105878 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd23a0-dacd-4c45-83f1-cfe56131367c None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.110554 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0b9ff-69b4-4d1d-b660-14b408e8261d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.111142 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0b9ff-69b4-4d1d-b660-14b408e8261d admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.111436 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0b9ff-69b4-4d1d-b660-14b408e8261d admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.111715 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0b9ff-69b4-4d1d-b660-14b408e8261d admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.112342 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c0b9ff-69b4-4d1d-b660-14b408e8261d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.113935 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c0b9ff-69b4-4d1d-b660-14b408e8261d admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.120631 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-6b86d9f2-5a98-4424-815f-d7bc412fd732 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:03.121877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6b86d9f2-5a98-4424-815f-d7bc412fd732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:03.125949 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 613/1239] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:03.126755 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0b9ff-69b4-4d1d-b660-14b408e8261d admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.133144 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 627/1240] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:03.133144 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1751d28-1fb1-44cf-851f-d3248f6c7536 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.133144 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1751d28-1fb1-44cf-851f-d3248f6c7536 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.133144 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1751d28-1fb1-44cf-851f-d3248f6c7536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.133527 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:03.136970 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0b9ff-69b4-4d1d-b660-14b408e8261d admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.143063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd837c3b-afdf-455a-a523-81014cab164e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.143688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd837c3b-afdf-455a-a523-81014cab164e admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.143963 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd837c3b-afdf-455a-a523-81014cab164e admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.144347 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd837c3b-afdf-455a-a523-81014cab164e admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.144980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd837c3b-afdf-455a-a523-81014cab164e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:03.145275 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd837c3b-afdf-455a-a523-81014cab164e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.146892 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd837c3b-afdf-455a-a523-81014cab164e admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.153158 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-a1751d28-1fb1-44cf-851f-d3248f6c7536 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:03.154350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a1751d28-1fb1-44cf-851f-d3248f6c7536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:03.159931 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 614/1241] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:03.160955 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd837c3b-afdf-455a-a523-81014cab164e admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.164607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 628/1242] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:03.165383 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1751d28-1fb1-44cf-851f-d3248f6c7536 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.174858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1751d28-1fb1-44cf-851f-d3248f6c7536 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.175130 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd837c3b-afdf-455a-a523-81014cab164e admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.179450 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12141c20-daa8-462f-ba46-10f4bf76909f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.179669 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb96ff-9512-4663-809d-aa9bacf97c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.180036 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12141c20-daa8-462f-ba46-10f4bf76909f admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.180251 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb96ff-9512-4663-809d-aa9bacf97c54 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.180359 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12141c20-daa8-462f-ba46-10f4bf76909f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.180525 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb96ff-9512-4663-809d-aa9bacf97c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.180622 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12141c20-daa8-462f-ba46-10f4bf76909f admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.180790 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb96ff-9512-4663-809d-aa9bacf97c54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.181191 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12141c20-daa8-462f-ba46-10f4bf76909f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:03.181912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb96ff-9512-4663-809d-aa9bacf97c54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:03.182011 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12141c20-daa8-462f-ba46-10f4bf76909f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.182208 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb96ff-9512-4663-809d-aa9bacf97c54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.183610 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12141c20-daa8-462f-ba46-10f4bf76909f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.184027 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb96ff-9512-4663-809d-aa9bacf97c54 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.195489 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 615/1243] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:03.203272 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb96ff-9512-4663-809d-aa9bacf97c54 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.203377 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 629/1244] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:03.203377 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12141c20-daa8-462f-ba46-10f4bf76909f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.212415 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12141c20-daa8-462f-ba46-10f4bf76909f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.212548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb96ff-9512-4663-809d-aa9bacf97c54 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.217137 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14cdb37-a601-4aa2-a135-22e4fc6b79dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.217288 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b615d2-dfad-4791-83c4-ff65b474b95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.217716 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b615d2-dfad-4791-83c4-ff65b474b95a admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.217829 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cdb37-a601-4aa2-a135-22e4fc6b79dc admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.217986 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b615d2-dfad-4791-83c4-ff65b474b95a admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.218109 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cdb37-a601-4aa2-a135-22e4fc6b79dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.218247 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cdb37-a601-4aa2-a135-22e4fc6b79dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.218344 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b615d2-dfad-4791-83c4-ff65b474b95a admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.218872 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14cdb37-a601-4aa2-a135-22e4fc6b79dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.218990 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b615d2-dfad-4791-83c4-ff65b474b95a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:03.219266 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b615d2-dfad-4791-83c4-ff65b474b95a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.220490 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14cdb37-a601-4aa2-a135-22e4fc6b79dc admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.220900 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b615d2-dfad-4791-83c4-ff65b474b95a admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.231219 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 630/1245] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:03.232026 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14cdb37-a601-4aa2-a135-22e4fc6b79dc admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.235170 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 616/1246] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:03.236304 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b615d2-dfad-4791-83c4-ff65b474b95a admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.241362 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14cdb37-a601-4aa2-a135-22e4fc6b79dc admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.246898 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783d4d2-079c-426e-aec6-3e833d7d221a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.247562 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783d4d2-079c-426e-aec6-3e833d7d221a admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.247841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783d4d2-079c-426e-aec6-3e833d7d221a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.248115 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783d4d2-079c-426e-aec6-3e833d7d221a admin admin] PATH_INFO: `/v3/projects/ca3452d8e9034671b17c2bc15e4acb4d/users/2716cf78afb84caf866acd4d5526168c/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.252075 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b615d2-dfad-4791-83c4-ff65b474b95a admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.256484 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5871c-337b-46b9-9ebf-52dc6ad21cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.257059 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5871c-337b-46b9-9ebf-52dc6ad21cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.257338 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5871c-337b-46b9-9ebf-52dc6ad21cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.257608 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5871c-337b-46b9-9ebf-52dc6ad21cf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.258227 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5871c-337b-46b9-9ebf-52dc6ad21cf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:03.258516 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5871c-337b-46b9-9ebf-52dc6ad21cf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.261231 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5871c-337b-46b9-9ebf-52dc6ad21cf7 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.263068 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783d4d2-079c-426e-aec6-3e833d7d221a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3452d8e9034671b17c2bc15e4acb4d, user_id=2716cf78afb84caf866acd4d5526168c, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.265787 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783d4d2-079c-426e-aec6-3e833d7d221a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.272875 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 617/1247] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:03.273669 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5871c-337b-46b9-9ebf-52dc6ad21cf7 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.280088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 631/1248] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:03 2022] PUT /identity/v3/projects/ca3452d8e9034671b17c2bc15e4acb4d/users/2716cf78afb84caf866acd4d5526168c/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:03.281435 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783d4d2-079c-426e-aec6-3e833d7d221a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.290348 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5871c-337b-46b9-9ebf-52dc6ad21cf7 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.343802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783d4d2-079c-426e-aec6-3e833d7d221a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.348541 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f88cf-ee48-4278-af83-14ced469eab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.349276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f88cf-ee48-4278-af83-14ced469eab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.349666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f88cf-ee48-4278-af83-14ced469eab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.350064 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f88cf-ee48-4278-af83-14ced469eab9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.350704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f88cf-ee48-4278-af83-14ced469eab9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:03.351005 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f88cf-ee48-4278-af83-14ced469eab9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.351217 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37cf70-6424-4af7-944b-e767f6888af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.351885 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37cf70-6424-4af7-944b-e767f6888af7 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.352163 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37cf70-6424-4af7-944b-e767f6888af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.352440 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37cf70-6424-4af7-944b-e767f6888af7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.352663 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f88cf-ee48-4278-af83-14ced469eab9 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.353889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37cf70-6424-4af7-944b-e767f6888af7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.356021 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37cf70-6424-4af7-944b-e767f6888af7 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.364781 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 632/1249] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:03.365644 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f88cf-ee48-4278-af83-14ced469eab9 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.381981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f88cf-ee48-4278-af83-14ced469eab9 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.386018 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 618/1250] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:03 2022] POST /identity/v3/projects => generated 367 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:03.386869 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37cf70-6424-4af7-944b-e767f6888af7 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.389962 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892551a-d660-4337-a9d6-7a3453135b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.390614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892551a-d660-4337-a9d6-7a3453135b0a admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.390927 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892551a-d660-4337-a9d6-7a3453135b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.391198 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892551a-d660-4337-a9d6-7a3453135b0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.391849 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892551a-d660-4337-a9d6-7a3453135b0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.393789 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892551a-d660-4337-a9d6-7a3453135b0a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.424266 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 633/1251] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:03 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:03.425227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892551a-d660-4337-a9d6-7a3453135b0a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.451262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37cf70-6424-4af7-944b-e767f6888af7 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.480714 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:03.485859 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892551a-d660-4337-a9d6-7a3453135b0a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.491299 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a2bbe-6a54-463c-a4c1-ae1cdf463aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.492022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a2bbe-6a54-463c-a4c1-ae1cdf463aff admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.492334 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a2bbe-6a54-463c-a4c1-ae1cdf463aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.492602 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a2bbe-6a54-463c-a4c1-ae1cdf463aff admin admin] PATH_INFO: `/v3/projects/38a10f7328d44c6499e020998ee0488b/users/8ff80e291bf5407089c2a00a38133b52/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.494261 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:03.507382 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a2bbe-6a54-463c-a4c1-ae1cdf463aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a10f7328d44c6499e020998ee0488b, user_id=8ff80e291bf5407089c2a00a38133b52, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.510554 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051b13d-449b-4739-82bd-0915ae90cf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.510796 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a2bbe-6a54-463c-a4c1-ae1cdf463aff admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.511154 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051b13d-449b-4739-82bd-0915ae90cf8b admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.511449 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051b13d-449b-4739-82bd-0915ae90cf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.511725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051b13d-449b-4739-82bd-0915ae90cf8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.512345 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051b13d-449b-4739-82bd-0915ae90cf8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.514248 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051b13d-449b-4739-82bd-0915ae90cf8b admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.523792 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 634/1252] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:03 2022] PUT /identity/v3/projects/38a10f7328d44c6499e020998ee0488b/users/8ff80e291bf5407089c2a00a38133b52/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:03.524667 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a2bbe-6a54-463c-a4c1-ae1cdf463aff admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.545742 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 619/1253] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:03 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:03.546925 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051b13d-449b-4739-82bd-0915ae90cf8b admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.595876 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a2bbe-6a54-463c-a4c1-ae1cdf463aff admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.612026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051b13d-449b-4739-82bd-0915ae90cf8b admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.616684 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7d13d-a088-4495-80e5-58a4291d7a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.617289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7d13d-a088-4495-80e5-58a4291d7a7c admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.617577 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7d13d-a088-4495-80e5-58a4291d7a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.617847 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7d13d-a088-4495-80e5-58a4291d7a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.618475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7d13d-a088-4495-80e5-58a4291d7a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.620484 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7d13d-a088-4495-80e5-58a4291d7a7c admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.652733 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 620/1254] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:03 2022] POST /identity/v3/projects => generated 393 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:03.652733 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ebf6e-3b09-45c2-a5c5-ff5b0fa85232 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.652733 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ebf6e-3b09-45c2-a5c5-ff5b0fa85232 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.652733 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ebf6e-3b09-45c2-a5c5-ff5b0fa85232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.654988 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2ad4c-ee34-4ff0-9248-af3f92ca3051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.655629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2ad4c-ee34-4ff0-9248-af3f92ca3051 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.655911 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2ad4c-ee34-4ff0-9248-af3f92ca3051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.656187 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2ad4c-ee34-4ff0-9248-af3f92ca3051 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.656819 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2ad4c-ee34-4ff0-9248-af3f92ca3051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.663544 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2ad4c-ee34-4ff0-9248-af3f92ca3051 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.670757 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-1f9ebf6e-3b09-45c2-a5c5-ff5b0fa85232 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:03.672002 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-1f9ebf6e-3b09-45c2-a5c5-ff5b0fa85232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:03.693227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 635/1255] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:03 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:03.693227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2ad4c-ee34-4ff0-9248-af3f92ca3051 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.735763 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 621/1256] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:03.736588 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ebf6e-3b09-45c2-a5c5-ff5b0fa85232 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.746266 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ebf6e-3b09-45c2-a5c5-ff5b0fa85232 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.757744 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2ad4c-ee34-4ff0-9248-af3f92ca3051 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.763193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e7727-1543-46fe-a268-0840c2c8b3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.763839 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e7727-1543-46fe-a268-0840c2c8b3ae admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.764127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e7727-1543-46fe-a268-0840c2c8b3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.764424 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e7727-1543-46fe-a268-0840c2c8b3ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.765059 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e7727-1543-46fe-a268-0840c2c8b3ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.767080 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e7727-1543-46fe-a268-0840c2c8b3ae admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.783546 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:03.795915 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 636/1257] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:03 2022] POST /identity/v3/projects => generated 403 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:03.796777 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e7727-1543-46fe-a268-0840c2c8b3ae admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.799559 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:03.805550 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b7496-f666-4c93-9b83-b523c63c9040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.806377 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b7496-f666-4c93-9b83-b523c63c9040 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.806954 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b7496-f666-4c93-9b83-b523c63c9040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.807833 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b7496-f666-4c93-9b83-b523c63c9040 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.808595 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b7496-f666-4c93-9b83-b523c63c9040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.809848 dv-cinder-862491-1-smb devstack@keystone.service[81600]: WARNING py.warnings [None req-d74b7496-f666-4c93-9b83-b523c63c9040 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:13:03.809848 dv-cinder-862491-1-smb devstack@keystone.service[81600]: warnings.warn(msg) Oct 24 13:13:03.809848 dv-cinder-862491-1-smb devstack@keystone.service[81600]: Oct 24 13:13:03.811076 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b7496-f666-4c93-9b83-b523c63c9040 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.836327 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 622/1258] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:03 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:03.836327 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24363d-caee-4990-98e8-86381cc8f43a None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.836327 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24363d-caee-4990-98e8-86381cc8f43a None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.836327 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24363d-caee-4990-98e8-86381cc8f43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.862043 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e7727-1543-46fe-a268-0840c2c8b3ae admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.862258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-fb24363d-caee-4990-98e8-86381cc8f43a None None] MFA Rules not processed for user `8ff80e291bf5407089c2a00a38133b52`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:03.863365 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-fb24363d-caee-4990-98e8-86381cc8f43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:03.866612 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0204427-20d3-4650-8920-87320e1dbe4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.867222 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0204427-20d3-4650-8920-87320e1dbe4b admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.867536 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0204427-20d3-4650-8920-87320e1dbe4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.867811 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0204427-20d3-4650-8920-87320e1dbe4b admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.868436 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0204427-20d3-4650-8920-87320e1dbe4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.870555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0204427-20d3-4650-8920-87320e1dbe4b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.892369 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 637/1259] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:03 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:03.893233 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0204427-20d3-4650-8920-87320e1dbe4b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.903263 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0204427-20d3-4650-8920-87320e1dbe4b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.908211 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6c61f-bc10-4491-8583-727eb54222f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.908803 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6c61f-bc10-4491-8583-727eb54222f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.909197 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6c61f-bc10-4491-8583-727eb54222f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.909471 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6c61f-bc10-4491-8583-727eb54222f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.910090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6c61f-bc10-4491-8583-727eb54222f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.912065 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6c61f-bc10-4491-8583-727eb54222f3 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.931760 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 623/1260] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:03.934108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 638/1261] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:03 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:03.934809 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6c61f-bc10-4491-8583-727eb54222f3 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.936309 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24363d-caee-4990-98e8-86381cc8f43a None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.949340 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6c61f-bc10-4491-8583-727eb54222f3 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.949789 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24363d-caee-4990-98e8-86381cc8f43a None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.954030 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03d4cd-434f-4ad7-b29f-13851f70abec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.954629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03d4cd-434f-4ad7-b29f-13851f70abec admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.955227 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fe6cb-1bcd-4bf1-9ee5-77ef5eef85e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.955352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03d4cd-434f-4ad7-b29f-13851f70abec admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.955352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03d4cd-434f-4ad7-b29f-13851f70abec admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.955636 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fe6cb-1bcd-4bf1-9ee5-77ef5eef85e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.956385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03d4cd-434f-4ad7-b29f-13851f70abec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.956625 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fe6cb-1bcd-4bf1-9ee5-77ef5eef85e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.956625 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fe6cb-1bcd-4bf1-9ee5-77ef5eef85e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.956779 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fe6cb-1bcd-4bf1-9ee5-77ef5eef85e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.957994 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03d4cd-434f-4ad7-b29f-13851f70abec admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.958987 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fe6cb-1bcd-4bf1-9ee5-77ef5eef85e2 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.987151 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 624/1262] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:03 2022] POST /identity/v3/users => generated 297 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:03.987151 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fe6cb-1bcd-4bf1-9ee5-77ef5eef85e2 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.987474 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 639/1263] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:03 2022] POST /identity/v3/users => generated 293 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:03.987474 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03d4cd-434f-4ad7-b29f-13851f70abec admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.997839 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03d4cd-434f-4ad7-b29f-13851f70abec admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:04.002401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516403b1-8643-41f6-92bd-5c1b5be2fdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:04.002978 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516403b1-8643-41f6-92bd-5c1b5be2fdfb admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.003257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516403b1-8643-41f6-92bd-5c1b5be2fdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.003556 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516403b1-8643-41f6-92bd-5c1b5be2fdfb admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.004172 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516403b1-8643-41f6-92bd-5c1b5be2fdfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:04.006059 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516403b1-8643-41f6-92bd-5c1b5be2fdfb admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:04.029659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 640/1264] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:03 2022] POST /identity/v3/users => generated 302 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:04.029659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516403b1-8643-41f6-92bd-5c1b5be2fdfb admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:04.037079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516403b1-8643-41f6-92bd-5c1b5be2fdfb admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:04.041710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d94a5-5864-437d-880e-b562ad75655c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:04.042284 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d94a5-5864-437d-880e-b562ad75655c admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.042560 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d94a5-5864-437d-880e-b562ad75655c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.042829 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d94a5-5864-437d-880e-b562ad75655c admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.043468 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d94a5-5864-437d-880e-b562ad75655c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:04.045037 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d94a5-5864-437d-880e-b562ad75655c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:04.045150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fe6cb-1bcd-4bf1-9ee5-77ef5eef85e2 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:04.049166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f08b4-886f-4e72-89f8-36b4a15631ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:04.049768 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f08b4-886f-4e72-89f8-36b4a15631ec service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.050492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f08b4-886f-4e72-89f8-36b4a15631ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.050772 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f08b4-886f-4e72-89f8-36b4a15631ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.054711 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 641/1265] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:04.055571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d94a5-5864-437d-880e-b562ad75655c admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:04.062261 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f08b4-886f-4e72-89f8-36b4a15631ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:04.063745 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f08b4-886f-4e72-89f8-36b4a15631ec service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:04.065181 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d94a5-5864-437d-880e-b562ad75655c admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:04.069691 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db319f38-df04-49ac-b8ab-cdbbc97820cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:04.070250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db319f38-df04-49ac-b8ab-cdbbc97820cb admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.070537 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db319f38-df04-49ac-b8ab-cdbbc97820cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.070786 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db319f38-df04-49ac-b8ab-cdbbc97820cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.071390 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db319f38-df04-49ac-b8ab-cdbbc97820cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:04.073657 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db319f38-df04-49ac-b8ab-cdbbc97820cb admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:04.073902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 625/1266] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:04.074676 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f08b4-886f-4e72-89f8-36b4a15631ec service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:04.083921 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f08b4-886f-4e72-89f8-36b4a15631ec service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:04.089966 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 642/1267] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:04.090108 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f95b7-d44d-46ed-8e29-b1210ffec879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:04.090108 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f95b7-d44d-46ed-8e29-b1210ffec879 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.090108 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f95b7-d44d-46ed-8e29-b1210ffec879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.090403 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f95b7-d44d-46ed-8e29-b1210ffec879 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.090882 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f95b7-d44d-46ed-8e29-b1210ffec879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:04.092395 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b04f54-3177-49d4-a663-7209c67cb3bd None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.092508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f95b7-d44d-46ed-8e29-b1210ffec879 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:04.092962 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b04f54-3177-49d4-a663-7209c67cb3bd None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.093787 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b04f54-3177-49d4-a663-7209c67cb3bd None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.096459 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 643/1268] 10.222.0.18 () {54 vars in 961 bytes} [Mon Oct 24 13:13:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:13:04.097489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b04f54-3177-49d4-a663-7209c67cb3bd None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:04.103471 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 626/1269] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:04.104413 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f95b7-d44d-46ed-8e29-b1210ffec879 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:04.114355 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f95b7-d44d-46ed-8e29-b1210ffec879 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:04.116410 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b04f54-3177-49d4-a663-7209c67cb3bd None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:04.119666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60869c-64d2-45db-80ca-a8a3f22dfd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:04.120378 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60869c-64d2-45db-80ca-a8a3f22dfd15 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.120672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60869c-64d2-45db-80ca-a8a3f22dfd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.121005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60869c-64d2-45db-80ca-a8a3f22dfd15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.121784 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60869c-64d2-45db-80ca-a8a3f22dfd15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:04.123018 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f497c-9ee2-4b13-8b30-9c357a75a2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:04.123385 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60869c-64d2-45db-80ca-a8a3f22dfd15 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:04.123683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f497c-9ee2-4b13-8b30-9c357a75a2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.123979 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f497c-9ee2-4b13-8b30-9c357a75a2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.124272 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f497c-9ee2-4b13-8b30-9c357a75a2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.124908 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f497c-9ee2-4b13-8b30-9c357a75a2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:04.126575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f497c-9ee2-4b13-8b30-9c357a75a2b9 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:04.142424 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 627/1270] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:04.142643 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 644/1271] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:04.142746 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60869c-64d2-45db-80ca-a8a3f22dfd15 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:04.142848 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f497c-9ee2-4b13-8b30-9c357a75a2b9 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:04.152856 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f497c-9ee2-4b13-8b30-9c357a75a2b9 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:04.153204 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60869c-64d2-45db-80ca-a8a3f22dfd15 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:04.157492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1da80-d1cc-4d19-950a-b9a4b8aa6bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:04.158117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1da80-d1cc-4d19-950a-b9a4b8aa6bee admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.158394 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1da80-d1cc-4d19-950a-b9a4b8aa6bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.158512 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351b2d2-ac40-4ceb-8d03-f28f263d34f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:04.158687 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1da80-d1cc-4d19-950a-b9a4b8aa6bee admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.159027 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351b2d2-ac40-4ceb-8d03-f28f263d34f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.159270 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351b2d2-ac40-4ceb-8d03-f28f263d34f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.159371 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1da80-d1cc-4d19-950a-b9a4b8aa6bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:04.159622 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351b2d2-ac40-4ceb-8d03-f28f263d34f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.160327 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351b2d2-ac40-4ceb-8d03-f28f263d34f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:04.160880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1da80-d1cc-4d19-950a-b9a4b8aa6bee admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:04.162222 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351b2d2-ac40-4ceb-8d03-f28f263d34f4 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:04.172047 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 645/1272] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:04.173038 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1da80-d1cc-4d19-950a-b9a4b8aa6bee admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:04.178830 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 628/1273] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:04.180191 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bfb73-cf84-4296-b91f-fc4584b25cdd None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.180493 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bfb73-cf84-4296-b91f-fc4584b25cdd None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.181918 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bfb73-cf84-4296-b91f-fc4584b25cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.185732 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1da80-d1cc-4d19-950a-b9a4b8aa6bee admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:04.191487 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24a7a8-f9d2-4776-8fe7-e1cbd3bab865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:04.193028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24a7a8-f9d2-4776-8fe7-e1cbd3bab865 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.193308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24a7a8-f9d2-4776-8fe7-e1cbd3bab865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.193578 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24a7a8-f9d2-4776-8fe7-e1cbd3bab865 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.194211 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24a7a8-f9d2-4776-8fe7-e1cbd3bab865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:04.195838 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24a7a8-f9d2-4776-8fe7-e1cbd3bab865 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:04.209034 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 646/1274] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:04.209888 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24a7a8-f9d2-4776-8fe7-e1cbd3bab865 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:04.220953 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24a7a8-f9d2-4776-8fe7-e1cbd3bab865 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:04.225781 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07403ef9-5681-4ee0-b05c-bb8205fdba3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:04.226382 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07403ef9-5681-4ee0-b05c-bb8205fdba3c admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.227080 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07403ef9-5681-4ee0-b05c-bb8205fdba3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.227080 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07403ef9-5681-4ee0-b05c-bb8205fdba3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.227606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07403ef9-5681-4ee0-b05c-bb8205fdba3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:04.229383 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07403ef9-5681-4ee0-b05c-bb8205fdba3c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:04.232031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-378bfb73-cf84-4296-b91f-fc4584b25cdd None None] MFA Rules not processed for user `4f6b27c7d052437a949a371169fb48ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:04.233522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-378bfb73-cf84-4296-b91f-fc4584b25cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:04.240726 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 647/1275] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:04.241864 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07403ef9-5681-4ee0-b05c-bb8205fdba3c admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:04.249002 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:04.255218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07403ef9-5681-4ee0-b05c-bb8205fdba3c admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:04.262305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc222ac-d82a-469f-851c-56c816a5af81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:04.263096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc222ac-d82a-469f-851c-56c816a5af81 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.263713 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc222ac-d82a-469f-851c-56c816a5af81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.263993 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc222ac-d82a-469f-851c-56c816a5af81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.264634 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc222ac-d82a-469f-851c-56c816a5af81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:04.266792 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc222ac-d82a-469f-851c-56c816a5af81 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:04.287547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 648/1276] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:04.292906 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc222ac-d82a-469f-851c-56c816a5af81 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:04.304207 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc222ac-d82a-469f-851c-56c816a5af81 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:04.310144 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b87b9-3179-42ed-bcf9-42339bded4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:04.310745 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b87b9-3179-42ed-bcf9-42339bded4fa admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.311024 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b87b9-3179-42ed-bcf9-42339bded4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.311471 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b87b9-3179-42ed-bcf9-42339bded4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.312117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b87b9-3179-42ed-bcf9-42339bded4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:04.314045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b87b9-3179-42ed-bcf9-42339bded4fa admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:04.325503 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 649/1277] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:04.326492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b87b9-3179-42ed-bcf9-42339bded4fa admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:04.331551 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 629/1278] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Oct 24 13:13:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:04.332701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bfb73-cf84-4296-b91f-fc4584b25cdd None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:04.336984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:04.345200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b87b9-3179-42ed-bcf9-42339bded4fa admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:04.347369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bfb73-cf84-4296-b91f-fc4584b25cdd None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:04.351313 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb487eb4-29a3-4158-9ff0-63f130a64be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:04.352060 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb487eb4-29a3-4158-9ff0-63f130a64be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.352362 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb487eb4-29a3-4158-9ff0-63f130a64be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.352753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb487eb4-29a3-4158-9ff0-63f130a64be8 admin admin] PATH_INFO: `/v3/projects/25c23861dee5471a8435b90b77530d96/users/3ef54a977abb4bc4a57d5a715327ade9/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.352953 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a3a31-ea28-4a5d-b404-79f74b52f526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:04.354198 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a3a31-ea28-4a5d-b404-79f74b52f526 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.354402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a3a31-ea28-4a5d-b404-79f74b52f526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.354665 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a3a31-ea28-4a5d-b404-79f74b52f526 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.355326 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a3a31-ea28-4a5d-b404-79f74b52f526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:04.356952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a3a31-ea28-4a5d-b404-79f74b52f526 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:04.368103 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 630/1279] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:04.369493 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a3a31-ea28-4a5d-b404-79f74b52f526 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:04.373670 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb487eb4-29a3-4158-9ff0-63f130a64be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25c23861dee5471a8435b90b77530d96, user_id=3ef54a977abb4bc4a57d5a715327ade9, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:04.376577 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb487eb4-29a3-4158-9ff0-63f130a64be8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:04.379678 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a3a31-ea28-4a5d-b404-79f74b52f526 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:04.384868 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c240b81-4e2d-403e-a15a-22e220474417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:04.385703 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c240b81-4e2d-403e-a15a-22e220474417 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.385980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c240b81-4e2d-403e-a15a-22e220474417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.386248 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c240b81-4e2d-403e-a15a-22e220474417 admin admin] PATH_INFO: `/v3/projects/8f061badb8f146559b21e0a4c9b780d2/users/ee6bc00495ae431ba92be399077b709b/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.401347 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 650/1280] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:04 2022] PUT /identity/v3/projects/25c23861dee5471a8435b90b77530d96/users/3ef54a977abb4bc4a57d5a715327ade9/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:04.401347 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb487eb4-29a3-4158-9ff0-63f130a64be8 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:04.410096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c240b81-4e2d-403e-a15a-22e220474417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f061badb8f146559b21e0a4c9b780d2, user_id=ee6bc00495ae431ba92be399077b709b, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:04.413730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c240b81-4e2d-403e-a15a-22e220474417 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:04.429581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 631/1281] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:04 2022] PUT /identity/v3/projects/8f061badb8f146559b21e0a4c9b780d2/users/ee6bc00495ae431ba92be399077b709b/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:04.430488 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c240b81-4e2d-403e-a15a-22e220474417 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:04.491392 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb487eb4-29a3-4158-9ff0-63f130a64be8 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:04.496921 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c240b81-4e2d-403e-a15a-22e220474417 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:04.497828 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2de351-2852-45b5-b9d4-29058202795f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:04.498489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2de351-2852-45b5-b9d4-29058202795f admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.498766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2de351-2852-45b5-b9d4-29058202795f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.499070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2de351-2852-45b5-b9d4-29058202795f admin admin] PATH_INFO: `/v3/projects/22c3f6f010f949409d1767ac551eefec/users/3b52c3ae1fff462899aa156fe978b03b/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.502920 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f8691-2db9-4d92-9d05-a03842fc498c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:04.503092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f8691-2db9-4d92-9d05-a03842fc498c admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.503229 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f8691-2db9-4d92-9d05-a03842fc498c admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.503583 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f8691-2db9-4d92-9d05-a03842fc498c admin admin] PATH_INFO: `/v3/projects/84e7ecf3a3884cb9a91aff698db8ae48/users/a2ec11f9ed9146c7a9d439bf99a1cb30/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.517587 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2de351-2852-45b5-b9d4-29058202795f admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c3f6f010f949409d1767ac551eefec, user_id=3b52c3ae1fff462899aa156fe978b03b, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:04.520357 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2de351-2852-45b5-b9d4-29058202795f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:04.521545 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f8691-2db9-4d92-9d05-a03842fc498c admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e7ecf3a3884cb9a91aff698db8ae48, user_id=a2ec11f9ed9146c7a9d439bf99a1cb30, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:04.524311 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f8691-2db9-4d92-9d05-a03842fc498c admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:04.542592 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 651/1282] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:04 2022] PUT /identity/v3/projects/22c3f6f010f949409d1767ac551eefec/users/3b52c3ae1fff462899aa156fe978b03b/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:04.542931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2de351-2852-45b5-b9d4-29058202795f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:04.547189 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 632/1283] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:04 2022] PUT /identity/v3/projects/84e7ecf3a3884cb9a91aff698db8ae48/users/a2ec11f9ed9146c7a9d439bf99a1cb30/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:04.548375 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f8691-2db9-4d92-9d05-a03842fc498c admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:04.614502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:04.620291 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2de351-2852-45b5-b9d4-29058202795f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:04.639284 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f8691-2db9-4d92-9d05-a03842fc498c admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:04.644792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffc413-cb83-4880-8176-c83c946114b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:04.645391 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffc413-cb83-4880-8176-c83c946114b4 service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.645666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffc413-cb83-4880-8176-c83c946114b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.645945 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffc413-cb83-4880-8176-c83c946114b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.687753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee57eab-268b-48fd-a059-74b72307afe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:04.688538 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee57eab-268b-48fd-a059-74b72307afe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.688818 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee57eab-268b-48fd-a059-74b72307afe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.689374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee57eab-268b-48fd-a059-74b72307afe9 admin admin] PATH_INFO: `/v3/projects/ff77096b3088490fb52dd53991e18336/users/a2ed22a974be4cfd86108df0b98c4d50/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.705837 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee57eab-268b-48fd-a059-74b72307afe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff77096b3088490fb52dd53991e18336, user_id=a2ed22a974be4cfd86108df0b98c4d50, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:04.708899 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee57eab-268b-48fd-a059-74b72307afe9 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:04.711352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:04.715651 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffc413-cb83-4880-8176-c83c946114b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:04.717790 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffc413-cb83-4880-8176-c83c946114b4 service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:04.725156 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 652/1284] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:04 2022] PUT /identity/v3/projects/ff77096b3088490fb52dd53991e18336/users/a2ed22a974be4cfd86108df0b98c4d50/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:04.725892 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee57eab-268b-48fd-a059-74b72307afe9 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:04.730006 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 633/1285] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:04.731368 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecb0ee-b5ac-4875-b687-301f44eedb8f None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.731748 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecb0ee-b5ac-4875-b687-301f44eedb8f None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.732514 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecb0ee-b5ac-4875-b687-301f44eedb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.770338 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-0cecb0ee-b5ac-4875-b687-301f44eedb8f None None] MFA Rules not processed for user `3ef54a977abb4bc4a57d5a715327ade9`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:04.772101 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-0cecb0ee-b5ac-4875-b687-301f44eedb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:04.810988 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee57eab-268b-48fd-a059-74b72307afe9 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:04.817783 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05956716-0031-489c-8e75-d31169261dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:04.818900 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05956716-0031-489c-8e75-d31169261dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.819697 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05956716-0031-489c-8e75-d31169261dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.820351 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05956716-0031-489c-8e75-d31169261dd1 admin admin] PATH_INFO: `/v3/projects/a854ab254a2945c3b66dd73a0f01ce15/users/3b7b6afc6c024a99aa3897abcfe867d0/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.849293 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05956716-0031-489c-8e75-d31169261dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a854ab254a2945c3b66dd73a0f01ce15, user_id=3b7b6afc6c024a99aa3897abcfe867d0, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:04.854623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05956716-0031-489c-8e75-d31169261dd1 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:04.879710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 634/1286] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:04.880987 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13de001-e975-48f4-9fc3-b4c225870279 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.881274 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13de001-e975-48f4-9fc3-b4c225870279 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.881549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13de001-e975-48f4-9fc3-b4c225870279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.885012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 653/1287] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:04 2022] PUT /identity/v3/projects/a854ab254a2945c3b66dd73a0f01ce15/users/3b7b6afc6c024a99aa3897abcfe867d0/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:04.887097 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e0720-8ae6-4b9a-a9b7-5a5607036b06 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.887613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e0720-8ae6-4b9a-a9b7-5a5607036b06 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.888090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e0720-8ae6-4b9a-a9b7-5a5607036b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.913566 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b46e0720-8ae6-4b9a-a9b7-5a5607036b06 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:04.915135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b46e0720-8ae6-4b9a-a9b7-5a5607036b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:04.934508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-b13de001-e975-48f4-9fc3-b4c225870279 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:04.941942 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b13de001-e975-48f4-9fc3-b4c225870279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:04.995932 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 654/1288] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:04.998374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b53e4-db7c-4376-95d7-79cc38c84015 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.998663 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b53e4-db7c-4376-95d7-79cc38c84015 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.998938 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b53e4-db7c-4376-95d7-79cc38c84015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:05.023914 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 635/1289] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:05.026210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99475b4c-6976-448e-a19e-7d9ccbb2608a None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:05.026597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99475b4c-6976-448e-a19e-7d9ccbb2608a None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:05.026876 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99475b4c-6976-448e-a19e-7d9ccbb2608a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:05.036966 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-806b53e4-db7c-4376-95d7-79cc38c84015 None None] MFA Rules not processed for user `a2ec11f9ed9146c7a9d439bf99a1cb30`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:05.038187 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-806b53e4-db7c-4376-95d7-79cc38c84015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:05.047760 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-99475b4c-6976-448e-a19e-7d9ccbb2608a None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:05.049644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-99475b4c-6976-448e-a19e-7d9ccbb2608a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:05.061557 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 636/1290] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:05.061557 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99475b4c-6976-448e-a19e-7d9ccbb2608a None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:05.075787 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99475b4c-6976-448e-a19e-7d9ccbb2608a None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:05.083494 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3743261-dd2f-429e-9969-9a6d53e3ba7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:05.084300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3743261-dd2f-429e-9969-9a6d53e3ba7b admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:05.084907 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3743261-dd2f-429e-9969-9a6d53e3ba7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:05.085248 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3743261-dd2f-429e-9969-9a6d53e3ba7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:05.086087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3743261-dd2f-429e-9969-9a6d53e3ba7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:05.089638 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3743261-dd2f-429e-9969-9a6d53e3ba7b admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:05.106184 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:05.132333 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 637/1291] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:05 2022] POST /identity/v3/projects => generated 365 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:05.135013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb06ec-bec7-40a0-a6d5-3d234cd9cf64 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:05.135765 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb06ec-bec7-40a0-a6d5-3d234cd9cf64 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:05.136089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb06ec-bec7-40a0-a6d5-3d234cd9cf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:05.149618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 655/1292] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:05.152524 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b53e4-db7c-4376-95d7-79cc38c84015 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:05.154497 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-806b53e4-db7c-4376-95d7-79cc38c84015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:05.160945 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-47eb06ec-bec7-40a0-a6d5-3d234cd9cf64 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:05.163303 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-47eb06ec-bec7-40a0-a6d5-3d234cd9cf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:05.167412 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:05.232841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b53e4-db7c-4376-95d7-79cc38c84015 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:05.239610 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 638/1293] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:05.239610 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b3021-8e8f-4dc9-a5b0-14cfbf7d5166 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:05.239610 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b3021-8e8f-4dc9-a5b0-14cfbf7d5166 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:05.239610 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b3021-8e8f-4dc9-a5b0-14cfbf7d5166 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:05.244001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 639/1294] 10.222.0.18 () {54 vars in 912 bytes} [Mon Oct 24 13:13:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:13:05.244713 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b3021-8e8f-4dc9-a5b0-14cfbf7d5166 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:05.308936 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcae6f-b0d6-455d-ab90-9ffd097ce65e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:05.310280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcae6f-b0d6-455d-ab90-9ffd097ce65e service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:05.311279 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcae6f-b0d6-455d-ab90-9ffd097ce65e service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:05.311714 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcae6f-b0d6-455d-ab90-9ffd097ce65e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:05.321358 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b3021-8e8f-4dc9-a5b0-14cfbf7d5166 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:05.326611 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcae6f-b0d6-455d-ab90-9ffd097ce65e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:05.326854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0932c-3d46-4395-a031-bd51c8455d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:05.327848 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0932c-3d46-4395-a031-bd51c8455d8d service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:05.328165 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcae6f-b0d6-455d-ab90-9ffd097ce65e service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:05.328487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0932c-3d46-4395-a031-bd51c8455d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:05.328904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0932c-3d46-4395-a031-bd51c8455d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:05.341440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 656/1295] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:05.342723 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcae6f-b0d6-455d-ab90-9ffd097ce65e service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:05.342932 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0932c-3d46-4395-a031-bd51c8455d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:05.344775 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0932c-3d46-4395-a031-bd51c8455d8d service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:05.353788 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcae6f-b0d6-455d-ab90-9ffd097ce65e service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:05.358103 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac196da-d5ae-4ccb-8b76-e4be89812119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:05.358583 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 640/1296] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:05.359050 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac196da-d5ae-4ccb-8b76-e4be89812119 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:05.359621 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac196da-d5ae-4ccb-8b76-e4be89812119 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:05.359789 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac196da-d5ae-4ccb-8b76-e4be89812119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:05.360900 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0932c-3d46-4395-a031-bd51c8455d8d service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:05.372607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac196da-d5ae-4ccb-8b76-e4be89812119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:05.374157 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac196da-d5ae-4ccb-8b76-e4be89812119 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:05.375324 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0932c-3d46-4395-a031-bd51c8455d8d service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:05.381115 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb5245-9954-4ecf-9bbb-0af0a916e18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:05.382254 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb5245-9954-4ecf-9bbb-0af0a916e18a admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:05.382574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb5245-9954-4ecf-9bbb-0af0a916e18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:05.382785 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb5245-9954-4ecf-9bbb-0af0a916e18a admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:05.383501 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb5245-9954-4ecf-9bbb-0af0a916e18a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:05.386025 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb5245-9954-4ecf-9bbb-0af0a916e18a admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:05.388165 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 657/1297] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:05.388983 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac196da-d5ae-4ccb-8b76-e4be89812119 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:05.403335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac196da-d5ae-4ccb-8b76-e4be89812119 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:05.409801 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917d8bb-05d8-42a8-8b7a-47e8c91876f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:05.411768 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917d8bb-05d8-42a8-8b7a-47e8c91876f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:05.412127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917d8bb-05d8-42a8-8b7a-47e8c91876f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:05.412409 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917d8bb-05d8-42a8-8b7a-47e8c91876f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:05.413126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917d8bb-05d8-42a8-8b7a-47e8c91876f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:05.415455 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917d8bb-05d8-42a8-8b7a-47e8c91876f1 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:05.422551 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 641/1298] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:05 2022] POST /identity/v3/users => generated 289 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:05.424265 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e6d85-9000-4c6f-87cc-10d537854f70 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:05.424548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e6d85-9000-4c6f-87cc-10d537854f70 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:05.425069 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e6d85-9000-4c6f-87cc-10d537854f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:05.451927 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-4d5e6d85-9000-4c6f-87cc-10d537854f70 None None] MFA Rules not processed for user `4f6b27c7d052437a949a371169fb48ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:05.453179 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-4d5e6d85-9000-4c6f-87cc-10d537854f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:05.458699 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 658/1299] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:05 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:05.460373 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917d8bb-05d8-42a8-8b7a-47e8c91876f1 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:05.619513 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917d8bb-05d8-42a8-8b7a-47e8c91876f1 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:05.626358 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 642/1300] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 24 13:13:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:05.628930 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7bb96-8a23-4e8d-9c42-3d4b4574e9cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:05.629128 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e6d85-9000-4c6f-87cc-10d537854f70 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:05.630755 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7bb96-8a23-4e8d-9c42-3d4b4574e9cf service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:05.642286 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7bb96-8a23-4e8d-9c42-3d4b4574e9cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:05.642730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7bb96-8a23-4e8d-9c42-3d4b4574e9cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:05.656715 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e6d85-9000-4c6f-87cc-10d537854f70 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:05.669451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:05.760173 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:05.766620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb015a0-93a5-4808-9a91-dba147c59f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:05.767653 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb015a0-93a5-4808-9a91-dba147c59f93 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:05.767968 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb015a0-93a5-4808-9a91-dba147c59f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:05.768220 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb015a0-93a5-4808-9a91-dba147c59f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:05.769437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb015a0-93a5-4808-9a91-dba147c59f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:05.771887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb015a0-93a5-4808-9a91-dba147c59f93 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:05.787271 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7bb96-8a23-4e8d-9c42-3d4b4574e9cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:05.792085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7bb96-8a23-4e8d-9c42-3d4b4574e9cf service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:05.795521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 643/1301] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:05.796647 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb015a0-93a5-4808-9a91-dba147c59f93 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:05.813113 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb015a0-93a5-4808-9a91-dba147c59f93 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:05.820517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 659/1302] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:05.821188 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69792c2f-fc35-420a-9482-69b4249d7a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:05.823665 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69792c2f-fc35-420a-9482-69b4249d7a58 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:05.824133 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69792c2f-fc35-420a-9482-69b4249d7a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:05.824503 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69792c2f-fc35-420a-9482-69b4249d7a58 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:05.825447 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7bb96-8a23-4e8d-9c42-3d4b4574e9cf service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:05.825577 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69792c2f-fc35-420a-9482-69b4249d7a58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:05.827913 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69792c2f-fc35-420a-9482-69b4249d7a58 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:05.862275 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 644/1303] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:05 2022] POST /identity/v3/users => generated 293 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:05.867276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69792c2f-fc35-420a-9482-69b4249d7a58 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:05.901238 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69792c2f-fc35-420a-9482-69b4249d7a58 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:05.912743 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8821d-2e57-4ef2-a07c-93658fa6ddb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:05.913697 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8821d-2e57-4ef2-a07c-93658fa6ddb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:05.913999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8821d-2e57-4ef2-a07c-93658fa6ddb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:05.914396 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8821d-2e57-4ef2-a07c-93658fa6ddb7 admin admin] PATH_INFO: `/v3/projects/4776d42b6da24977a0b4d5d9211f0363/users/4f58592e75a34472b86a4fc86d8cc693/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:05.937749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7bb96-8a23-4e8d-9c42-3d4b4574e9cf service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:05.943105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8821d-2e57-4ef2-a07c-93658fa6ddb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4776d42b6da24977a0b4d5d9211f0363, user_id=4f58592e75a34472b86a4fc86d8cc693, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:05.947748 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8821d-2e57-4ef2-a07c-93658fa6ddb7 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:05.948571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2000a31-e687-49c8-86bf-674c3a667ace service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:05.951000 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2000a31-e687-49c8-86bf-674c3a667ace service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:05.951369 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2000a31-e687-49c8-86bf-674c3a667ace service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:05.951777 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2000a31-e687-49c8-86bf-674c3a667ace service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:05.991542 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 645/1304] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:05 2022] PUT /identity/v3/projects/4776d42b6da24977a0b4d5d9211f0363/users/4f58592e75a34472b86a4fc86d8cc693/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:05.993430 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8821d-2e57-4ef2-a07c-93658fa6ddb7 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:06.137702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2000a31-e687-49c8-86bf-674c3a667ace service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:06.141991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2000a31-e687-49c8-86bf-674c3a667ace service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:06.155233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8821d-2e57-4ef2-a07c-93658fa6ddb7 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:06.170274 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ee4a9-5815-4a02-a796-c79ae40c3165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:06.172296 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ee4a9-5815-4a02-a796-c79ae40c3165 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:06.172597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ee4a9-5815-4a02-a796-c79ae40c3165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:06.172898 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ee4a9-5815-4a02-a796-c79ae40c3165 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:06.174823 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ee4a9-5815-4a02-a796-c79ae40c3165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:06.175288 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 660/1305] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:06.178670 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ee4a9-5815-4a02-a796-c79ae40c3165 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:06.179225 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2000a31-e687-49c8-86bf-674c3a667ace service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:06.286200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2000a31-e687-49c8-86bf-674c3a667ace service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:06.289789 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 646/1306] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:06.289789 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ee4a9-5815-4a02-a796-c79ae40c3165 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:06.290115 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec0995-0fe2-4ee2-be0f-cb8349af5dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:06.290115 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec0995-0fe2-4ee2-be0f-cb8349af5dcb admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:06.290115 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec0995-0fe2-4ee2-be0f-cb8349af5dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:06.304213 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec0995-0fe2-4ee2-be0f-cb8349af5dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:06.307587 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec0995-0fe2-4ee2-be0f-cb8349af5dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:06.311006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec0995-0fe2-4ee2-be0f-cb8349af5dcb admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:06.327080 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ee4a9-5815-4a02-a796-c79ae40c3165 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:06.349984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f5859-d7c1-4aab-a305-9949db6c3de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:06.350679 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f5859-d7c1-4aab-a305-9949db6c3de9 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:06.351047 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f5859-d7c1-4aab-a305-9949db6c3de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:06.351390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f5859-d7c1-4aab-a305-9949db6c3de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:06.351983 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 661/1307] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:06.352799 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f5859-d7c1-4aab-a305-9949db6c3de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:06.354120 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec0995-0fe2-4ee2-be0f-cb8349af5dcb admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:06.357672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f5859-d7c1-4aab-a305-9949db6c3de9 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:06.379626 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec0995-0fe2-4ee2-be0f-cb8349af5dcb admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:06.386811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 647/1308] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:06.389984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f5859-d7c1-4aab-a305-9949db6c3de9 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:06.394654 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353b813-cee1-4fa5-8ab1-89c987c773fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:06.396506 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353b813-cee1-4fa5-8ab1-89c987c773fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:06.398182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353b813-cee1-4fa5-8ab1-89c987c773fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:06.399816 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353b813-cee1-4fa5-8ab1-89c987c773fd admin admin] PATH_INFO: `/v3/projects/4776d42b6da24977a0b4d5d9211f0363/users/4f58592e75a34472b86a4fc86d8cc693/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:06.403823 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353b813-cee1-4fa5-8ab1-89c987c773fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4776d42b6da24977a0b4d5d9211f0363, user_id=4f58592e75a34472b86a4fc86d8cc693, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:06.413066 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353b813-cee1-4fa5-8ab1-89c987c773fd admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:06.416780 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f5859-d7c1-4aab-a305-9949db6c3de9 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:06.429029 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17dd341-c2e4-4a5b-9009-7106157cd564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:06.429718 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dd341-c2e4-4a5b-9009-7106157cd564 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:06.430000 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dd341-c2e4-4a5b-9009-7106157cd564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:06.430276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dd341-c2e4-4a5b-9009-7106157cd564 admin admin] PATH_INFO: `/v3/projects/d7c95b82fd254af3b9d8cac5e1f94999/users/502ab07a2372421eaf35942137373b5f/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:06.449781 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 662/1309] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:06 2022] PUT /identity/v3/projects/4776d42b6da24977a0b4d5d9211f0363/users/4f58592e75a34472b86a4fc86d8cc693/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:06.453308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f737d-1dc9-4f26-8e8d-c7ad6cc78c27 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:06.453599 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f737d-1dc9-4f26-8e8d-c7ad6cc78c27 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:06.453876 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f737d-1dc9-4f26-8e8d-c7ad6cc78c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:06.474118 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17dd341-c2e4-4a5b-9009-7106157cd564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c95b82fd254af3b9d8cac5e1f94999, user_id=502ab07a2372421eaf35942137373b5f, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:06.476990 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17dd341-c2e4-4a5b-9009-7106157cd564 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:06.504400 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-9d7f737d-1dc9-4f26-8e8d-c7ad6cc78c27 None None] MFA Rules not processed for user `4f58592e75a34472b86a4fc86d8cc693`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:06.506465 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9d7f737d-1dc9-4f26-8e8d-c7ad6cc78c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:06.508476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 648/1310] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:06 2022] PUT /identity/v3/projects/d7c95b82fd254af3b9d8cac5e1f94999/users/502ab07a2372421eaf35942137373b5f/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:06.519979 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4c1d2-5d6b-44f6-a80f-73980fbb1302 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:06.521421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4c1d2-5d6b-44f6-a80f-73980fbb1302 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:06.521421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4c1d2-5d6b-44f6-a80f-73980fbb1302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:06.586175 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-b0f4c1d2-5d6b-44f6-a80f-73980fbb1302 None None] MFA Rules not processed for user `502ab07a2372421eaf35942137373b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:06.587586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b0f4c1d2-5d6b-44f6-a80f-73980fbb1302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:06.588101 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:06.614044 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:06.649362 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 663/1311] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:06.650605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f737d-1dc9-4f26-8e8d-c7ad6cc78c27 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:06.763505 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 649/1312] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:06.767677 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4c1d2-5d6b-44f6-a80f-73980fbb1302 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:06.797318 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f737d-1dc9-4f26-8e8d-c7ad6cc78c27 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:06.811597 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c498e35-32e7-4165-99a3-931e0af93eb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:06.812993 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c498e35-32e7-4165-99a3-931e0af93eb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:06.813485 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c498e35-32e7-4165-99a3-931e0af93eb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:06.813958 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c498e35-32e7-4165-99a3-931e0af93eb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:06.835018 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c498e35-32e7-4165-99a3-931e0af93eb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:06.836812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c498e35-32e7-4165-99a3-931e0af93eb4 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:06.865362 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 664/1313] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:06.930013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4c1d2-5d6b-44f6-a80f-73980fbb1302 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:06.938662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecd71e-765d-4f94-b079-e38b6c1434c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:06.940474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecd71e-765d-4f94-b079-e38b6c1434c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:06.940746 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecd71e-765d-4f94-b079-e38b6c1434c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:06.941011 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecd71e-765d-4f94-b079-e38b6c1434c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:06.943387 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ecd71e-765d-4f94-b079-e38b6c1434c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:06.946382 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ecd71e-765d-4f94-b079-e38b6c1434c6 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:06.982833 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c498e35-32e7-4165-99a3-931e0af93eb4 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:06.996046 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c498e35-32e7-4165-99a3-931e0af93eb4 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:07.014526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812291d-8183-4a74-a4c4-0cda61e4d911 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:07.015168 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 650/1314] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:06 2022] POST /identity/v3/projects => generated 385 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:07.015741 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812291d-8183-4a74-a4c4-0cda61e4d911 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:07.016592 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812291d-8183-4a74-a4c4-0cda61e4d911 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:07.017042 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812291d-8183-4a74-a4c4-0cda61e4d911 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:07.018289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecd71e-765d-4f94-b079-e38b6c1434c6 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:07.169888 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecd71e-765d-4f94-b079-e38b6c1434c6 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:07.174882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812291d-8183-4a74-a4c4-0cda61e4d911 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:07.176570 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812291d-8183-4a74-a4c4-0cda61e4d911 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:07.200663 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ba61c-465f-4e80-986a-6b0ce3c19ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:07.201773 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ba61c-465f-4e80-986a-6b0ce3c19ffb admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:07.201773 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ba61c-465f-4e80-986a-6b0ce3c19ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:07.202006 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ba61c-465f-4e80-986a-6b0ce3c19ffb admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:07.202913 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ba61c-465f-4e80-986a-6b0ce3c19ffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:07.205720 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ba61c-465f-4e80-986a-6b0ce3c19ffb admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:07.229188 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 665/1315] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:07.285289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 651/1316] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:07 2022] POST /identity/v3/users => generated 299 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:07.289738 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812291d-8183-4a74-a4c4-0cda61e4d911 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:07.328631 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812291d-8183-4a74-a4c4-0cda61e4d911 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:07.346092 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486ace9-593c-49b6-ad1b-125c319a0d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:07.346730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486ace9-593c-49b6-ad1b-125c319a0d6e admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:07.347019 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486ace9-593c-49b6-ad1b-125c319a0d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:07.347299 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486ace9-593c-49b6-ad1b-125c319a0d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:07.352000 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486ace9-593c-49b6-ad1b-125c319a0d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:07.360940 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486ace9-593c-49b6-ad1b-125c319a0d6e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:07.393217 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 666/1317] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:07.400502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ba61c-465f-4e80-986a-6b0ce3c19ffb admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:07.433650 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ba61c-465f-4e80-986a-6b0ce3c19ffb admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:07.479181 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa5550-6c68-4710-9aff-cbb7559db9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:07.479902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa5550-6c68-4710-9aff-cbb7559db9bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:07.480184 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa5550-6c68-4710-9aff-cbb7559db9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:07.480457 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa5550-6c68-4710-9aff-cbb7559db9bf admin admin] PATH_INFO: `/v3/projects/9b3b639867d3487982ca69a34c9f1e24/users/a302493a3b494d41930c4e9bc99c1640/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:07.514255 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa5550-6c68-4710-9aff-cbb7559db9bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b3b639867d3487982ca69a34c9f1e24, user_id=a302493a3b494d41930c4e9bc99c1640, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:07.517900 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa5550-6c68-4710-9aff-cbb7559db9bf admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:07.544883 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 652/1318] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:07 2022] PUT /identity/v3/projects/9b3b639867d3487982ca69a34c9f1e24/users/a302493a3b494d41930c4e9bc99c1640/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:07.553773 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486ace9-593c-49b6-ad1b-125c319a0d6e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:07.566826 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486ace9-593c-49b6-ad1b-125c319a0d6e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:07.705720 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b0780-0252-41d9-81d9-563ee4c75d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:07.706351 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b0780-0252-41d9-81d9-563ee4c75d03 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:07.706634 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b0780-0252-41d9-81d9-563ee4c75d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:07.707171 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b0780-0252-41d9-81d9-563ee4c75d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:07.708767 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b0780-0252-41d9-81d9-563ee4c75d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:07.710404 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b0780-0252-41d9-81d9-563ee4c75d03 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:07.724160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 667/1319] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:13:07.729370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa5550-6c68-4710-9aff-cbb7559db9bf admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:07.737009 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:07.742553 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa5550-6c68-4710-9aff-cbb7559db9bf admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:07.758619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d65e0-c173-4869-8183-0ea080475f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:07.759223 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d65e0-c173-4869-8183-0ea080475f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:07.761641 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d65e0-c173-4869-8183-0ea080475f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:07.762022 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d65e0-c173-4869-8183-0ea080475f4e admin admin] PATH_INFO: `/v3/projects/9b3b639867d3487982ca69a34c9f1e24/users/a302493a3b494d41930c4e9bc99c1640/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:07.767950 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d65e0-c173-4869-8183-0ea080475f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b3b639867d3487982ca69a34c9f1e24, user_id=a302493a3b494d41930c4e9bc99c1640, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:07.772738 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d65e0-c173-4869-8183-0ea080475f4e admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:07.802940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 653/1320] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:07 2022] PUT /identity/v3/projects/9b3b639867d3487982ca69a34c9f1e24/users/a302493a3b494d41930c4e9bc99c1640/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:07.814786 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7bbb2-2ff8-4b57-8961-e461e6f80ca5 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:07.815185 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7bbb2-2ff8-4b57-8961-e461e6f80ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:07.815678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7bbb2-2ff8-4b57-8961-e461e6f80ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:07.855569 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:07.867609 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee788c-3b9d-4435-a973-c46c1244e9eb None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:07.867900 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee788c-3b9d-4435-a973-c46c1244e9eb None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:07.868207 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee788c-3b9d-4435-a973-c46c1244e9eb None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:07.871715 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 654/1321] 10.222.0.18 () {54 vars in 961 bytes} [Mon Oct 24 13:13:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:13:07.880667 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e3c23-5351-4e52-b04f-f2e2729622bb None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:07.881005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e3c23-5351-4e52-b04f-f2e2729622bb None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:07.881287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e3c23-5351-4e52-b04f-f2e2729622bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:07.907945 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-19f7bbb2-2ff8-4b57-8961-e461e6f80ca5 None None] MFA Rules not processed for user `a302493a3b494d41930c4e9bc99c1640`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:07.912436 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-19f7bbb2-2ff8-4b57-8961-e461e6f80ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:07.933319 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-1d8e3c23-5351-4e52-b04f-f2e2729622bb None None] MFA Rules not processed for user `4f6b27c7d052437a949a371169fb48ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:07.934731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-1d8e3c23-5351-4e52-b04f-f2e2729622bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:08.045204 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 655/1322] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Oct 24 13:13:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:08.050906 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce5f19-2103-40ae-803a-a47e407b5f48 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:08.051215 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce5f19-2103-40ae-803a-a47e407b5f48 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:08.051709 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce5f19-2103-40ae-803a-a47e407b5f48 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:08.053089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 656/1323] 10.222.0.18 () {54 vars in 912 bytes} [Mon Oct 24 13:13:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:13:08.059792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839eabf-f4c7-43fa-a624-e470c9ec37a7 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:08.060438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839eabf-f4c7-43fa-a624-e470c9ec37a7 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:08.061067 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839eabf-f4c7-43fa-a624-e470c9ec37a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:08.098721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-3839eabf-f4c7-43fa-a624-e470c9ec37a7 None None] MFA Rules not processed for user `4f6b27c7d052437a949a371169fb48ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:08.104118 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-3839eabf-f4c7-43fa-a624-e470c9ec37a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:08.108529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 668/1324] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:08.120691 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7bbb2-2ff8-4b57-8961-e461e6f80ca5 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:08.148089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 657/1325] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 24 13:13:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:08.266099 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839eabf-f4c7-43fa-a624-e470c9ec37a7 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:08.308614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7bbb2-2ff8-4b57-8961-e461e6f80ca5 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:08.320821 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c497afe-05e3-4e63-9800-525baac413e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:08.321466 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c497afe-05e3-4e63-9800-525baac413e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:08.322276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c497afe-05e3-4e63-9800-525baac413e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:08.322562 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c497afe-05e3-4e63-9800-525baac413e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:08.347268 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c497afe-05e3-4e63-9800-525baac413e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:08.352843 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c497afe-05e3-4e63-9800-525baac413e4 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:08.380367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 669/1326] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:08.384186 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839eabf-f4c7-43fa-a624-e470c9ec37a7 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:08.389929 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f5c2c-a702-48a7-a107-408122011de6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:08.390610 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f5c2c-a702-48a7-a107-408122011de6 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:08.390882 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f5c2c-a702-48a7-a107-408122011de6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:08.391163 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f5c2c-a702-48a7-a107-408122011de6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:08.433399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f5c2c-a702-48a7-a107-408122011de6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:08.434988 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f5c2c-a702-48a7-a107-408122011de6 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:08.458372 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 658/1327] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:13:09.545054 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068a3b3-74c6-4854-88f0-cc3a7143f1db None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:09.545539 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068a3b3-74c6-4854-88f0-cc3a7143f1db None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:09.545684 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068a3b3-74c6-4854-88f0-cc3a7143f1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:09.610671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-3068a3b3-74c6-4854-88f0-cc3a7143f1db None None] MFA Rules not processed for user `3b7b6afc6c024a99aa3897abcfe867d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:09.611920 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3068a3b3-74c6-4854-88f0-cc3a7143f1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:09.867079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 670/1328] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:09 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:09.872480 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f5c2c-a702-48a7-a107-408122011de6 service cinder] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:10.082941 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f5c2c-a702-48a7-a107-408122011de6 service cinder] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:10.096482 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90011a1-0603-431b-9586-9d5e961d0e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:10.097127 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90011a1-0603-431b-9586-9d5e961d0e37 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:10.098680 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90011a1-0603-431b-9586-9d5e961d0e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:10.098958 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90011a1-0603-431b-9586-9d5e961d0e37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:10.099632 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90011a1-0603-431b-9586-9d5e961d0e37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:10.108566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90011a1-0603-431b-9586-9d5e961d0e37 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:10.153904 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068a3b3-74c6-4854-88f0-cc3a7143f1db None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:10.168628 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 659/1329] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:09 2022] POST /identity/v3/projects => generated 403 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:10.169580 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90011a1-0603-431b-9586-9d5e961d0e37 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:10.174143 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068a3b3-74c6-4854-88f0-cc3a7143f1db None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:10.175461 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:10.238619 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:10.295993 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24ffef-27c1-4786-b121-88edb26fcb9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:10.296522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90011a1-0603-431b-9586-9d5e961d0e37 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:10.296654 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24ffef-27c1-4786-b121-88edb26fcb9f service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:10.296878 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24ffef-27c1-4786-b121-88edb26fcb9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:10.297156 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24ffef-27c1-4786-b121-88edb26fcb9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:10.308822 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917f89c-653c-4f5c-ba28-1dee7988aeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:10.309518 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917f89c-653c-4f5c-ba28-1dee7988aeda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:10.309804 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917f89c-653c-4f5c-ba28-1dee7988aeda admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:10.310081 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917f89c-653c-4f5c-ba28-1dee7988aeda admin admin] PATH_INFO: `/v3/users/8ff80e291bf5407089c2a00a38133b52` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:10.316279 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917f89c-653c-4f5c-ba28-1dee7988aeda admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff80e291bf5407089c2a00a38133b52)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:10.317910 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917f89c-653c-4f5c-ba28-1dee7988aeda admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:10.454438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f917f89c-653c-4f5c-ba28-1dee7988aeda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff80e291bf5407089c2a00a38133b52'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.472021 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24ffef-27c1-4786-b121-88edb26fcb9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:10.472602 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f917f89c-653c-4f5c-ba28-1dee7988aeda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff80e291bf5407089c2a00a38133b52'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.475905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24ffef-27c1-4786-b121-88edb26fcb9f service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:10.487840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f917f89c-653c-4f5c-ba28-1dee7988aeda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff80e291bf5407089c2a00a38133b52'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.509048 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 671/1330] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:13:10.510942 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24ffef-27c1-4786-b121-88edb26fcb9f service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:10.513442 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f917f89c-653c-4f5c-ba28-1dee7988aeda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff80e291bf5407089c2a00a38133b52'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.514214 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f917f89c-653c-4f5c-ba28-1dee7988aeda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff80e291bf5407089c2a00a38133b52'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.527506 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 660/1331] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:10 2022] DELETE /identity/v3/users/8ff80e291bf5407089c2a00a38133b52 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:10.528458 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24ffef-27c1-4786-b121-88edb26fcb9f service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:10.532916 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71da07-7b88-4fb3-bb0b-74103a5dc5d6 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:10.533204 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71da07-7b88-4fb3-bb0b-74103a5dc5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:10.533474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71da07-7b88-4fb3-bb0b-74103a5dc5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:10.588851 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-1d71da07-7b88-4fb3-bb0b-74103a5dc5d6 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:10.594965 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-1d71da07-7b88-4fb3-bb0b-74103a5dc5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:10.710363 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d5e20-c93d-4a90-a945-dad27b71f934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:10.732691 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d5e20-c93d-4a90-a945-dad27b71f934 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:10.734613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d5e20-c93d-4a90-a945-dad27b71f934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:10.735116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d5e20-c93d-4a90-a945-dad27b71f934 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:10.736594 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d5e20-c93d-4a90-a945-dad27b71f934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:10.741973 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d5e20-c93d-4a90-a945-dad27b71f934 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:10.799329 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 661/1332] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:10.808682 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 672/1333] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:10 2022] POST /identity/v3/users => generated 308 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:10.811298 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71da07-7b88-4fb3-bb0b-74103a5dc5d6 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:10.817672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-1d71da07-7b88-4fb3-bb0b-74103a5dc5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:10.840233 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d5e20-c93d-4a90-a945-dad27b71f934 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:10.845263 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4b2d5e20-c93d-4a90-a945-dad27b71f934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:10.867501 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71da07-7b88-4fb3-bb0b-74103a5dc5d6 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:10.888120 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23605908-8d3e-41f3-b8ab-0eeffa31568f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:10.889110 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23605908-8d3e-41f3-b8ab-0eeffa31568f admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:10.889635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23605908-8d3e-41f3-b8ab-0eeffa31568f admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:10.889913 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23605908-8d3e-41f3-b8ab-0eeffa31568f admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:10.890581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23605908-8d3e-41f3-b8ab-0eeffa31568f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:10.892254 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23605908-8d3e-41f3-b8ab-0eeffa31568f admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:10.921573 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 662/1334] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:10.923290 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23605908-8d3e-41f3-b8ab-0eeffa31568f admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:10.939604 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23605908-8d3e-41f3-b8ab-0eeffa31568f admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:10.952089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0dac10-f07a-45a1-999b-17d1f8d80b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:10.952770 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0dac10-f07a-45a1-999b-17d1f8d80b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:10.953050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0dac10-f07a-45a1-999b-17d1f8d80b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:10.953322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0dac10-f07a-45a1-999b-17d1f8d80b92 admin admin] PATH_INFO: `/v3/projects/c28295e469f44dfd8ea399670f4d5531/users/4a0d83b5a3e349139eb7347f7e95b767/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:10.975221 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:10.985984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0dac10-f07a-45a1-999b-17d1f8d80b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c28295e469f44dfd8ea399670f4d5531, user_id=4a0d83b5a3e349139eb7347f7e95b767, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:10.995818 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0dac10-f07a-45a1-999b-17d1f8d80b92 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:11.031980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 663/1335] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:10 2022] PUT /identity/v3/projects/c28295e469f44dfd8ea399670f4d5531/users/4a0d83b5a3e349139eb7347f7e95b767/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:11.036113 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0dac10-f07a-45a1-999b-17d1f8d80b92 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:11.082978 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d5e20-c93d-4a90-a945-dad27b71f934 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:11.146563 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:11.199819 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0dac10-f07a-45a1-999b-17d1f8d80b92 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:11.214995 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2d33f-0555-49b1-8bbb-ee69cdf83fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:11.217284 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2d33f-0555-49b1-8bbb-ee69cdf83fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:11.218060 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2d33f-0555-49b1-8bbb-ee69cdf83fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:11.219073 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2d33f-0555-49b1-8bbb-ee69cdf83fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:11.220615 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2d33f-0555-49b1-8bbb-ee69cdf83fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:11.221464 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514e2ae-fe7a-411b-8c08-2037ef033eda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:11.222090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514e2ae-fe7a-411b-8c08-2037ef033eda service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:11.222370 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514e2ae-fe7a-411b-8c08-2037ef033eda service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:11.222643 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514e2ae-fe7a-411b-8c08-2037ef033eda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:11.225926 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2d33f-0555-49b1-8bbb-ee69cdf83fd3 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:11.246961 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514e2ae-fe7a-411b-8c08-2037ef033eda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:11.248495 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514e2ae-fe7a-411b-8c08-2037ef033eda service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:11.264239 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 664/1336] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:13:11.266518 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2d33f-0555-49b1-8bbb-ee69cdf83fd3 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:11.269734 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 673/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:11.288178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2d33f-0555-49b1-8bbb-ee69cdf83fd3 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:11.295723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2c876-4f96-4a97-991c-d5584f9b2cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:11.296648 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2c876-4f96-4a97-991c-d5584f9b2cba admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:11.297141 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2c876-4f96-4a97-991c-d5584f9b2cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:11.297599 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2c876-4f96-4a97-991c-d5584f9b2cba admin admin] PATH_INFO: `/v3/projects/c28295e469f44dfd8ea399670f4d5531/users/4a0d83b5a3e349139eb7347f7e95b767/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:11.300515 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2c876-4f96-4a97-991c-d5584f9b2cba admin admin] RBAC: Authorizing `identity:create_grant(project_id=c28295e469f44dfd8ea399670f4d5531, user_id=4a0d83b5a3e349139eb7347f7e95b767, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:11.303549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2c876-4f96-4a97-991c-d5584f9b2cba admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:11.327216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 665/1338] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:11 2022] PUT /identity/v3/projects/c28295e469f44dfd8ea399670f4d5531/users/4a0d83b5a3e349139eb7347f7e95b767/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:12.097876 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514e2ae-fe7a-411b-8c08-2037ef033eda service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:12.099316 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c514e2ae-fe7a-411b-8c08-2037ef033eda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:12.126081 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514e2ae-fe7a-411b-8c08-2037ef033eda service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:12.312084 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e7a7e-d38a-41a7-beb7-cfa3a99b779f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:12.312817 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e7a7e-d38a-41a7-beb7-cfa3a99b779f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:12.313321 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e7a7e-d38a-41a7-beb7-cfa3a99b779f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:12.313651 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e7a7e-d38a-41a7-beb7-cfa3a99b779f admin admin] PATH_INFO: `/v3/users/3ef54a977abb4bc4a57d5a715327ade9` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:12.314810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e7a7e-d38a-41a7-beb7-cfa3a99b779f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef54a977abb4bc4a57d5a715327ade9)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:12.316061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: WARNING py.warnings [None req-d20e7a7e-d38a-41a7-beb7-cfa3a99b779f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:13:12.316061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: warnings.warn(msg) Oct 24 13:13:12.316061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: Oct 24 13:13:12.322357 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e7a7e-d38a-41a7-beb7-cfa3a99b779f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:12.519668 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d20e7a7e-d38a-41a7-beb7-cfa3a99b779f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef54a977abb4bc4a57d5a715327ade9'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:12.552816 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d20e7a7e-d38a-41a7-beb7-cfa3a99b779f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef54a977abb4bc4a57d5a715327ade9'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:12.621943 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d20e7a7e-d38a-41a7-beb7-cfa3a99b779f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef54a977abb4bc4a57d5a715327ade9'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:12.656936 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d20e7a7e-d38a-41a7-beb7-cfa3a99b779f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef54a977abb4bc4a57d5a715327ade9'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:12.657671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d20e7a7e-d38a-41a7-beb7-cfa3a99b779f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef54a977abb4bc4a57d5a715327ade9'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:12.674659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 674/1339] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:12 2022] DELETE /identity/v3/users/3ef54a977abb4bc4a57d5a715327ade9 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:12.680291 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08d498-d267-4384-a273-cc688358b721 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:12.680803 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08d498-d267-4384-a273-cc688358b721 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:12.680906 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08d498-d267-4384-a273-cc688358b721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:12.752341 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-2e08d498-d267-4384-a273-cc688358b721 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:12.763347 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-2e08d498-d267-4384-a273-cc688358b721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:13.014871 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 666/1340] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:13.230296 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e7a7e-d38a-41a7-beb7-cfa3a99b779f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:13.241337 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d20e7a7e-d38a-41a7-beb7-cfa3a99b779f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:13.437481 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:13.450164 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e7a7e-d38a-41a7-beb7-cfa3a99b779f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:13.457761 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb877daa-901c-460f-9771-83a453456d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:13.459009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb877daa-901c-460f-9771-83a453456d2c service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:13.461313 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb877daa-901c-460f-9771-83a453456d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:13.463483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb877daa-901c-460f-9771-83a453456d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:13.482209 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb877daa-901c-460f-9771-83a453456d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:13.487191 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb877daa-901c-460f-9771-83a453456d2c service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:13.507563 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 675/1341] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:14.192183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08d498-d267-4384-a273-cc688358b721 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:14.195087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-2e08d498-d267-4384-a273-cc688358b721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:14.231574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08d498-d267-4384-a273-cc688358b721 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:14.266915 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adace10a-295d-4c02-8f20-24403d0cd07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:14.267890 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adace10a-295d-4c02-8f20-24403d0cd07c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:14.268399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adace10a-295d-4c02-8f20-24403d0cd07c admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:14.268900 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adace10a-295d-4c02-8f20-24403d0cd07c admin admin] PATH_INFO: `/v3/projects/38a10f7328d44c6499e020998ee0488b` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:14.271631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adace10a-295d-4c02-8f20-24403d0cd07c admin admin] RBAC: Authorizing `identity:delete_project(project_id=38a10f7328d44c6499e020998ee0488b)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:14.280473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: WARNING py.warnings [None req-adace10a-295d-4c02-8f20-24403d0cd07c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:13:14.280473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: warnings.warn(msg) Oct 24 13:13:14.280473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: Oct 24 13:13:14.282672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adace10a-295d-4c02-8f20-24403d0cd07c admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:14.416372 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-adace10a-295d-4c02-8f20-24403d0cd07c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38a10f7328d44c6499e020998ee0488b', 'request_id': 'req-adace10a-295d-4c02-8f20-24403d0cd07c'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:14.441307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-adace10a-295d-4c02-8f20-24403d0cd07c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38a10f7328d44c6499e020998ee0488b', 'request_id': 'req-adace10a-295d-4c02-8f20-24403d0cd07c'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:14.456312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-adace10a-295d-4c02-8f20-24403d0cd07c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38a10f7328d44c6499e020998ee0488b', 'request_id': 'req-adace10a-295d-4c02-8f20-24403d0cd07c'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:14.490454 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:14.511674 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-adace10a-295d-4c02-8f20-24403d0cd07c admin admin] The token cache is being invalidate because project 38a10f7328d44c6499e020998ee0488b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:14.512105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-adace10a-295d-4c02-8f20-24403d0cd07c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:14.516275 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-adace10a-295d-4c02-8f20-24403d0cd07c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:14.519309 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 667/1342] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:14 2022] DELETE /identity/v3/projects/38a10f7328d44c6499e020998ee0488b => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:14.525540 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36773cf3-859e-46dd-9913-6ea44c17c920 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:14.526053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36773cf3-859e-46dd-9913-6ea44c17c920 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:14.526053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36773cf3-859e-46dd-9913-6ea44c17c920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:14.580759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-36773cf3-859e-46dd-9913-6ea44c17c920 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:14.584328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-36773cf3-859e-46dd-9913-6ea44c17c920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:14.701990 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 676/1343] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:14.704021 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78332e91-affb-4f03-9e8a-6bc0b0496bde None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:14.704430 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78332e91-affb-4f03-9e8a-6bc0b0496bde None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:14.704888 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78332e91-affb-4f03-9e8a-6bc0b0496bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:14.771695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-78332e91-affb-4f03-9e8a-6bc0b0496bde None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:14.771695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-78332e91-affb-4f03-9e8a-6bc0b0496bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:14.802537 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 668/1344] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:14.803283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36773cf3-859e-46dd-9913-6ea44c17c920 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:14.825832 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36773cf3-859e-46dd-9913-6ea44c17c920 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:14.842411 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33ab37-d822-42c5-b857-0b1454be609a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:14.843059 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33ab37-d822-42c5-b857-0b1454be609a admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:14.844453 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33ab37-d822-42c5-b857-0b1454be609a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:14.845357 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33ab37-d822-42c5-b857-0b1454be609a admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:14.847302 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33ab37-d822-42c5-b857-0b1454be609a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:14.847445 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33ab37-d822-42c5-b857-0b1454be609a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:14.850019 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33ab37-d822-42c5-b857-0b1454be609a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:14.887685 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 677/1345] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:14.887918 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78332e91-affb-4f03-9e8a-6bc0b0496bde None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:14.898162 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78332e91-affb-4f03-9e8a-6bc0b0496bde None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:14.916039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cf157-bc94-49f2-ba17-768d326e2959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:14.917750 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cf157-bc94-49f2-ba17-768d326e2959 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:14.918443 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cf157-bc94-49f2-ba17-768d326e2959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:14.919188 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cf157-bc94-49f2-ba17-768d326e2959 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:14.921250 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45cf157-bc94-49f2-ba17-768d326e2959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:14.923457 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45cf157-bc94-49f2-ba17-768d326e2959 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:14.996295 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 669/1346] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:14 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:14.996813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33ab37-d822-42c5-b857-0b1454be609a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:15.019617 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33ab37-d822-42c5-b857-0b1454be609a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:15.102534 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480084ef-1b06-45b6-99b1-96893a9fd6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:15.103286 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480084ef-1b06-45b6-99b1-96893a9fd6e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:15.103851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480084ef-1b06-45b6-99b1-96893a9fd6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:15.104239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480084ef-1b06-45b6-99b1-96893a9fd6e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:15.105309 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480084ef-1b06-45b6-99b1-96893a9fd6e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:15.107663 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480084ef-1b06-45b6-99b1-96893a9fd6e8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:15.137251 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 678/1347] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:14 2022] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:13:15.141687 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cf157-bc94-49f2-ba17-768d326e2959 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:15.174140 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbe48a-b126-49ea-a96f-a50de995bf76 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:15.174436 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbe48a-b126-49ea-a96f-a50de995bf76 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:15.174696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbe48a-b126-49ea-a96f-a50de995bf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:15.182136 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cf157-bc94-49f2-ba17-768d326e2959 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:15.200333 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63feb2fd-bd87-46ba-909e-7b0c302f8bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:15.201121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63feb2fd-bd87-46ba-909e-7b0c302f8bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:15.201538 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63feb2fd-bd87-46ba-909e-7b0c302f8bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:15.201919 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63feb2fd-bd87-46ba-909e-7b0c302f8bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:15.202689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63feb2fd-bd87-46ba-909e-7b0c302f8bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:15.204511 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63feb2fd-bd87-46ba-909e-7b0c302f8bf0 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:15.227211 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 670/1348] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:15.231051 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63feb2fd-bd87-46ba-909e-7b0c302f8bf0 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:15.255378 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63feb2fd-bd87-46ba-909e-7b0c302f8bf0 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:15.265851 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1984c6-e224-488f-8dee-9afb7518fcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:15.266128 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-f4dbe48a-b126-49ea-a96f-a50de995bf76 None None] MFA Rules not processed for user `2716cf78afb84caf866acd4d5526168c`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:15.266697 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1984c6-e224-488f-8dee-9afb7518fcff admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:15.267083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1984c6-e224-488f-8dee-9afb7518fcff admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:15.267380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f4dbe48a-b126-49ea-a96f-a50de995bf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:15.267534 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1984c6-e224-488f-8dee-9afb7518fcff admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:15.268463 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1984c6-e224-488f-8dee-9afb7518fcff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:15.270365 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1984c6-e224-488f-8dee-9afb7518fcff admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:15.302672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 671/1349] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:15.308246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1984c6-e224-488f-8dee-9afb7518fcff admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:15.346597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1984c6-e224-488f-8dee-9afb7518fcff admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:15.367694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43202296-f32f-46c3-bae4-8e1e2b5df0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:15.369636 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43202296-f32f-46c3-bae4-8e1e2b5df0bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:15.370145 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43202296-f32f-46c3-bae4-8e1e2b5df0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:15.371257 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43202296-f32f-46c3-bae4-8e1e2b5df0bf admin admin] PATH_INFO: `/v3/projects/a6f77e9963b143e384cca8b56fa591e5/users/1ce500fb3a9042c59e7868379261f7a3/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:15.419935 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43202296-f32f-46c3-bae4-8e1e2b5df0bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f77e9963b143e384cca8b56fa591e5, user_id=1ce500fb3a9042c59e7868379261f7a3, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:15.429792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43202296-f32f-46c3-bae4-8e1e2b5df0bf admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:15.461850 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 672/1350] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:15 2022] PUT /identity/v3/projects/a6f77e9963b143e384cca8b56fa591e5/users/1ce500fb3a9042c59e7868379261f7a3/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:15.476603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:15.478809 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a9350-8795-44a2-ac43-8e77b2a5a731 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:15.479224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a9350-8795-44a2-ac43-8e77b2a5a731 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:15.480978 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a9350-8795-44a2-ac43-8e77b2a5a731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:15.485270 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 679/1351] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:15.511584 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbe48a-b126-49ea-a96f-a50de995bf76 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:15.513174 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f4dbe48a-b126-49ea-a96f-a50de995bf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:15.596313 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-8d1a9350-8795-44a2-ac43-8e77b2a5a731 None None] MFA Rules not processed for user `1ce500fb3a9042c59e7868379261f7a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:15.601426 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-8d1a9350-8795-44a2-ac43-8e77b2a5a731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:15.721138 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 673/1352] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:15.725067 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a9350-8795-44a2-ac43-8e77b2a5a731 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:15.727087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-8d1a9350-8795-44a2-ac43-8e77b2a5a731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:15.766190 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbe48a-b126-49ea-a96f-a50de995bf76 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:15.850468 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a9350-8795-44a2-ac43-8e77b2a5a731 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:15.861321 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866b306-34e1-4816-b8b9-32f6cca03e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:15.862030 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866b306-34e1-4816-b8b9-32f6cca03e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:15.862310 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866b306-34e1-4816-b8b9-32f6cca03e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:15.863926 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866b306-34e1-4816-b8b9-32f6cca03e45 admin admin] PATH_INFO: `/v3/projects/25c23861dee5471a8435b90b77530d96` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:15.865889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866b306-34e1-4816-b8b9-32f6cca03e45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25c23861dee5471a8435b90b77530d96)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:15.869320 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866b306-34e1-4816-b8b9-32f6cca03e45 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:15.907603 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:15.913339 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d99bc5-2c98-4aea-bf55-79173b2fc822 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:15.916057 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d99bc5-2c98-4aea-bf55-79173b2fc822 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:15.916579 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d99bc5-2c98-4aea-bf55-79173b2fc822 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:15.917282 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d99bc5-2c98-4aea-bf55-79173b2fc822 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:16.004978 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-b866b306-34e1-4816-b8b9-32f6cca03e45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25c23861dee5471a8435b90b77530d96', 'request_id': 'req-b866b306-34e1-4816-b8b9-32f6cca03e45'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:16.023727 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-b866b306-34e1-4816-b8b9-32f6cca03e45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25c23861dee5471a8435b90b77530d96', 'request_id': 'req-b866b306-34e1-4816-b8b9-32f6cca03e45'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:16.037815 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-b866b306-34e1-4816-b8b9-32f6cca03e45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25c23861dee5471a8435b90b77530d96', 'request_id': 'req-b866b306-34e1-4816-b8b9-32f6cca03e45'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:16.068044 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d99bc5-2c98-4aea-bf55-79173b2fc822 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:16.069226 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-b866b306-34e1-4816-b8b9-32f6cca03e45 admin admin] The token cache is being invalidate because project 25c23861dee5471a8435b90b77530d96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:16.069755 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-b866b306-34e1-4816-b8b9-32f6cca03e45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:16.072424 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-b866b306-34e1-4816-b8b9-32f6cca03e45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:16.075023 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 674/1353] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:15 2022] DELETE /identity/v3/projects/25c23861dee5471a8435b90b77530d96 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:16.076746 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d99bc5-2c98-4aea-bf55-79173b2fc822 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:16.087073 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866b306-34e1-4816-b8b9-32f6cca03e45 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:16.095288 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b866b306-34e1-4816-b8b9-32f6cca03e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:16.101031 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 680/1354] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:13:16.102308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6cc08-8f42-47ea-8e46-c596d8595e61 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:16.102584 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6cc08-8f42-47ea-8e46-c596d8595e61 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:16.103482 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6cc08-8f42-47ea-8e46-c596d8595e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:16.176505 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-4da6cc08-8f42-47ea-8e46-c596d8595e61 None None] MFA Rules not processed for user `4a0d83b5a3e349139eb7347f7e95b767`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:16.178413 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4da6cc08-8f42-47ea-8e46-c596d8595e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:16.220651 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:16.249965 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866b306-34e1-4816-b8b9-32f6cca03e45 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:16.267492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc58f1-fd01-4985-a629-6e1db1558a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:16.268129 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc58f1-fd01-4985-a629-6e1db1558a1c admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:16.268578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc58f1-fd01-4985-a629-6e1db1558a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:16.269007 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc58f1-fd01-4985-a629-6e1db1558a1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:16.269802 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc58f1-fd01-4985-a629-6e1db1558a1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:16.272934 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc58f1-fd01-4985-a629-6e1db1558a1c admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:16.340743 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 675/1355] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:16 2022] POST /identity/v3/projects => generated 373 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:16.341930 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc58f1-fd01-4985-a629-6e1db1558a1c admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:16.344958 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-c7cc58f1-fd01-4985-a629-6e1db1558a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:16.397195 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 681/1356] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:16 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:16.398330 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6cc08-8f42-47ea-8e46-c596d8595e61 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:16.413131 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6cc08-8f42-47ea-8e46-c596d8595e61 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:16.498789 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc58f1-fd01-4985-a629-6e1db1558a1c admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:16.510305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f146a3e-420d-4f34-8540-eea39ba25d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:16.511197 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f146a3e-420d-4f34-8540-eea39ba25d86 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:16.511518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f146a3e-420d-4f34-8540-eea39ba25d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:16.511880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f146a3e-420d-4f34-8540-eea39ba25d86 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:16.512531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f146a3e-420d-4f34-8540-eea39ba25d86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:16.514716 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f146a3e-420d-4f34-8540-eea39ba25d86 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:16.521335 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da308ae-a3ec-4268-b119-636a9fd52bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:16.521929 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da308ae-a3ec-4268-b119-636a9fd52bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:16.522209 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da308ae-a3ec-4268-b119-636a9fd52bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:16.522480 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da308ae-a3ec-4268-b119-636a9fd52bfa admin admin] PATH_INFO: `/v3/users/4f58592e75a34472b86a4fc86d8cc693` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:16.523657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da308ae-a3ec-4268-b119-636a9fd52bfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f58592e75a34472b86a4fc86d8cc693)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:16.526873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da308ae-a3ec-4268-b119-636a9fd52bfa admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:16.551583 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 682/1357] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:16 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:16.551583 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f146a3e-420d-4f34-8540-eea39ba25d86 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:16.556265 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5f146a3e-420d-4f34-8540-eea39ba25d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:16.591822 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:16.630737 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2da308ae-a3ec-4268-b119-636a9fd52bfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f58592e75a34472b86a4fc86d8cc693'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:16.648744 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2da308ae-a3ec-4268-b119-636a9fd52bfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f58592e75a34472b86a4fc86d8cc693'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:16.654808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f146a3e-420d-4f34-8540-eea39ba25d86 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:16.660375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80416e34-0a5e-46bc-baa1-de6e8d9a2eb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:16.662139 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80416e34-0a5e-46bc-baa1-de6e8d9a2eb2 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:16.662717 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80416e34-0a5e-46bc-baa1-de6e8d9a2eb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:16.663878 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80416e34-0a5e-46bc-baa1-de6e8d9a2eb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:16.666878 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-80416e34-0a5e-46bc-baa1-de6e8d9a2eb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:16.667980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2da308ae-a3ec-4268-b119-636a9fd52bfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f58592e75a34472b86a4fc86d8cc693'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:16.690157 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2da308ae-a3ec-4268-b119-636a9fd52bfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f58592e75a34472b86a4fc86d8cc693'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:16.696181 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2da308ae-a3ec-4268-b119-636a9fd52bfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f58592e75a34472b86a4fc86d8cc693'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:16.709196 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 676/1358] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:16 2022] DELETE /identity/v3/users/4f58592e75a34472b86a4fc86d8cc693 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:16.710515 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da308ae-a3ec-4268-b119-636a9fd52bfa admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:16.716216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-2da308ae-a3ec-4268-b119-636a9fd52bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:16.784343 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80416e34-0a5e-46bc-baa1-de6e8d9a2eb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:16.787653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80416e34-0a5e-46bc-baa1-de6e8d9a2eb2 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:16.808001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 683/1359] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:16.885923 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da308ae-a3ec-4268-b119-636a9fd52bfa admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:16.896583 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f1c22-8ea5-461e-a380-1762f378c6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:16.897228 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f1c22-8ea5-461e-a380-1762f378c6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:16.897510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f1c22-8ea5-461e-a380-1762f378c6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:16.897906 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f1c22-8ea5-461e-a380-1762f378c6c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:16.898423 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f1c22-8ea5-461e-a380-1762f378c6c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:16.903960 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f1c22-8ea5-461e-a380-1762f378c6c9 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:16.931925 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 677/1360] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:16.934998 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80416e34-0a5e-46bc-baa1-de6e8d9a2eb2 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:16.944614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:16.959628 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80416e34-0a5e-46bc-baa1-de6e8d9a2eb2 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:16.975151 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c367e-dbff-4f63-ad45-7867cacaddea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:16.976673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c367e-dbff-4f63-ad45-7867cacaddea admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:16.977385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c367e-dbff-4f63-ad45-7867cacaddea admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:16.979206 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c367e-dbff-4f63-ad45-7867cacaddea admin admin] PATH_INFO: `/v3/projects/3cc21de6a27648449b5fc24e8ecd81bf/users/0d854ee2f06a42b8841aee2f11d4817f/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:17.026046 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c367e-dbff-4f63-ad45-7867cacaddea admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cc21de6a27648449b5fc24e8ecd81bf, user_id=0d854ee2f06a42b8841aee2f11d4817f, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:17.037280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c367e-dbff-4f63-ad45-7867cacaddea admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:17.080642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f1c22-8ea5-461e-a380-1762f378c6c9 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:17.081445 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 684/1361] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:16 2022] PUT /identity/v3/projects/3cc21de6a27648449b5fc24e8ecd81bf/users/0d854ee2f06a42b8841aee2f11d4817f/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:17.092155 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f1c22-8ea5-461e-a380-1762f378c6c9 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:17.269210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3774152-69eb-41a7-9fbf-329e94cb76a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:17.269906 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3774152-69eb-41a7-9fbf-329e94cb76a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:17.270243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3774152-69eb-41a7-9fbf-329e94cb76a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:17.270501 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3774152-69eb-41a7-9fbf-329e94cb76a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:17.271088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3774152-69eb-41a7-9fbf-329e94cb76a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:17.272883 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3774152-69eb-41a7-9fbf-329e94cb76a1 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:17.296316 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 678/1362] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:13:17.297633 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c367e-dbff-4f63-ad45-7867cacaddea admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:17.322585 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c367e-dbff-4f63-ad45-7867cacaddea admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:17.333535 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7419970-349c-49cc-88d4-3c3e5e5327e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:17.334222 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7419970-349c-49cc-88d4-3c3e5e5327e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:17.334505 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7419970-349c-49cc-88d4-3c3e5e5327e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:17.334783 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7419970-349c-49cc-88d4-3c3e5e5327e2 admin admin] PATH_INFO: `/v3/projects/3cc21de6a27648449b5fc24e8ecd81bf/users/0d854ee2f06a42b8841aee2f11d4817f/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:17.336874 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7419970-349c-49cc-88d4-3c3e5e5327e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cc21de6a27648449b5fc24e8ecd81bf, user_id=0d854ee2f06a42b8841aee2f11d4817f, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:17.340216 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7419970-349c-49cc-88d4-3c3e5e5327e2 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:17.378808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 685/1363] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:17 2022] PUT /identity/v3/projects/3cc21de6a27648449b5fc24e8ecd81bf/users/0d854ee2f06a42b8841aee2f11d4817f/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:17.382073 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19457895-59a5-4678-a332-492b229e6d81 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:17.382073 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19457895-59a5-4678-a332-492b229e6d81 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:17.382316 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19457895-59a5-4678-a332-492b229e6d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:17.445797 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-19457895-59a5-4678-a332-492b229e6d81 None None] MFA Rules not processed for user `0d854ee2f06a42b8841aee2f11d4817f`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:17.447363 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-19457895-59a5-4678-a332-492b229e6d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:17.514588 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:17.622446 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 679/1364] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:17.636077 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7419970-349c-49cc-88d4-3c3e5e5327e2 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:17.638698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e7419970-349c-49cc-88d4-3c3e5e5327e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:17.776174 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7419970-349c-49cc-88d4-3c3e5e5327e2 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:17.781342 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd0252-3a81-49bd-88b6-fda153813cfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:17.782093 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd0252-3a81-49bd-88b6-fda153813cfb service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:17.782674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd0252-3a81-49bd-88b6-fda153813cfb service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:17.783215 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd0252-3a81-49bd-88b6-fda153813cfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:17.795534 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd0252-3a81-49bd-88b6-fda153813cfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:17.798662 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd0252-3a81-49bd-88b6-fda153813cfb service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:17.811747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 686/1365] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:18.045016 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19457895-59a5-4678-a332-492b229e6d81 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:18.067071 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19457895-59a5-4678-a332-492b229e6d81 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:18.081000 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08e354-fb93-41a1-810a-0e14013ca622 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:18.084512 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08e354-fb93-41a1-810a-0e14013ca622 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:18.085098 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08e354-fb93-41a1-810a-0e14013ca622 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:18.085589 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08e354-fb93-41a1-810a-0e14013ca622 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:18.094270 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-be08e354-fb93-41a1-810a-0e14013ca622 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:18.324347 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08e354-fb93-41a1-810a-0e14013ca622 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:18.326722 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08e354-fb93-41a1-810a-0e14013ca622 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:18.338133 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 680/1366] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:18.935024 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd0252-3a81-49bd-88b6-fda153813cfb service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:18.937944 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-bccd0252-3a81-49bd-88b6-fda153813cfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:19.078258 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd0252-3a81-49bd-88b6-fda153813cfb service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:19.084210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df222c-2437-450b-b642-ab7feb1d80e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:19.085023 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df222c-2437-450b-b642-ab7feb1d80e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:19.085397 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df222c-2437-450b-b642-ab7feb1d80e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:19.085763 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df222c-2437-450b-b642-ab7feb1d80e6 admin admin] PATH_INFO: `/v3/projects/4776d42b6da24977a0b4d5d9211f0363` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:19.087132 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df222c-2437-450b-b642-ab7feb1d80e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4776d42b6da24977a0b4d5d9211f0363)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:19.089896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df222c-2437-450b-b642-ab7feb1d80e6 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:19.106232 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bb5b0-d13e-4a04-a137-b8b4f6e9de96 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:19.106644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bb5b0-d13e-4a04-a137-b8b4f6e9de96 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:19.107008 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bb5b0-d13e-4a04-a137-b8b4f6e9de96 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:19.108861 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 681/1367] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 24 13:13:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:13:19.145550 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0100d-e60e-4c90-830c-c55cc6028388 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:19.145943 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0100d-e60e-4c90-830c-c55cc6028388 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:19.146338 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0100d-e60e-4c90-830c-c55cc6028388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:19.177222 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-fac0100d-e60e-4c90-830c-c55cc6028388 None None] MFA Rules not processed for user `60b3ca8694ab4a169a3c36561290d8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:19.178951 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-fac0100d-e60e-4c90-830c-c55cc6028388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:19.193551 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-05df222c-2437-450b-b642-ab7feb1d80e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4776d42b6da24977a0b4d5d9211f0363', 'request_id': 'req-05df222c-2437-450b-b642-ab7feb1d80e6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:19.210737 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-05df222c-2437-450b-b642-ab7feb1d80e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4776d42b6da24977a0b4d5d9211f0363', 'request_id': 'req-05df222c-2437-450b-b642-ab7feb1d80e6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:19.219533 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-05df222c-2437-450b-b642-ab7feb1d80e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4776d42b6da24977a0b4d5d9211f0363', 'request_id': 'req-05df222c-2437-450b-b642-ab7feb1d80e6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:19.229466 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:19.246070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-05df222c-2437-450b-b642-ab7feb1d80e6 admin admin] The token cache is being invalidate because project 4776d42b6da24977a0b4d5d9211f0363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:19.246942 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-05df222c-2437-450b-b642-ab7feb1d80e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:19.250337 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-05df222c-2437-450b-b642-ab7feb1d80e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:19.254196 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 687/1368] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:18 2022] DELETE /identity/v3/projects/4776d42b6da24977a0b4d5d9211f0363 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:19.263741 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d00821-39a0-4f4e-b9ea-a218fead4746 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:19.264516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d00821-39a0-4f4e-b9ea-a218fead4746 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:19.265515 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d00821-39a0-4f4e-b9ea-a218fead4746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:19.288370 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-23d00821-39a0-4f4e-b9ea-a218fead4746 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:19.289757 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-23d00821-39a0-4f4e-b9ea-a218fead4746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:19.370913 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 682/1369] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 24 13:13:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:19.395224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0100d-e60e-4c90-830c-c55cc6028388 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:19.397010 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-fac0100d-e60e-4c90-830c-c55cc6028388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:19.418978 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0100d-e60e-4c90-830c-c55cc6028388 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:19.423324 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 688/1370] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:19.434448 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd080b9-6f36-4fcf-b7a7-6e1cfac2e46d None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:19.435058 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd080b9-6f36-4fcf-b7a7-6e1cfac2e46d None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:19.435531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd080b9-6f36-4fcf-b7a7-6e1cfac2e46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:19.447254 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615d959-a169-4d9d-8417-aa60f4dcdf6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b3ca8694ab4a169a3c36561290d8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:19.447955 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615d959-a169-4d9d-8417-aa60f4dcdf6e service placement] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:19.449369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615d959-a169-4d9d-8417-aa60f4dcdf6e service placement] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:19.449650 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615d959-a169-4d9d-8417-aa60f4dcdf6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:19.476172 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615d959-a169-4d9d-8417-aa60f4dcdf6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:19.479565 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615d959-a169-4d9d-8417-aa60f4dcdf6e service placement] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:19.489519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-4dd080b9-6f36-4fcf-b7a7-6e1cfac2e46d None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:19.491638 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4dd080b9-6f36-4fcf-b7a7-6e1cfac2e46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:19.514376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 683/1371] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:13:19.517945 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 689/1372] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:19.521899 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615d959-a169-4d9d-8417-aa60f4dcdf6e service placement] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:19.538214 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615d959-a169-4d9d-8417-aa60f4dcdf6e service placement] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:19.555700 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68036303-e3fc-452c-923e-9626ae785e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:19.558950 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68036303-e3fc-452c-923e-9626ae785e28 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:19.559336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68036303-e3fc-452c-923e-9626ae785e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:19.559743 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68036303-e3fc-452c-923e-9626ae785e28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:19.562504 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68036303-e3fc-452c-923e-9626ae785e28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:19.563599 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68036303-e3fc-452c-923e-9626ae785e28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:19.567664 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68036303-e3fc-452c-923e-9626ae785e28 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:19.586258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 684/1373] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:19.592263 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd080b9-6f36-4fcf-b7a7-6e1cfac2e46d None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:19.608232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd080b9-6f36-4fcf-b7a7-6e1cfac2e46d None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:19.617218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c4d8e-6060-4f75-a098-e81fea51ccde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:19.620381 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c4d8e-6060-4f75-a098-e81fea51ccde admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:19.621928 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c4d8e-6060-4f75-a098-e81fea51ccde admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:19.622462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c4d8e-6060-4f75-a098-e81fea51ccde admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:19.625154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c4d8e-6060-4f75-a098-e81fea51ccde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:19.629151 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c4d8e-6060-4f75-a098-e81fea51ccde admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:19.706912 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 690/1374] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:19 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:19.707731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68036303-e3fc-452c-923e-9626ae785e28 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:19.725391 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68036303-e3fc-452c-923e-9626ae785e28 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:19.846411 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:19.921931 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035bc8e-c107-4228-845c-eef2c1ac5058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:19.922643 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035bc8e-c107-4228-845c-eef2c1ac5058 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:19.922922 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035bc8e-c107-4228-845c-eef2c1ac5058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:19.923195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035bc8e-c107-4228-845c-eef2c1ac5058 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:19.924144 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035bc8e-c107-4228-845c-eef2c1ac5058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:19.926104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035bc8e-c107-4228-845c-eef2c1ac5058 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:19.990434 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 685/1375] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:19 2022] POST /identity/v3/users => generated 294 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:13:19.994000 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c4d8e-6060-4f75-a098-e81fea51ccde admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:20.011026 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c4d8e-6060-4f75-a098-e81fea51ccde admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:20.034704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028f180-b66f-4f66-a068-bfd366556584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:20.037480 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028f180-b66f-4f66-a068-bfd366556584 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:20.037958 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028f180-b66f-4f66-a068-bfd366556584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:20.038910 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028f180-b66f-4f66-a068-bfd366556584 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:20.039606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028f180-b66f-4f66-a068-bfd366556584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:20.041683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028f180-b66f-4f66-a068-bfd366556584 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:20.090706 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 691/1376] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:20.095135 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035bc8e-c107-4228-845c-eef2c1ac5058 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:20.111789 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035bc8e-c107-4228-845c-eef2c1ac5058 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:20.131326 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afed7f5-1b2e-43a9-82d0-5af03edc8bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:20.132009 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afed7f5-1b2e-43a9-82d0-5af03edc8bac admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:20.132400 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afed7f5-1b2e-43a9-82d0-5af03edc8bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:20.132566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afed7f5-1b2e-43a9-82d0-5af03edc8bac admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:20.133311 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afed7f5-1b2e-43a9-82d0-5af03edc8bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:20.143859 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afed7f5-1b2e-43a9-82d0-5af03edc8bac admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:20.185221 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 686/1377] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:20.186164 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028f180-b66f-4f66-a068-bfd366556584 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:20.209991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028f180-b66f-4f66-a068-bfd366556584 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:20.239780 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bb219-0abd-47f8-a4d5-b144e87b41ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:20.240468 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bb219-0abd-47f8-a4d5-b144e87b41ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:20.240753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bb219-0abd-47f8-a4d5-b144e87b41ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:20.241025 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bb219-0abd-47f8-a4d5-b144e87b41ce admin admin] PATH_INFO: `/v3/projects/f4c2c3e4dda84746bfe81a851696351a/users/d31c7457b5b64235a4073726e55fe3be/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:20.302529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bb219-0abd-47f8-a4d5-b144e87b41ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4c2c3e4dda84746bfe81a851696351a, user_id=d31c7457b5b64235a4073726e55fe3be, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:20.305972 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bb219-0abd-47f8-a4d5-b144e87b41ce admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:20.372484 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 692/1378] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:20 2022] PUT /identity/v3/projects/f4c2c3e4dda84746bfe81a851696351a/users/d31c7457b5b64235a4073726e55fe3be/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:20.374330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09a92e-3c5f-4c64-9f53-ad311dbed8d9 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:20.374807 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09a92e-3c5f-4c64-9f53-ad311dbed8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:20.375281 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09a92e-3c5f-4c64-9f53-ad311dbed8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:20.492379 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-6a09a92e-3c5f-4c64-9f53-ad311dbed8d9 None None] MFA Rules not processed for user `d31c7457b5b64235a4073726e55fe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:20.502459 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-6a09a92e-3c5f-4c64-9f53-ad311dbed8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:20.690216 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bb219-0abd-47f8-a4d5-b144e87b41ce admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:20.690742 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 687/1379] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:20.795786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09a92e-3c5f-4c64-9f53-ad311dbed8d9 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:20.797316 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-6a09a92e-3c5f-4c64-9f53-ad311dbed8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:20.888919 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bb219-0abd-47f8-a4d5-b144e87b41ce admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:20.912969 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88c817-ec99-48bb-8340-f5944b5eb268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:20.914230 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88c817-ec99-48bb-8340-f5944b5eb268 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:20.915849 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88c817-ec99-48bb-8340-f5944b5eb268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:20.916498 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88c817-ec99-48bb-8340-f5944b5eb268 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:20.917669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88c817-ec99-48bb-8340-f5944b5eb268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:20.921877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88c817-ec99-48bb-8340-f5944b5eb268 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:21.012149 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 693/1380] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:20 2022] POST /identity/v3/projects => generated 387 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:13:21.018280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88c817-ec99-48bb-8340-f5944b5eb268 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:21.029218 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09a92e-3c5f-4c64-9f53-ad311dbed8d9 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:21.081078 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:21.147281 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:21.185745 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe74910-3925-45eb-8237-3e94d02cc6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:21.186304 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe74910-3925-45eb-8237-3e94d02cc6fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.186567 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe74910-3925-45eb-8237-3e94d02cc6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.187015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe74910-3925-45eb-8237-3e94d02cc6fd admin admin] PATH_INFO: `/v3/users/a2ec11f9ed9146c7a9d439bf99a1cb30` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.188369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe74910-3925-45eb-8237-3e94d02cc6fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2ec11f9ed9146c7a9d439bf99a1cb30)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:21.188870 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88c817-ec99-48bb-8340-f5944b5eb268 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:21.190507 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe74910-3925-45eb-8237-3e94d02cc6fd admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:21.207583 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe055d79-4907-4eca-8870-69a176704f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:21.208460 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe055d79-4907-4eca-8870-69a176704f7b admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.208958 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe055d79-4907-4eca-8870-69a176704f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.209527 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe055d79-4907-4eca-8870-69a176704f7b admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.210448 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe055d79-4907-4eca-8870-69a176704f7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:21.213547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe055d79-4907-4eca-8870-69a176704f7b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:21.270230 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 694/1381] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:21 2022] POST /identity/v3/users => generated 300 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:21.274148 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe055d79-4907-4eca-8870-69a176704f7b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:21.288093 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-6fe74910-3925-45eb-8237-3e94d02cc6fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2ec11f9ed9146c7a9d439bf99a1cb30'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:21.299270 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe055d79-4907-4eca-8870-69a176704f7b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:21.308564 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-6fe74910-3925-45eb-8237-3e94d02cc6fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2ec11f9ed9146c7a9d439bf99a1cb30'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:21.318609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1999c-2d68-4ae4-90ed-4f8eb1152b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:21.319220 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1999c-2d68-4ae4-90ed-4f8eb1152b4a admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.319629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1999c-2d68-4ae4-90ed-4f8eb1152b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.319885 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1999c-2d68-4ae4-90ed-4f8eb1152b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.320804 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1999c-2d68-4ae4-90ed-4f8eb1152b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:21.323692 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1999c-2d68-4ae4-90ed-4f8eb1152b4a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:21.327507 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-6fe74910-3925-45eb-8237-3e94d02cc6fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2ec11f9ed9146c7a9d439bf99a1cb30'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:21.347866 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-6fe74910-3925-45eb-8237-3e94d02cc6fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2ec11f9ed9146c7a9d439bf99a1cb30'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:21.350465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-6fe74910-3925-45eb-8237-3e94d02cc6fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2ec11f9ed9146c7a9d439bf99a1cb30'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:21.363624 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 695/1382] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:13:21.364717 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1999c-2d68-4ae4-90ed-4f8eb1152b4a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:21.368066 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-cfd1999c-2d68-4ae4-90ed-4f8eb1152b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:21.370103 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 688/1383] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:20 2022] DELETE /identity/v3/users/a2ec11f9ed9146c7a9d439bf99a1cb30 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:21.371806 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd758546-ba4d-4fb5-91fd-8dcefaac83ca None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.372087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd758546-ba4d-4fb5-91fd-8dcefaac83ca None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.372364 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd758546-ba4d-4fb5-91fd-8dcefaac83ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.395591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-dd758546-ba4d-4fb5-91fd-8dcefaac83ca None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:21.398282 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-dd758546-ba4d-4fb5-91fd-8dcefaac83ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:21.416582 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1999c-2d68-4ae4-90ed-4f8eb1152b4a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:21.521351 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97600136-3b74-4254-9673-0117abb8a9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:21.522024 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97600136-3b74-4254-9673-0117abb8a9be admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.522306 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97600136-3b74-4254-9673-0117abb8a9be admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.522579 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97600136-3b74-4254-9673-0117abb8a9be admin admin] PATH_INFO: `/v3/projects/0139747ebb5b4308a6098abfc36ca2c1/users/e648848bcf584ed19ef8ef9b2e5c3270/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.543765 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 689/1384] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:21.565388 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97600136-3b74-4254-9673-0117abb8a9be admin admin] RBAC: Authorizing `identity:create_grant(project_id=0139747ebb5b4308a6098abfc36ca2c1, user_id=e648848bcf584ed19ef8ef9b2e5c3270, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:21.568213 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97600136-3b74-4254-9673-0117abb8a9be admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:21.600607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 696/1385] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:21 2022] PUT /identity/v3/projects/0139747ebb5b4308a6098abfc36ca2c1/users/e648848bcf584ed19ef8ef9b2e5c3270/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:21.602494 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd758546-ba4d-4fb5-91fd-8dcefaac83ca None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:21.621792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd758546-ba4d-4fb5-91fd-8dcefaac83ca None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:21.632127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97600136-3b74-4254-9673-0117abb8a9be admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:21.634575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-97600136-3b74-4254-9673-0117abb8a9be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:21.788213 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e12676-e9a1-44b2-b7f9-f9fa93eca4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:21.788828 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e12676-e9a1-44b2-b7f9-f9fa93eca4db admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.789336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e12676-e9a1-44b2-b7f9-f9fa93eca4db admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.789451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e12676-e9a1-44b2-b7f9-f9fa93eca4db admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.790919 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e12676-e9a1-44b2-b7f9-f9fa93eca4db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:21.795187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e12676-e9a1-44b2-b7f9-f9fa93eca4db admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:21.826016 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97600136-3b74-4254-9673-0117abb8a9be admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:21.844749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca85a0-00ce-4aa1-98fd-ae1eec754605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:21.845392 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca85a0-00ce-4aa1-98fd-ae1eec754605 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.845676 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca85a0-00ce-4aa1-98fd-ae1eec754605 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.845951 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca85a0-00ce-4aa1-98fd-ae1eec754605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.847047 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 690/1386] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:21.851837 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e12676-e9a1-44b2-b7f9-f9fa93eca4db admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:21.868843 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:21.888407 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca85a0-00ce-4aa1-98fd-ae1eec754605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:21.889903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca85a0-00ce-4aa1-98fd-ae1eec754605 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:21.892987 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e12676-e9a1-44b2-b7f9-f9fa93eca4db admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:21.907456 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981ca39-0f2d-48f3-882a-9ec42c5c8112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:21.910150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981ca39-0f2d-48f3-882a-9ec42c5c8112 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.910435 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981ca39-0f2d-48f3-882a-9ec42c5c8112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.911670 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981ca39-0f2d-48f3-882a-9ec42c5c8112 admin admin] PATH_INFO: `/v3/projects/0139747ebb5b4308a6098abfc36ca2c1/users/e648848bcf584ed19ef8ef9b2e5c3270/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.917091 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981ca39-0f2d-48f3-882a-9ec42c5c8112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0139747ebb5b4308a6098abfc36ca2c1, user_id=e648848bcf584ed19ef8ef9b2e5c3270, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:21.920408 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 697/1387] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:21.921999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981ca39-0f2d-48f3-882a-9ec42c5c8112 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:21.950261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab00b6b-cbc1-4df3-b7b7-8f8bacabc2c7 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.950600 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 691/1388] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:21 2022] PUT /identity/v3/projects/0139747ebb5b4308a6098abfc36ca2c1/users/e648848bcf584ed19ef8ef9b2e5c3270/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:21.950777 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab00b6b-cbc1-4df3-b7b7-8f8bacabc2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.951173 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab00b6b-cbc1-4df3-b7b7-8f8bacabc2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:22.012039 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-9ab00b6b-cbc1-4df3-b7b7-8f8bacabc2c7 None None] MFA Rules not processed for user `e648848bcf584ed19ef8ef9b2e5c3270`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:22.014141 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9ab00b6b-cbc1-4df3-b7b7-8f8bacabc2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:22.069733 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:22.239258 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 698/1389] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:21 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:22.273555 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981ca39-0f2d-48f3-882a-9ec42c5c8112 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:22.276437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-e981ca39-0f2d-48f3-882a-9ec42c5c8112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:22.521168 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981ca39-0f2d-48f3-882a-9ec42c5c8112 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:22.532287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a1443-40ae-4e4d-82bc-ca045fe810e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:22.533451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a1443-40ae-4e4d-82bc-ca045fe810e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:22.534065 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a1443-40ae-4e4d-82bc-ca045fe810e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:22.534658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a1443-40ae-4e4d-82bc-ca045fe810e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:22.570292 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a1443-40ae-4e4d-82bc-ca045fe810e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:22.572260 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a1443-40ae-4e4d-82bc-ca045fe810e2 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:22.673165 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 692/1390] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:22 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:22.801724 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b632a-f588-4b11-adaa-621167352a34 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:22.802438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b632a-f588-4b11-adaa-621167352a34 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:22.803096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b632a-f588-4b11-adaa-621167352a34 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:22.805679 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 699/1391] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 24 13:13:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:13:22.865210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc6518-84fc-4d5f-9f4d-606ada94afd5 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:22.865797 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc6518-84fc-4d5f-9f4d-606ada94afd5 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:22.866464 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc6518-84fc-4d5f-9f4d-606ada94afd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:22.961522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-c1fc6518-84fc-4d5f-9f4d-606ada94afd5 None None] MFA Rules not processed for user `60b3ca8694ab4a169a3c36561290d8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:22.964184 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-c1fc6518-84fc-4d5f-9f4d-606ada94afd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:23.066805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b632a-f588-4b11-adaa-621167352a34 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:23.271864 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 693/1392] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 24 13:13:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:23.272761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc6518-84fc-4d5f-9f4d-606ada94afd5 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:23.276970 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-c1fc6518-84fc-4d5f-9f4d-606ada94afd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:23.341035 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b632a-f588-4b11-adaa-621167352a34 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:23.352136 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848575e-e28c-492a-a5d9-91dec107835b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:23.353252 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848575e-e28c-492a-a5d9-91dec107835b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:23.354132 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848575e-e28c-492a-a5d9-91dec107835b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:23.354608 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848575e-e28c-492a-a5d9-91dec107835b admin admin] PATH_INFO: `/v3/users/d31c7457b5b64235a4073726e55fe3be` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:23.357572 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848575e-e28c-492a-a5d9-91dec107835b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d31c7457b5b64235a4073726e55fe3be)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:23.363653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848575e-e28c-492a-a5d9-91dec107835b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:23.430401 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc6518-84fc-4d5f-9f4d-606ada94afd5 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:23.437040 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6c66d-6ab5-4464-8215-34ce01d4f8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:23.437861 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6c66d-6ab5-4464-8215-34ce01d4f8ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:23.438283 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6c66d-6ab5-4464-8215-34ce01d4f8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:23.438693 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6c66d-6ab5-4464-8215-34ce01d4f8ce admin admin] PATH_INFO: `/v3/users/3b7b6afc6c024a99aa3897abcfe867d0` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:23.440946 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6c66d-6ab5-4464-8215-34ce01d4f8ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b7b6afc6c024a99aa3897abcfe867d0)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:23.443301 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6c66d-6ab5-4464-8215-34ce01d4f8ce admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:23.499154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5848575e-e28c-492a-a5d9-91dec107835b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd31c7457b5b64235a4073726e55fe3be'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:23.527792 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5848575e-e28c-492a-a5d9-91dec107835b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd31c7457b5b64235a4073726e55fe3be'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:23.529516 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:23.563298 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-65c6c66d-6ab5-4464-8215-34ce01d4f8ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b7b6afc6c024a99aa3897abcfe867d0'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:23.567764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5848575e-e28c-492a-a5d9-91dec107835b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd31c7457b5b64235a4073726e55fe3be'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:23.581072 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-65c6c66d-6ab5-4464-8215-34ce01d4f8ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b7b6afc6c024a99aa3897abcfe867d0'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:23.602151 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5848575e-e28c-492a-a5d9-91dec107835b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd31c7457b5b64235a4073726e55fe3be'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:23.603808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5848575e-e28c-492a-a5d9-91dec107835b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd31c7457b5b64235a4073726e55fe3be'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:23.614694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-65c6c66d-6ab5-4464-8215-34ce01d4f8ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b7b6afc6c024a99aa3897abcfe867d0'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:23.622318 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 700/1393] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:23 2022] DELETE /identity/v3/users/d31c7457b5b64235a4073726e55fe3be => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:23.622318 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848575e-e28c-492a-a5d9-91dec107835b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:23.622788 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5848575e-e28c-492a-a5d9-91dec107835b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:23.639330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-65c6c66d-6ab5-4464-8215-34ce01d4f8ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b7b6afc6c024a99aa3897abcfe867d0'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:23.640336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-65c6c66d-6ab5-4464-8215-34ce01d4f8ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b7b6afc6c024a99aa3897abcfe867d0'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:23.650720 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 694/1394] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:23 2022] DELETE /identity/v3/users/3b7b6afc6c024a99aa3897abcfe867d0 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:23.652416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40057e9-a39d-4bc8-a51a-db4c44818a82 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:23.652841 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40057e9-a39d-4bc8-a51a-db4c44818a82 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:23.653232 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40057e9-a39d-4bc8-a51a-db4c44818a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:23.679566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-f40057e9-a39d-4bc8-a51a-db4c44818a82 None None] MFA Rules not processed for user `2716cf78afb84caf866acd4d5526168c`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:23.681920 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f40057e9-a39d-4bc8-a51a-db4c44818a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:23.712264 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:23.807111 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 695/1395] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:23.808176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848575e-e28c-492a-a5d9-91dec107835b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:23.808844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da163dd-d12f-426a-beb9-a7e73d8a847a None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:23.809255 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da163dd-d12f-426a-beb9-a7e73d8a847a None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:23.809677 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da163dd-d12f-426a-beb9-a7e73d8a847a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:23.869677 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-9da163dd-d12f-426a-beb9-a7e73d8a847a None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:23.871142 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-9da163dd-d12f-426a-beb9-a7e73d8a847a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:23.972152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c53749-bd7a-4823-b132-3c316ca02f63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b3ca8694ab4a169a3c36561290d8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:23.972915 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c53749-bd7a-4823-b132-3c316ca02f63 service placement] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:23.973246 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c53749-bd7a-4823-b132-3c316ca02f63 service placement] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:23.973582 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c53749-bd7a-4823-b132-3c316ca02f63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:23.975675 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f9c53749-bd7a-4823-b132-3c316ca02f63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:23.991470 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 696/1396] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:24.006639 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c53749-bd7a-4823-b132-3c316ca02f63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:24.008355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c53749-bd7a-4823-b132-3c316ca02f63 service placement] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:24.028492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 701/1397] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:24.030290 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da163dd-d12f-426a-beb9-a7e73d8a847a None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:24.032769 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-9da163dd-d12f-426a-beb9-a7e73d8a847a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:24.183882 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da163dd-d12f-426a-beb9-a7e73d8a847a None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:24.188234 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69d1a7-4aab-4cf7-b63e-0ff61ef3177f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:24.188869 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69d1a7-4aab-4cf7-b63e-0ff61ef3177f service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:24.189148 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69d1a7-4aab-4cf7-b63e-0ff61ef3177f service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:24.189418 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69d1a7-4aab-4cf7-b63e-0ff61ef3177f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:24.212774 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:24.217513 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69d1a7-4aab-4cf7-b63e-0ff61ef3177f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:24.219054 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69d1a7-4aab-4cf7-b63e-0ff61ef3177f service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:24.248379 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 697/1398] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:24.455070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c53749-bd7a-4823-b132-3c316ca02f63 service placement] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:24.456782 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f9c53749-bd7a-4823-b132-3c316ca02f63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:24.484085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c53749-bd7a-4823-b132-3c316ca02f63 service placement] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:24.497860 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623f311-a269-40a2-84b1-796cf5a1cb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:24.500804 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623f311-a269-40a2-84b1-796cf5a1cb2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:24.502768 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623f311-a269-40a2-84b1-796cf5a1cb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:24.504283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623f311-a269-40a2-84b1-796cf5a1cb2b admin admin] PATH_INFO: `/v3/projects/84e7ecf3a3884cb9a91aff698db8ae48` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:24.505893 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623f311-a269-40a2-84b1-796cf5a1cb2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=84e7ecf3a3884cb9a91aff698db8ae48)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:24.510510 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623f311-a269-40a2-84b1-796cf5a1cb2b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:24.635044 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1623f311-a269-40a2-84b1-796cf5a1cb2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84e7ecf3a3884cb9a91aff698db8ae48', 'request_id': 'req-1623f311-a269-40a2-84b1-796cf5a1cb2b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:24.669452 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1623f311-a269-40a2-84b1-796cf5a1cb2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84e7ecf3a3884cb9a91aff698db8ae48', 'request_id': 'req-1623f311-a269-40a2-84b1-796cf5a1cb2b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:24.700645 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1623f311-a269-40a2-84b1-796cf5a1cb2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84e7ecf3a3884cb9a91aff698db8ae48', 'request_id': 'req-1623f311-a269-40a2-84b1-796cf5a1cb2b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:24.733143 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1623f311-a269-40a2-84b1-796cf5a1cb2b admin admin] The token cache is being invalidate because project 84e7ecf3a3884cb9a91aff698db8ae48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:24.737062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1623f311-a269-40a2-84b1-796cf5a1cb2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:24.738056 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1623f311-a269-40a2-84b1-796cf5a1cb2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:24.745998 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 702/1399] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:24 2022] DELETE /identity/v3/projects/84e7ecf3a3884cb9a91aff698db8ae48 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:24.746720 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69d1a7-4aab-4cf7-b63e-0ff61ef3177f service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:24.766543 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69d1a7-4aab-4cf7-b63e-0ff61ef3177f service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:24.927865 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623f311-a269-40a2-84b1-796cf5a1cb2b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:24.930494 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1623f311-a269-40a2-84b1-796cf5a1cb2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:24.934512 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb959cec-db35-4d24-8838-1fd580ba8639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:24.935179 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb959cec-db35-4d24-8838-1fd580ba8639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:24.935476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb959cec-db35-4d24-8838-1fd580ba8639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:24.935862 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb959cec-db35-4d24-8838-1fd580ba8639 admin admin] PATH_INFO: `/v3/users/502ab07a2372421eaf35942137373b5f` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:24.937390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb959cec-db35-4d24-8838-1fd580ba8639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=502ab07a2372421eaf35942137373b5f)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:24.939699 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb959cec-db35-4d24-8838-1fd580ba8639 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:24.949970 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623f311-a269-40a2-84b1-796cf5a1cb2b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:24.957775 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1a4f0-02ad-4a48-ba22-912b1d55ade2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:24.959922 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1a4f0-02ad-4a48-ba22-912b1d55ade2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:24.960338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1a4f0-02ad-4a48-ba22-912b1d55ade2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:24.960615 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1a4f0-02ad-4a48-ba22-912b1d55ade2 admin admin] PATH_INFO: `/v3/projects/a854ab254a2945c3b66dd73a0f01ce15` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:24.961846 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1a4f0-02ad-4a48-ba22-912b1d55ade2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a854ab254a2945c3b66dd73a0f01ce15)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:24.973611 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1a4f0-02ad-4a48-ba22-912b1d55ade2 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:25.057991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-bb959cec-db35-4d24-8838-1fd580ba8639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '502ab07a2372421eaf35942137373b5f'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:25.084403 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-bb959cec-db35-4d24-8838-1fd580ba8639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '502ab07a2372421eaf35942137373b5f'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:25.096384 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:25.108797 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-bb959cec-db35-4d24-8838-1fd580ba8639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '502ab07a2372421eaf35942137373b5f'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:25.121418 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c7a1a4f0-02ad-4a48-ba22-912b1d55ade2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a854ab254a2945c3b66dd73a0f01ce15', 'request_id': 'req-c7a1a4f0-02ad-4a48-ba22-912b1d55ade2'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:25.136938 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c7a1a4f0-02ad-4a48-ba22-912b1d55ade2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a854ab254a2945c3b66dd73a0f01ce15', 'request_id': 'req-c7a1a4f0-02ad-4a48-ba22-912b1d55ade2'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:25.144573 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-bb959cec-db35-4d24-8838-1fd580ba8639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '502ab07a2372421eaf35942137373b5f'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:25.146343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-bb959cec-db35-4d24-8838-1fd580ba8639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '502ab07a2372421eaf35942137373b5f'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:25.152428 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c7a1a4f0-02ad-4a48-ba22-912b1d55ade2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a854ab254a2945c3b66dd73a0f01ce15', 'request_id': 'req-c7a1a4f0-02ad-4a48-ba22-912b1d55ade2'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:25.175015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 698/1400] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:24 2022] DELETE /identity/v3/users/502ab07a2372421eaf35942137373b5f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:25.192259 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c7a1a4f0-02ad-4a48-ba22-912b1d55ade2 admin admin] The token cache is being invalidate because project a854ab254a2945c3b66dd73a0f01ce15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:25.193248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c7a1a4f0-02ad-4a48-ba22-912b1d55ade2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:25.194177 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c7a1a4f0-02ad-4a48-ba22-912b1d55ade2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:25.200023 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 703/1401] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:24 2022] DELETE /identity/v3/projects/a854ab254a2945c3b66dd73a0f01ce15 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:25.201010 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb959cec-db35-4d24-8838-1fd580ba8639 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:25.202597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-bb959cec-db35-4d24-8838-1fd580ba8639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:25.299215 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcbe82-d2d6-4d49-9340-c8802edf8fbd None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:25.299552 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcbe82-d2d6-4d49-9340-c8802edf8fbd None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:25.299975 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcbe82-d2d6-4d49-9340-c8802edf8fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:25.330045 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb959cec-db35-4d24-8838-1fd580ba8639 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:25.346559 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf35ea4-c1e4-4291-a584-d69649247abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:25.347454 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf35ea4-c1e4-4291-a584-d69649247abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:25.347981 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf35ea4-c1e4-4291-a584-d69649247abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:25.348366 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf35ea4-c1e4-4291-a584-d69649247abe admin admin] PATH_INFO: `/v3/users/4a0d83b5a3e349139eb7347f7e95b767` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:25.349638 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf35ea4-c1e4-4291-a584-d69649247abe admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a0d83b5a3e349139eb7347f7e95b767)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:25.351729 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf35ea4-c1e4-4291-a584-d69649247abe admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:25.369282 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b0dcbe82-d2d6-4d49-9340-c8802edf8fbd None None] MFA Rules not processed for user `ee6bc00495ae431ba92be399077b709b`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:25.370805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b0dcbe82-d2d6-4d49-9340-c8802edf8fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:25.392248 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:25.515919 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8cf35ea4-c1e4-4291-a584-d69649247abe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a0d83b5a3e349139eb7347f7e95b767'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:25.528256 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8cf35ea4-c1e4-4291-a584-d69649247abe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a0d83b5a3e349139eb7347f7e95b767'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:25.567406 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8cf35ea4-c1e4-4291-a584-d69649247abe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a0d83b5a3e349139eb7347f7e95b767'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:25.594948 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8cf35ea4-c1e4-4291-a584-d69649247abe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a0d83b5a3e349139eb7347f7e95b767'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:25.596920 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8cf35ea4-c1e4-4291-a584-d69649247abe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a0d83b5a3e349139eb7347f7e95b767'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:25.615358 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 699/1402] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:25 2022] DELETE /identity/v3/users/4a0d83b5a3e349139eb7347f7e95b767 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:25.617025 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729541b-0661-49aa-9de4-cd94c9af2c31 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:25.619984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729541b-0661-49aa-9de4-cd94c9af2c31 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:25.620371 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729541b-0661-49aa-9de4-cd94c9af2c31 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:25.621808 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 700/1403] 10.222.0.18 () {54 vars in 912 bytes} [Mon Oct 24 13:13:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:13:25.638336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f69cb2-fa37-4e98-9885-e358327ba4cc None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:25.640963 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f69cb2-fa37-4e98-9885-e358327ba4cc None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:25.641255 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f69cb2-fa37-4e98-9885-e358327ba4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:25.666781 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 704/1404] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:25.669205 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4a572-7fa9-434a-93fd-23af2b5bd056 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:25.669517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4a572-7fa9-434a-93fd-23af2b5bd056 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:25.669792 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4a572-7fa9-434a-93fd-23af2b5bd056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:25.756241 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b3d4a572-7fa9-434a-93fd-23af2b5bd056 None None] MFA Rules not processed for user `ee6bc00495ae431ba92be399077b709b`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:25.759739 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b3d4a572-7fa9-434a-93fd-23af2b5bd056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:25.828802 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-70f69cb2-fa37-4e98-9885-e358327ba4cc None None] MFA Rules not processed for user `0f2295659f2e467d8d798bf93f731330`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:25.842099 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-70f69cb2-fa37-4e98-9885-e358327ba4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:25.947763 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 705/1405] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:25.960103 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4a572-7fa9-434a-93fd-23af2b5bd056 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:25.961698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b3d4a572-7fa9-434a-93fd-23af2b5bd056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:26.057894 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 701/1406] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 24 13:13:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:26.097182 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f69cb2-fa37-4e98-9885-e358327ba4cc None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:26.098659 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-70f69cb2-fa37-4e98-9885-e358327ba4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:26.121371 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f69cb2-fa37-4e98-9885-e358327ba4cc None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:26.133293 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c709c-5d0d-4873-9060-3cc488af0f31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:26.134501 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c709c-5d0d-4873-9060-3cc488af0f31 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:26.134824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c709c-5d0d-4873-9060-3cc488af0f31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:26.138607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c709c-5d0d-4873-9060-3cc488af0f31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:26.149032 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c709c-5d0d-4873-9060-3cc488af0f31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:26.151950 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c709c-5d0d-4873-9060-3cc488af0f31 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:26.160769 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:26.190539 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 702/1407] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:26.207612 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4a572-7fa9-434a-93fd-23af2b5bd056 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:26.218236 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af488a0-269b-45f9-8dd4-fada8ca4bc3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:26.219072 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af488a0-269b-45f9-8dd4-fada8ca4bc3a service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:26.219534 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af488a0-269b-45f9-8dd4-fada8ca4bc3a service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:26.219962 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af488a0-269b-45f9-8dd4-fada8ca4bc3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:26.221886 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8af488a0-269b-45f9-8dd4-fada8ca4bc3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:26.234654 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af488a0-269b-45f9-8dd4-fada8ca4bc3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:26.236887 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af488a0-269b-45f9-8dd4-fada8ca4bc3a service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:26.250167 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 706/1408] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:26.414487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c709c-5d0d-4873-9060-3cc488af0f31 service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:26.416303 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-e45c709c-5d0d-4873-9060-3cc488af0f31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:26.586269 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c709c-5d0d-4873-9060-3cc488af0f31 service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:26.593937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f89d7-6c2d-4c2d-bb6b-bf5ba919136e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:26.594711 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f89d7-6c2d-4c2d-bb6b-bf5ba919136e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:26.595323 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f89d7-6c2d-4c2d-bb6b-bf5ba919136e admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:26.595680 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f89d7-6c2d-4c2d-bb6b-bf5ba919136e admin admin] PATH_INFO: `/v3/projects/f4c2c3e4dda84746bfe81a851696351a` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:26.597505 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f89d7-6c2d-4c2d-bb6b-bf5ba919136e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4c2c3e4dda84746bfe81a851696351a)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:26.600100 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f89d7-6c2d-4c2d-bb6b-bf5ba919136e admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:26.642779 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:26.648398 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af488a0-269b-45f9-8dd4-fada8ca4bc3a service nova] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:26.650447 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8af488a0-269b-45f9-8dd4-fada8ca4bc3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:26.678789 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af488a0-269b-45f9-8dd4-fada8ca4bc3a service nova] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:26.693303 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-285f89d7-6c2d-4c2d-bb6b-bf5ba919136e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4c2c3e4dda84746bfe81a851696351a', 'request_id': 'req-285f89d7-6c2d-4c2d-bb6b-bf5ba919136e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:26.709481 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-285f89d7-6c2d-4c2d-bb6b-bf5ba919136e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4c2c3e4dda84746bfe81a851696351a', 'request_id': 'req-285f89d7-6c2d-4c2d-bb6b-bf5ba919136e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:26.729592 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-285f89d7-6c2d-4c2d-bb6b-bf5ba919136e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4c2c3e4dda84746bfe81a851696351a', 'request_id': 'req-285f89d7-6c2d-4c2d-bb6b-bf5ba919136e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:26.756833 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-285f89d7-6c2d-4c2d-bb6b-bf5ba919136e admin admin] The token cache is being invalidate because project f4c2c3e4dda84746bfe81a851696351a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:26.757132 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-285f89d7-6c2d-4c2d-bb6b-bf5ba919136e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:26.758228 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-285f89d7-6c2d-4c2d-bb6b-bf5ba919136e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:26.761925 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 703/1409] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:26 2022] DELETE /identity/v3/projects/f4c2c3e4dda84746bfe81a851696351a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:26.769281 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f89d7-6c2d-4c2d-bb6b-bf5ba919136e admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:26.770801 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-285f89d7-6c2d-4c2d-bb6b-bf5ba919136e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:26.797486 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b6a1b-5182-48ff-b9a2-b3ff7933d927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:26.799162 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b6a1b-5182-48ff-b9a2-b3ff7933d927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:26.799784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b6a1b-5182-48ff-b9a2-b3ff7933d927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:26.800298 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b6a1b-5182-48ff-b9a2-b3ff7933d927 admin admin] PATH_INFO: `/v3/projects/d7c95b82fd254af3b9d8cac5e1f94999` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:26.802365 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b6a1b-5182-48ff-b9a2-b3ff7933d927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c95b82fd254af3b9d8cac5e1f94999)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:26.806921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b6a1b-5182-48ff-b9a2-b3ff7933d927 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:26.880703 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-430b6a1b-5182-48ff-b9a2-b3ff7933d927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c95b82fd254af3b9d8cac5e1f94999', 'request_id': 'req-430b6a1b-5182-48ff-b9a2-b3ff7933d927'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:26.889961 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f89d7-6c2d-4c2d-bb6b-bf5ba919136e admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:26.893059 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-430b6a1b-5182-48ff-b9a2-b3ff7933d927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c95b82fd254af3b9d8cac5e1f94999', 'request_id': 'req-430b6a1b-5182-48ff-b9a2-b3ff7933d927'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:26.903962 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-430b6a1b-5182-48ff-b9a2-b3ff7933d927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c95b82fd254af3b9d8cac5e1f94999', 'request_id': 'req-430b6a1b-5182-48ff-b9a2-b3ff7933d927'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:26.932707 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-430b6a1b-5182-48ff-b9a2-b3ff7933d927 admin admin] The token cache is being invalidate because project d7c95b82fd254af3b9d8cac5e1f94999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:26.933980 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-430b6a1b-5182-48ff-b9a2-b3ff7933d927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:26.935928 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-430b6a1b-5182-48ff-b9a2-b3ff7933d927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:26.939920 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 707/1410] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:26 2022] DELETE /identity/v3/projects/d7c95b82fd254af3b9d8cac5e1f94999 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:26.945853 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b6a1b-5182-48ff-b9a2-b3ff7933d927 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:26.949586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-430b6a1b-5182-48ff-b9a2-b3ff7933d927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:27.020161 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff73642-beba-456a-9935-126592f2059e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:27.021743 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff73642-beba-456a-9935-126592f2059e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:27.023512 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff73642-beba-456a-9935-126592f2059e admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:27.023927 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff73642-beba-456a-9935-126592f2059e admin admin] PATH_INFO: `/v3/users/e648848bcf584ed19ef8ef9b2e5c3270` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:27.026579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff73642-beba-456a-9935-126592f2059e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e648848bcf584ed19ef8ef9b2e5c3270)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:27.030311 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff73642-beba-456a-9935-126592f2059e admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:27.094393 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b6a1b-5182-48ff-b9a2-b3ff7933d927 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:27.101132 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafac0d-3d25-4d8e-b986-c9e020ed41fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:27.107486 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafac0d-3d25-4d8e-b986-c9e020ed41fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:27.107788 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafac0d-3d25-4d8e-b986-c9e020ed41fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:27.108063 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafac0d-3d25-4d8e-b986-c9e020ed41fe admin admin] PATH_INFO: `/v3/users/a302493a3b494d41930c4e9bc99c1640` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:27.109640 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafac0d-3d25-4d8e-b986-c9e020ed41fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a302493a3b494d41930c4e9bc99c1640)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:27.113086 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafac0d-3d25-4d8e-b986-c9e020ed41fe admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:27.151322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-4ff73642-beba-456a-9935-126592f2059e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e648848bcf584ed19ef8ef9b2e5c3270'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:27.167996 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-4ff73642-beba-456a-9935-126592f2059e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e648848bcf584ed19ef8ef9b2e5c3270'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:27.168201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:27.170706 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:27.189291 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-4ff73642-beba-456a-9935-126592f2059e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e648848bcf584ed19ef8ef9b2e5c3270'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:27.230718 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-4ff73642-beba-456a-9935-126592f2059e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e648848bcf584ed19ef8ef9b2e5c3270'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:27.233392 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-4ff73642-beba-456a-9935-126592f2059e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e648848bcf584ed19ef8ef9b2e5c3270'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:27.251849 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0eafac0d-3d25-4d8e-b986-c9e020ed41fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a302493a3b494d41930c4e9bc99c1640'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:27.259378 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 704/1411] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:26 2022] DELETE /identity/v3/users/e648848bcf584ed19ef8ef9b2e5c3270 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:27.271330 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0eafac0d-3d25-4d8e-b986-c9e020ed41fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a302493a3b494d41930c4e9bc99c1640'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:27.273678 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff73642-beba-456a-9935-126592f2059e admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:27.281734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-4ff73642-beba-456a-9935-126592f2059e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:27.289831 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0eafac0d-3d25-4d8e-b986-c9e020ed41fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a302493a3b494d41930c4e9bc99c1640'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:27.301443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0eafac0d-3d25-4d8e-b986-c9e020ed41fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a302493a3b494d41930c4e9bc99c1640'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:27.303797 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0eafac0d-3d25-4d8e-b986-c9e020ed41fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a302493a3b494d41930c4e9bc99c1640'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:27.314742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 708/1412] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:26 2022] DELETE /identity/v3/users/a302493a3b494d41930c4e9bc99c1640 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:27.409961 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff73642-beba-456a-9935-126592f2059e admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:27.474324 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d569f-e36f-47ae-843d-a0a1b1c9f5ad None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:27.474620 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d569f-e36f-47ae-843d-a0a1b1c9f5ad None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:27.474901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d569f-e36f-47ae-843d-a0a1b1c9f5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:27.551549 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-4c3d569f-e36f-47ae-843d-a0a1b1c9f5ad None None] MFA Rules not processed for user `3b52c3ae1fff462899aa156fe978b03b`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:27.554724 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4c3d569f-e36f-47ae-843d-a0a1b1c9f5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:27.560022 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b4fc6-94d3-4672-87f0-60cd17cc8ac1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b3ca8694ab4a169a3c36561290d8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:27.560725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b4fc6-94d3-4672-87f0-60cd17cc8ac1 service placement] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:27.561083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b4fc6-94d3-4672-87f0-60cd17cc8ac1 service placement] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:27.561397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b4fc6-94d3-4672-87f0-60cd17cc8ac1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:27.570163 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-371b4fc6-94d3-4672-87f0-60cd17cc8ac1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:27.597947 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b4fc6-94d3-4672-87f0-60cd17cc8ac1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:27.599900 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b4fc6-94d3-4672-87f0-60cd17cc8ac1 service placement] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:27.626866 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 705/1413] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:27.671995 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601a94e-b368-4510-9659-ec846d75428e None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:27.672323 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601a94e-b368-4510-9659-ec846d75428e None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:27.672611 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601a94e-b368-4510-9659-ec846d75428e None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:27.674593 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 706/1414] 10.222.0.18 () {54 vars in 912 bytes} [Mon Oct 24 13:13:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:13:27.693478 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef327c9f-4f0d-4368-ac01-63e4fbf0b46e None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:27.694216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef327c9f-4f0d-4368-ac01-63e4fbf0b46e None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:27.694216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef327c9f-4f0d-4368-ac01-63e4fbf0b46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:27.754702 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-ef327c9f-4f0d-4368-ac01-63e4fbf0b46e None None] MFA Rules not processed for user `0f2295659f2e467d8d798bf93f731330`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:27.776892 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-ef327c9f-4f0d-4368-ac01-63e4fbf0b46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:27.787035 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 709/1415] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:27.807888 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d569f-e36f-47ae-843d-a0a1b1c9f5ad None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:27.811517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4c3d569f-e36f-47ae-843d-a0a1b1c9f5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:27.984579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 707/1416] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 24 13:13:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:27.994959 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef327c9f-4f0d-4368-ac01-63e4fbf0b46e None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:28.000167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-ef327c9f-4f0d-4368-ac01-63e4fbf0b46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:28.060215 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:28.145030 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d569f-e36f-47ae-843d-a0a1b1c9f5ad None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:28.166279 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b3bba-e9c9-478f-8d35-794b0841bba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:28.167130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b3bba-e9c9-478f-8d35-794b0841bba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:28.167410 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b3bba-e9c9-478f-8d35-794b0841bba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:28.167706 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b3bba-e9c9-478f-8d35-794b0841bba6 admin admin] PATH_INFO: `/v3/projects/c28295e469f44dfd8ea399670f4d5531` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:28.172324 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b3bba-e9c9-478f-8d35-794b0841bba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c28295e469f44dfd8ea399670f4d5531)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:28.172449 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef327c9f-4f0d-4368-ac01-63e4fbf0b46e None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:28.182260 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b3bba-e9c9-478f-8d35-794b0841bba6 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:28.187315 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e85aaf-cdb7-484f-b308-c68fea6358e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:28.187983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e85aaf-cdb7-484f-b308-c68fea6358e5 service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:28.188293 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e85aaf-cdb7-484f-b308-c68fea6358e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:28.188641 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e85aaf-cdb7-484f-b308-c68fea6358e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:28.223250 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e85aaf-cdb7-484f-b308-c68fea6358e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:28.230741 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e85aaf-cdb7-484f-b308-c68fea6358e5 service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:28.255767 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 708/1417] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:28.295706 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:28.336301 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e85aaf-cdb7-484f-b308-c68fea6358e5 service nova] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:28.339727 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5d6b3bba-e9c9-478f-8d35-794b0841bba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c28295e469f44dfd8ea399670f4d5531', 'request_id': 'req-5d6b3bba-e9c9-478f-8d35-794b0841bba6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:28.339849 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-41e85aaf-cdb7-484f-b308-c68fea6358e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:28.357666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5d6b3bba-e9c9-478f-8d35-794b0841bba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c28295e469f44dfd8ea399670f4d5531', 'request_id': 'req-5d6b3bba-e9c9-478f-8d35-794b0841bba6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:28.362104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e85aaf-cdb7-484f-b308-c68fea6358e5 service nova] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:28.372085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5d6b3bba-e9c9-478f-8d35-794b0841bba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c28295e469f44dfd8ea399670f4d5531', 'request_id': 'req-5d6b3bba-e9c9-478f-8d35-794b0841bba6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:28.406710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5d6b3bba-e9c9-478f-8d35-794b0841bba6 admin admin] The token cache is being invalidate because project c28295e469f44dfd8ea399670f4d5531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:28.407016 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5d6b3bba-e9c9-478f-8d35-794b0841bba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:28.408161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5d6b3bba-e9c9-478f-8d35-794b0841bba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:28.414410 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 710/1418] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:27 2022] DELETE /identity/v3/projects/c28295e469f44dfd8ea399670f4d5531 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:28.423695 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3805793-b3e3-4021-a629-a61c30409271 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:28.424007 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3805793-b3e3-4021-a629-a61c30409271 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:28.424240 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3805793-b3e3-4021-a629-a61c30409271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:28.486910 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-c3805793-b3e3-4021-a629-a61c30409271 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:28.489078 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c3805793-b3e3-4021-a629-a61c30409271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:28.558297 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c68818-b6a7-46ed-90a8-b079e661de46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:28.559012 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c68818-b6a7-46ed-90a8-b079e661de46 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:28.559340 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c68818-b6a7-46ed-90a8-b079e661de46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:28.559730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c68818-b6a7-46ed-90a8-b079e661de46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:28.562693 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-01c68818-b6a7-46ed-90a8-b079e661de46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:28.586681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c68818-b6a7-46ed-90a8-b079e661de46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:28.590482 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c68818-b6a7-46ed-90a8-b079e661de46 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:28.623997 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 709/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:13:28.931600 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 711/1420] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:28.933346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa028f8a-8777-4ac0-be6c-dfa8a47f8351 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:28.933665 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa028f8a-8777-4ac0-be6c-dfa8a47f8351 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:28.933978 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa028f8a-8777-4ac0-be6c-dfa8a47f8351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:28.975892 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-fa028f8a-8777-4ac0-be6c-dfa8a47f8351 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:28.977173 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-fa028f8a-8777-4ac0-be6c-dfa8a47f8351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:28.999676 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 710/1421] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:29.001737 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3805793-b3e3-4021-a629-a61c30409271 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:29.016173 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3805793-b3e3-4021-a629-a61c30409271 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:29.029324 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c7636-e50b-48b4-ad76-b0afe69290f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:29.030030 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c7636-e50b-48b4-ad76-b0afe69290f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:29.031501 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c7636-e50b-48b4-ad76-b0afe69290f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:29.031805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c7636-e50b-48b4-ad76-b0afe69290f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:29.032472 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c7636-e50b-48b4-ad76-b0afe69290f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:29.032773 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c7636-e50b-48b4-ad76-b0afe69290f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:29.036621 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c7636-e50b-48b4-ad76-b0afe69290f9 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:29.072266 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 712/1422] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:29.073514 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa028f8a-8777-4ac0-be6c-dfa8a47f8351 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:29.105787 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa028f8a-8777-4ac0-be6c-dfa8a47f8351 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:29.130359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88852a8b-0267-4869-b447-43f20d9d87f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:29.134698 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88852a8b-0267-4869-b447-43f20d9d87f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:29.135738 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88852a8b-0267-4869-b447-43f20d9d87f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:29.136582 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88852a8b-0267-4869-b447-43f20d9d87f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:29.140276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88852a8b-0267-4869-b447-43f20d9d87f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:29.150429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88852a8b-0267-4869-b447-43f20d9d87f9 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:29.246899 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32e33c-8420-47a9-8dad-c293b46c36e4 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:29.247411 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32e33c-8420-47a9-8dad-c293b46c36e4 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:29.247930 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32e33c-8420-47a9-8dad-c293b46c36e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:29.282146 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 711/1423] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:29 2022] POST /identity/v3/projects => generated 373 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:29.284158 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88852a8b-0267-4869-b447-43f20d9d87f9 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:29.290460 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-88852a8b-0267-4869-b447-43f20d9d87f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:29.326244 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-3f32e33c-8420-47a9-8dad-c293b46c36e4 None None] MFA Rules not processed for user `a2ed22a974be4cfd86108df0b98c4d50`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:29.329441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3f32e33c-8420-47a9-8dad-c293b46c36e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:29.510446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 713/1424] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:29.511258 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32e33c-8420-47a9-8dad-c293b46c36e4 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:29.538503 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88852a8b-0267-4869-b447-43f20d9d87f9 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:29.567977 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7898b87-980a-416a-903d-b2e28ee4d136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:29.568611 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32e33c-8420-47a9-8dad-c293b46c36e4 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:29.569158 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7898b87-980a-416a-903d-b2e28ee4d136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:29.572245 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7898b87-980a-416a-903d-b2e28ee4d136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:29.572716 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7898b87-980a-416a-903d-b2e28ee4d136 admin admin] PATH_INFO: `/v3/projects/0139747ebb5b4308a6098abfc36ca2c1` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:29.576819 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7898b87-980a-416a-903d-b2e28ee4d136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0139747ebb5b4308a6098abfc36ca2c1)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:29.583678 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7898b87-980a-416a-903d-b2e28ee4d136 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:29.586864 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe604906-079a-45e6-a7ca-29bcb3e00109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:29.587829 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe604906-079a-45e6-a7ca-29bcb3e00109 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:29.587955 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe604906-079a-45e6-a7ca-29bcb3e00109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:29.588277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe604906-079a-45e6-a7ca-29bcb3e00109 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:29.588811 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe604906-079a-45e6-a7ca-29bcb3e00109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:29.590882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe604906-079a-45e6-a7ca-29bcb3e00109 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:29.636655 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 714/1425] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:29 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:29.637877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe604906-079a-45e6-a7ca-29bcb3e00109 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:29.640518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-fe604906-079a-45e6-a7ca-29bcb3e00109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:29.645893 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:29.657519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe604906-079a-45e6-a7ca-29bcb3e00109 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:29.670500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2a367-dffe-4def-9c2e-435bd11e9c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:29.673044 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2a367-dffe-4def-9c2e-435bd11e9c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:29.673568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2a367-dffe-4def-9c2e-435bd11e9c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:29.674148 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2a367-dffe-4def-9c2e-435bd11e9c33 admin admin] PATH_INFO: `/v3/projects/9b3b639867d3487982ca69a34c9f1e24` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:29.680372 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2a367-dffe-4def-9c2e-435bd11e9c33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b3b639867d3487982ca69a34c9f1e24)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:29.683051 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2a367-dffe-4def-9c2e-435bd11e9c33 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:29.697807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:29.711635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f7898b87-980a-416a-903d-b2e28ee4d136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0139747ebb5b4308a6098abfc36ca2c1', 'request_id': 'req-f7898b87-980a-416a-903d-b2e28ee4d136'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:29.728398 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f7898b87-980a-416a-903d-b2e28ee4d136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0139747ebb5b4308a6098abfc36ca2c1', 'request_id': 'req-f7898b87-980a-416a-903d-b2e28ee4d136'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:29.739742 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f7898b87-980a-416a-903d-b2e28ee4d136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0139747ebb5b4308a6098abfc36ca2c1', 'request_id': 'req-f7898b87-980a-416a-903d-b2e28ee4d136'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:29.755235 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d7e2a367-dffe-4def-9c2e-435bd11e9c33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b3b639867d3487982ca69a34c9f1e24', 'request_id': 'req-d7e2a367-dffe-4def-9c2e-435bd11e9c33'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:29.768547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f7898b87-980a-416a-903d-b2e28ee4d136 admin admin] The token cache is being invalidate because project 0139747ebb5b4308a6098abfc36ca2c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:29.768837 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f7898b87-980a-416a-903d-b2e28ee4d136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:29.774311 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d7e2a367-dffe-4def-9c2e-435bd11e9c33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b3b639867d3487982ca69a34c9f1e24', 'request_id': 'req-d7e2a367-dffe-4def-9c2e-435bd11e9c33'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:29.775090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f7898b87-980a-416a-903d-b2e28ee4d136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:29.778940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 712/1426] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:29 2022] DELETE /identity/v3/projects/0139747ebb5b4308a6098abfc36ca2c1 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:29.780250 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746125d-f11e-402d-adc2-149eeb2fde45 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:29.780576 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746125d-f11e-402d-adc2-149eeb2fde45 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:29.780877 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746125d-f11e-402d-adc2-149eeb2fde45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:29.794536 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d7e2a367-dffe-4def-9c2e-435bd11e9c33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b3b639867d3487982ca69a34c9f1e24', 'request_id': 'req-d7e2a367-dffe-4def-9c2e-435bd11e9c33'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:29.817760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d7e2a367-dffe-4def-9c2e-435bd11e9c33 admin admin] The token cache is being invalidate because project 9b3b639867d3487982ca69a34c9f1e24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:29.818073 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d7e2a367-dffe-4def-9c2e-435bd11e9c33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:29.819938 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d7e2a367-dffe-4def-9c2e-435bd11e9c33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:29.822324 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 715/1427] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:29 2022] DELETE /identity/v3/projects/9b3b639867d3487982ca69a34c9f1e24 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:29.825382 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2a367-dffe-4def-9c2e-435bd11e9c33 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:29.829083 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d7e2a367-dffe-4def-9c2e-435bd11e9c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:29.843930 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-a746125d-f11e-402d-adc2-149eeb2fde45 None None] MFA Rules not processed for user `a2ed22a974be4cfd86108df0b98c4d50`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:29.845178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-a746125d-f11e-402d-adc2-149eeb2fde45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:29.966889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 713/1428] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:29.971134 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231c565-3b1b-4ad3-a05e-7c8ed3f94437 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:29.971797 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231c565-3b1b-4ad3-a05e-7c8ed3f94437 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:29.972284 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231c565-3b1b-4ad3-a05e-7c8ed3f94437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:29.998066 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-c231c565-3b1b-4ad3-a05e-7c8ed3f94437 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:29.999840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-c231c565-3b1b-4ad3-a05e-7c8ed3f94437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:30.020716 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2a367-dffe-4def-9c2e-435bd11e9c33 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:30.025173 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 714/1429] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:30.027085 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28802d9a-d7f6-4736-982e-717ad5324f09 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:30.027595 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28802d9a-d7f6-4736-982e-717ad5324f09 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:30.028078 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28802d9a-d7f6-4736-982e-717ad5324f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:30.042212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019c50c-b558-40b5-8cca-b16a84fe0966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:30.042860 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019c50c-b558-40b5-8cca-b16a84fe0966 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:30.043145 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019c50c-b558-40b5-8cca-b16a84fe0966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:30.043442 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019c50c-b558-40b5-8cca-b16a84fe0966 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:30.044106 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019c50c-b558-40b5-8cca-b16a84fe0966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:30.045740 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019c50c-b558-40b5-8cca-b16a84fe0966 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:30.086701 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 716/1430] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:30.088744 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cbfca-6295-4f68-9e93-8f9131fb7a68 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:30.089037 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cbfca-6295-4f68-9e93-8f9131fb7a68 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:30.089316 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cbfca-6295-4f68-9e93-8f9131fb7a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:30.121559 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-28802d9a-d7f6-4736-982e-717ad5324f09 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:30.125456 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-28802d9a-d7f6-4736-982e-717ad5324f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:30.162716 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 715/1431] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:30.168934 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28802d9a-d7f6-4736-982e-717ad5324f09 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:30.197855 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-678cbfca-6295-4f68-9e93-8f9131fb7a68 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:30.199855 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-678cbfca-6295-4f68-9e93-8f9131fb7a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:30.202780 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28802d9a-d7f6-4736-982e-717ad5324f09 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:30.218014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeef126-9850-49b6-96bf-7e18032bf0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:30.219222 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeef126-9850-49b6-96bf-7e18032bf0ef admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:30.219756 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeef126-9850-49b6-96bf-7e18032bf0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:30.220228 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeef126-9850-49b6-96bf-7e18032bf0ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:30.221351 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeef126-9850-49b6-96bf-7e18032bf0ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:30.222477 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 717/1432] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:30.223357 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeef126-9850-49b6-96bf-7e18032bf0ef admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:30.223995 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9cbe1-929e-47b8-bb8e-2345725d89bf None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:30.224374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9cbe1-929e-47b8-bb8e-2345725d89bf None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:30.225444 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9cbe1-929e-47b8-bb8e-2345725d89bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:30.238868 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 716/1433] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:30.238868 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeef126-9850-49b6-96bf-7e18032bf0ef admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:30.271131 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeef126-9850-49b6-96bf-7e18032bf0ef admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:30.278712 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-1db9cbe1-929e-47b8-bb8e-2345725d89bf None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:30.279963 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1db9cbe1-929e-47b8-bb8e-2345725d89bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:30.284025 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4401ad-a81d-4d0f-b44f-be3f9c873347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:30.285167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4401ad-a81d-4d0f-b44f-be3f9c873347 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:30.285641 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4401ad-a81d-4d0f-b44f-be3f9c873347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:30.286283 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4401ad-a81d-4d0f-b44f-be3f9c873347 admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:30.287251 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4401ad-a81d-4d0f-b44f-be3f9c873347 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:30.287777 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4401ad-a81d-4d0f-b44f-be3f9c873347 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:30.289691 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4401ad-a81d-4d0f-b44f-be3f9c873347 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:30.336161 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 717/1434] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:30.338083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4401ad-a81d-4d0f-b44f-be3f9c873347 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:30.338646 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 718/1435] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:30.341302 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9cbe1-929e-47b8-bb8e-2345725d89bf None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:30.344218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1db9cbe1-929e-47b8-bb8e-2345725d89bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:30.375132 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4401ad-a81d-4d0f-b44f-be3f9c873347 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:30.406599 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cadc9-d32b-40cf-8793-28c50cbe8173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:30.411588 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cadc9-d32b-40cf-8793-28c50cbe8173 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:30.411874 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cadc9-d32b-40cf-8793-28c50cbe8173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:30.413876 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cadc9-d32b-40cf-8793-28c50cbe8173 admin admin] PATH_INFO: `/v3/projects/06f2866f775b41a5b5721658223e0e0f/users/a00d787da0dc403cae4e5bb2cba7db9c/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:30.451777 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35cadc9-d32b-40cf-8793-28c50cbe8173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f2866f775b41a5b5721658223e0e0f, user_id=a00d787da0dc403cae4e5bb2cba7db9c, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:30.459090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35cadc9-d32b-40cf-8793-28c50cbe8173 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:30.511534 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 718/1436] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:30 2022] PUT /identity/v3/projects/06f2866f775b41a5b5721658223e0e0f/users/a00d787da0dc403cae4e5bb2cba7db9c/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:30.512397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cadc9-d32b-40cf-8793-28c50cbe8173 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:30.617834 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9cbe1-929e-47b8-bb8e-2345725d89bf None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:30.652652 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:30.750659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e951ff1-a190-4bae-8961-4b6fbda06fa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:30.751674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e951ff1-a190-4bae-8961-4b6fbda06fa2 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:30.752243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:30.753125 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e951ff1-a190-4bae-8961-4b6fbda06fa2 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:30.753788 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e951ff1-a190-4bae-8961-4b6fbda06fa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:30.756325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8e951ff1-a190-4bae-8961-4b6fbda06fa2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:30.796892 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cadc9-d32b-40cf-8793-28c50cbe8173 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:30.814503 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f901c1-c61d-474f-bf9f-ddd025179813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:30.815276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f901c1-c61d-474f-bf9f-ddd025179813 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:30.815588 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f901c1-c61d-474f-bf9f-ddd025179813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:30.815864 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f901c1-c61d-474f-bf9f-ddd025179813 admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:30.816517 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f901c1-c61d-474f-bf9f-ddd025179813 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:30.816866 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f901c1-c61d-474f-bf9f-ddd025179813 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:30.818784 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f901c1-c61d-474f-bf9f-ddd025179813 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:30.853701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 719/1437] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:30.853701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f901c1-c61d-474f-bf9f-ddd025179813 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:30.865395 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f901c1-c61d-474f-bf9f-ddd025179813 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:30.879034 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f4f4f-59ba-4934-9925-72ebb4416fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:30.879034 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f4f4f-59ba-4934-9925-72ebb4416fcb admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:30.879346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f4f4f-59ba-4934-9925-72ebb4416fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:30.879605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f4f4f-59ba-4934-9925-72ebb4416fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:30.880252 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f4f4f-59ba-4934-9925-72ebb4416fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:30.882300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f4f4f-59ba-4934-9925-72ebb4416fcb admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:30.888404 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e951ff1-a190-4bae-8961-4b6fbda06fa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:30.889849 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e951ff1-a190-4bae-8961-4b6fbda06fa2 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:30.910971 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 719/1438] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:30 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:30.912333 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c40e14-b33c-4b94-bb8d-0f72b94d4539 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:30.912831 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c40e14-b33c-4b94-bb8d-0f72b94d4539 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:30.912940 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c40e14-b33c-4b94-bb8d-0f72b94d4539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:30.968349 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 720/1439] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:30 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:30.970324 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f4f4f-59ba-4934-9925-72ebb4416fcb admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:30.976531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-e2c40e14-b33c-4b94-bb8d-0f72b94d4539 None None] MFA Rules not processed for user `a00d787da0dc403cae4e5bb2cba7db9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:30.979756 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e2c40e14-b33c-4b94-bb8d-0f72b94d4539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:31.120106 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f4f4f-59ba-4934-9925-72ebb4416fcb admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:31.135589 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6262575-d59e-4562-8bb4-32391b5dc030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:31.136765 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6262575-d59e-4562-8bb4-32391b5dc030 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:31.137396 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6262575-d59e-4562-8bb4-32391b5dc030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:31.138766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6262575-d59e-4562-8bb4-32391b5dc030 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:31.141952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6262575-d59e-4562-8bb4-32391b5dc030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:31.144576 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6262575-d59e-4562-8bb4-32391b5dc030 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:31.211584 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 721/1440] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:30 2022] POST /identity/v3/projects => generated 401 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:31.213119 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6262575-d59e-4562-8bb4-32391b5dc030 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:31.236441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 720/1441] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:31.241067 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c40e14-b33c-4b94-bb8d-0f72b94d4539 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:31.266117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c40e14-b33c-4b94-bb8d-0f72b94d4539 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:31.364952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6262575-d59e-4562-8bb4-32391b5dc030 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:31.404240 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f84427-6385-4e6c-840f-2f4a94034708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:31.406607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f84427-6385-4e6c-840f-2f4a94034708 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:31.406887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f84427-6385-4e6c-840f-2f4a94034708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:31.407177 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f84427-6385-4e6c-840f-2f4a94034708 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:31.407598 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:31.411203 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f84427-6385-4e6c-840f-2f4a94034708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:31.417800 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f84427-6385-4e6c-840f-2f4a94034708 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:31.455442 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8028e7a-c764-4a19-8436-b9b8f5626c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:31.456040 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8028e7a-c764-4a19-8436-b9b8f5626c80 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:31.457497 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8028e7a-c764-4a19-8436-b9b8f5626c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:31.475000 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8028e7a-c764-4a19-8436-b9b8f5626c80 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:31.481113 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8028e7a-c764-4a19-8436-b9b8f5626c80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:31.501949 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8028e7a-c764-4a19-8436-b9b8f5626c80 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:31.525797 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 722/1442] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:31 2022] POST /identity/v3/users => generated 293 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:31.532680 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f84427-6385-4e6c-840f-2f4a94034708 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:31.572595 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f84427-6385-4e6c-840f-2f4a94034708 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:31.584059 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 721/1443] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:31 2022] POST /identity/v3/users => generated 301 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:31.585135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8028e7a-c764-4a19-8436-b9b8f5626c80 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:31.593391 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bdcd1-3f72-4774-9614-b09ba59c56b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:31.597505 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bdcd1-3f72-4774-9614-b09ba59c56b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:31.597827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bdcd1-3f72-4774-9614-b09ba59c56b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:31.598101 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bdcd1-3f72-4774-9614-b09ba59c56b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:31.598821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250bdcd1-3f72-4774-9614-b09ba59c56b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:31.604456 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250bdcd1-3f72-4774-9614-b09ba59c56b7 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:31.622279 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8028e7a-c764-4a19-8436-b9b8f5626c80 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:31.646364 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505545ea-a2ba-4375-b0d6-ca7dd5a22369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:31.647119 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505545ea-a2ba-4375-b0d6-ca7dd5a22369 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:31.650899 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505545ea-a2ba-4375-b0d6-ca7dd5a22369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:31.651274 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505545ea-a2ba-4375-b0d6-ca7dd5a22369 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:31.654163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505545ea-a2ba-4375-b0d6-ca7dd5a22369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:31.660098 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505545ea-a2ba-4375-b0d6-ca7dd5a22369 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:31.682119 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 722/1444] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:31.683367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505545ea-a2ba-4375-b0d6-ca7dd5a22369 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:31.698200 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 723/1445] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:31 2022] POST /identity/v3/projects => generated 371 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:31.699178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bdcd1-3f72-4774-9614-b09ba59c56b7 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:31.716238 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505545ea-a2ba-4375-b0d6-ca7dd5a22369 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:31.742793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:31.865759 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bdcd1-3f72-4774-9614-b09ba59c56b7 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:31.883784 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ca2d4-5bc8-4e71-a271-d7b9a9fc80b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:31.884457 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc989e71-0dc5-416b-aff0-cc51ea448749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:31.885340 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc989e71-0dc5-416b-aff0-cc51ea448749 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:31.885616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc989e71-0dc5-416b-aff0-cc51ea448749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:31.887725 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc989e71-0dc5-416b-aff0-cc51ea448749 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:31.889962 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ca2d4-5bc8-4e71-a271-d7b9a9fc80b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:31.890235 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ca2d4-5bc8-4e71-a271-d7b9a9fc80b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:31.891698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc989e71-0dc5-416b-aff0-cc51ea448749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:31.895271 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ca2d4-5bc8-4e71-a271-d7b9a9fc80b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:31.896093 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ca2d4-5bc8-4e71-a271-d7b9a9fc80b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:31.899270 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc989e71-0dc5-416b-aff0-cc51ea448749 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:31.901867 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ca2d4-5bc8-4e71-a271-d7b9a9fc80b3 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:31.941122 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 723/1446] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:31.941866 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc989e71-0dc5-416b-aff0-cc51ea448749 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:31.942508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 724/1447] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:31.945624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ca2d4-5bc8-4e71-a271-d7b9a9fc80b3 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:31.981134 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ca2d4-5bc8-4e71-a271-d7b9a9fc80b3 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:31.982458 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc989e71-0dc5-416b-aff0-cc51ea448749 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:32.002173 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2172603-63c6-4675-8931-7cededa59950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:32.002853 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2172603-63c6-4675-8931-7cededa59950 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:32.003130 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2172603-63c6-4675-8931-7cededa59950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:32.003402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2172603-63c6-4675-8931-7cededa59950 admin admin] PATH_INFO: `/v3/projects/3fc68623e80b4957973c1501d5bb6502/users/5118c0f680004de8bec13d0e86830840/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:32.004809 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c43ab-4918-4167-8ef0-838748a37642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:32.005422 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c43ab-4918-4167-8ef0-838748a37642 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:32.005693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c43ab-4918-4167-8ef0-838748a37642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:32.006114 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c43ab-4918-4167-8ef0-838748a37642 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:32.010719 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c43ab-4918-4167-8ef0-838748a37642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:32.018974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c43ab-4918-4167-8ef0-838748a37642 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:32.076418 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2172603-63c6-4675-8931-7cededa59950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fc68623e80b4957973c1501d5bb6502, user_id=5118c0f680004de8bec13d0e86830840, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:32.090501 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2172603-63c6-4675-8931-7cededa59950 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:32.123356 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 724/1448] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:31 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:32.123356 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c43ab-4918-4167-8ef0-838748a37642 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:32.144768 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 725/1449] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:31 2022] PUT /identity/v3/projects/3fc68623e80b4957973c1501d5bb6502/users/5118c0f680004de8bec13d0e86830840/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:32.147641 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7027d-f06d-4ebb-b90c-cb3fc9d51e19 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:32.151007 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7027d-f06d-4ebb-b90c-cb3fc9d51e19 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:32.151348 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7027d-f06d-4ebb-b90c-cb3fc9d51e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:32.162190 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c43ab-4918-4167-8ef0-838748a37642 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:32.323004 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4cd29-9e54-41e4-809d-22cd6b6c329a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:32.324400 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4cd29-9e54-41e4-809d-22cd6b6c329a admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:32.324830 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4cd29-9e54-41e4-809d-22cd6b6c329a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:32.326184 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4cd29-9e54-41e4-809d-22cd6b6c329a admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:32.326998 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4cd29-9e54-41e4-809d-22cd6b6c329a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:32.328258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-85d7027d-f06d-4ebb-b90c-cb3fc9d51e19 None None] MFA Rules not processed for user `f3254b4fddaa4f099c6c44f4c139ee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:32.331600 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-85d7027d-f06d-4ebb-b90c-cb3fc9d51e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:32.338560 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4cd29-9e54-41e4-809d-22cd6b6c329a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:32.363341 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 725/1450] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:32.365081 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4cd29-9e54-41e4-809d-22cd6b6c329a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:32.388028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4cd29-9e54-41e4-809d-22cd6b6c329a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:32.405198 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34386d-6393-4e9c-84dd-8182a6645497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:32.405934 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34386d-6393-4e9c-84dd-8182a6645497 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:32.407723 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34386d-6393-4e9c-84dd-8182a6645497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:32.408105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34386d-6393-4e9c-84dd-8182a6645497 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:32.410280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34386d-6393-4e9c-84dd-8182a6645497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:32.412581 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34386d-6393-4e9c-84dd-8182a6645497 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:32.451043 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 726/1451] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:32.452989 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c470da5-3c43-4010-8f67-155fe70ae9ad None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:32.454827 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c470da5-3c43-4010-8f67-155fe70ae9ad None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:32.455791 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c470da5-3c43-4010-8f67-155fe70ae9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:32.485496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 726/1452] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 24 13:13:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:32.486428 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7027d-f06d-4ebb-b90c-cb3fc9d51e19 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:32.513740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7027d-f06d-4ebb-b90c-cb3fc9d51e19 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:32.549740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a6459-ef7e-4fcf-9b2b-6c8c609c8489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:32.550560 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a6459-ef7e-4fcf-9b2b-6c8c609c8489 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:32.551387 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a6459-ef7e-4fcf-9b2b-6c8c609c8489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:32.551895 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a6459-ef7e-4fcf-9b2b-6c8c609c8489 admin admin] PATH_INFO: `/v3/projects/0865b8f7fc6e44f08ed04e88ca74817e/users/7be5f9153dcf4881ac359a57afa8a694/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:32.561931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-7c470da5-3c43-4010-8f67-155fe70ae9ad None None] MFA Rules not processed for user `5118c0f680004de8bec13d0e86830840`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:32.566282 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7c470da5-3c43-4010-8f67-155fe70ae9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:32.594415 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a6459-ef7e-4fcf-9b2b-6c8c609c8489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0865b8f7fc6e44f08ed04e88ca74817e, user_id=7be5f9153dcf4881ac359a57afa8a694, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:32.597850 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a6459-ef7e-4fcf-9b2b-6c8c609c8489 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:32.627508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:32.636311 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 727/1453] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:32 2022] PUT /identity/v3/projects/0865b8f7fc6e44f08ed04e88ca74817e/users/7be5f9153dcf4881ac359a57afa8a694/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:32.644904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a6459-ef7e-4fcf-9b2b-6c8c609c8489 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:32.797412 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:32.874930 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 727/1454] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:32.890737 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb332f60-6348-4e6d-8113-ce79ae03f35d None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:32.891037 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb332f60-6348-4e6d-8113-ce79ae03f35d None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:32.891293 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb332f60-6348-4e6d-8113-ce79ae03f35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:32.896044 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a6459-ef7e-4fcf-9b2b-6c8c609c8489 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:32.902153 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1707983-2954-4eca-9f6b-600f8b1a84fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:32.903345 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1707983-2954-4eca-9f6b-600f8b1a84fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:32.904522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1707983-2954-4eca-9f6b-600f8b1a84fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:32.905460 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1707983-2954-4eca-9f6b-600f8b1a84fd admin admin] PATH_INFO: `/v3/projects/670967dec357493892dcc750c7795f41/users/30269fdb24cd4493ae8b89b97705d929/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:32.940248 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1707983-2954-4eca-9f6b-600f8b1a84fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=670967dec357493892dcc750c7795f41, user_id=30269fdb24cd4493ae8b89b97705d929, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:32.943078 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1707983-2954-4eca-9f6b-600f8b1a84fd admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:32.987656 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 728/1455] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:32 2022] PUT /identity/v3/projects/670967dec357493892dcc750c7795f41/users/30269fdb24cd4493ae8b89b97705d929/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:32.988297 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1707983-2954-4eca-9f6b-600f8b1a84fd admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:32.996285 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b1707983-2954-4eca-9f6b-600f8b1a84fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:32.999466 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-bb332f60-6348-4e6d-8113-ce79ae03f35d None None] MFA Rules not processed for user `7be5f9153dcf4881ac359a57afa8a694`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:33.001273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-bb332f60-6348-4e6d-8113-ce79ae03f35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:33.203318 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 728/1456] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:32 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:33.204523 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb332f60-6348-4e6d-8113-ce79ae03f35d None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:33.210965 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-bb332f60-6348-4e6d-8113-ce79ae03f35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:33.227827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1707983-2954-4eca-9f6b-600f8b1a84fd admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:33.242000 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab04f2a-4bde-4b64-b302-ba25efe0b0fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '768c71ab4ab241e4bfed9f7561ae3d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:33.242554 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab04f2a-4bde-4b64-b302-ba25efe0b0fb service swift] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:33.245349 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab04f2a-4bde-4b64-b302-ba25efe0b0fb service swift] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:33.245659 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab04f2a-4bde-4b64-b302-ba25efe0b0fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:33.392489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb332f60-6348-4e6d-8113-ce79ae03f35d None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:33.402568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f34292-a1dd-4f72-a473-9c79aef1397f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:33.403210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f34292-a1dd-4f72-a473-9c79aef1397f service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:33.403592 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f34292-a1dd-4f72-a473-9c79aef1397f service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:33.403913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f34292-a1dd-4f72-a473-9c79aef1397f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:33.421485 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab04f2a-4bde-4b64-b302-ba25efe0b0fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:33.428396 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab04f2a-4bde-4b64-b302-ba25efe0b0fb service swift] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:33.452474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 729/1457] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 24 13:13:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:13:33.453371 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab04f2a-4bde-4b64-b302-ba25efe0b0fb service swift] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:33.523645 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:33.554602 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab04f2a-4bde-4b64-b302-ba25efe0b0fb service swift] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:33.572337 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4351a9-79e4-4235-a311-0f16124a367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:33.573325 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4351a9-79e4-4235-a311-0f16124a367f admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:33.577351 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4351a9-79e4-4235-a311-0f16124a367f admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:33.577738 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4351a9-79e4-4235-a311-0f16124a367f admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:33.579962 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4351a9-79e4-4235-a311-0f16124a367f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:33.592736 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4351a9-79e4-4235-a311-0f16124a367f admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:33.628813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f34292-a1dd-4f72-a473-9c79aef1397f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:33.630851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f34292-a1dd-4f72-a473-9c79aef1397f service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:33.634896 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 730/1458] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:33.636023 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4351a9-79e4-4235-a311-0f16124a367f admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:33.670452 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 729/1459] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:33.671483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f34292-a1dd-4f72-a473-9c79aef1397f service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:33.673667 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4351a9-79e4-4235-a311-0f16124a367f admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:33.689587 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:33.692359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31df656-1723-4b86-8a7c-96eccfa20aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:33.693006 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31df656-1723-4b86-8a7c-96eccfa20aef admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:33.693293 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31df656-1723-4b86-8a7c-96eccfa20aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:33.697211 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31df656-1723-4b86-8a7c-96eccfa20aef admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:33.700704 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31df656-1723-4b86-8a7c-96eccfa20aef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:33.705147 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f34292-a1dd-4f72-a473-9c79aef1397f service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:33.705311 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31df656-1723-4b86-8a7c-96eccfa20aef admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:33.748634 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86cf31-f2cd-4575-99b9-b53708cd8d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:33.752453 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86cf31-f2cd-4575-99b9-b53708cd8d5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:33.753072 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86cf31-f2cd-4575-99b9-b53708cd8d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:33.753739 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86cf31-f2cd-4575-99b9-b53708cd8d5b admin admin] PATH_INFO: `/v3/projects/670967dec357493892dcc750c7795f41/users/30269fdb24cd4493ae8b89b97705d929/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:33.758874 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86cf31-f2cd-4575-99b9-b53708cd8d5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=670967dec357493892dcc750c7795f41, user_id=30269fdb24cd4493ae8b89b97705d929, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:33.766268 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86cf31-f2cd-4575-99b9-b53708cd8d5b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:33.787654 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 730/1460] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:33 2022] PUT /identity/v3/projects/670967dec357493892dcc750c7795f41/users/30269fdb24cd4493ae8b89b97705d929/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:33.789243 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86cf31-f2cd-4575-99b9-b53708cd8d5b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:33.803327 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 731/1461] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:33 2022] POST /identity/v3/projects => generated 399 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:33.811660 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2f766-3d98-4901-a17c-d31212cc5122 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:33.812146 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2f766-3d98-4901-a17c-d31212cc5122 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:33.812455 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2f766-3d98-4901-a17c-d31212cc5122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:33.905417 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-fef2f766-3d98-4901-a17c-d31212cc5122 None None] MFA Rules not processed for user `30269fdb24cd4493ae8b89b97705d929`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:33.907105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-fef2f766-3d98-4901-a17c-d31212cc5122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:34.017607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86cf31-f2cd-4575-99b9-b53708cd8d5b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:34.115473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 732/1462] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:34.115473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2f766-3d98-4901-a17c-d31212cc5122 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:34.255460 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb98257-102a-45ef-98a2-71ccec29a446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:34.256388 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb98257-102a-45ef-98a2-71ccec29a446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:34.256976 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb98257-102a-45ef-98a2-71ccec29a446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:34.257409 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb98257-102a-45ef-98a2-71ccec29a446 admin admin] PATH_INFO: `/v3/users/5118c0f680004de8bec13d0e86830840` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:34.261027 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb98257-102a-45ef-98a2-71ccec29a446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5118c0f680004de8bec13d0e86830840)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:34.265916 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb98257-102a-45ef-98a2-71ccec29a446 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:34.423951 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2f766-3d98-4901-a17c-d31212cc5122 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:34.430140 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cfb98257-102a-45ef-98a2-71ccec29a446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5118c0f680004de8bec13d0e86830840'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:34.448594 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810a6f5-60f2-4841-be93-b56c6860afcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:34.449694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810a6f5-60f2-4841-be93-b56c6860afcc admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:34.450117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810a6f5-60f2-4841-be93-b56c6860afcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:34.453780 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810a6f5-60f2-4841-be93-b56c6860afcc admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:34.454749 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810a6f5-60f2-4841-be93-b56c6860afcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:34.457596 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cfb98257-102a-45ef-98a2-71ccec29a446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5118c0f680004de8bec13d0e86830840'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:34.463303 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810a6f5-60f2-4841-be93-b56c6860afcc admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:34.514966 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cfb98257-102a-45ef-98a2-71ccec29a446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5118c0f680004de8bec13d0e86830840'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:34.547539 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 733/1463] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:34 2022] POST /identity/v3/users => generated 306 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:34.548737 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810a6f5-60f2-4841-be93-b56c6860afcc admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:34.574285 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cfb98257-102a-45ef-98a2-71ccec29a446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5118c0f680004de8bec13d0e86830840'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:34.576761 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cfb98257-102a-45ef-98a2-71ccec29a446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5118c0f680004de8bec13d0e86830840'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:34.623040 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 731/1464] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:33 2022] DELETE /identity/v3/users/5118c0f680004de8bec13d0e86830840 => generated 0 bytes in 834 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:34.624653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced10eca-b91c-4f6f-8093-1c376de20c2c None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:34.630621 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced10eca-b91c-4f6f-8093-1c376de20c2c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:34.630775 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced10eca-b91c-4f6f-8093-1c376de20c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:34.652988 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:34.734444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810a6f5-60f2-4841-be93-b56c6860afcc admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:34.746939 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-ced10eca-b91c-4f6f-8093-1c376de20c2c None None] MFA Rules not processed for user `3b52c3ae1fff462899aa156fe978b03b`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:34.750375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ced10eca-b91c-4f6f-8093-1c376de20c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:34.792374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:34.910501 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 732/1465] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:34.912747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced10eca-b91c-4f6f-8093-1c376de20c2c None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:34.931707 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ced10eca-b91c-4f6f-8093-1c376de20c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:34.953196 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c070e-3c14-44f4-82b8-08c1c5c2c0c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:34.953952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c070e-3c14-44f4-82b8-08c1c5c2c0c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:34.954517 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c070e-3c14-44f4-82b8-08c1c5c2c0c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:34.954918 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c070e-3c14-44f4-82b8-08c1c5c2c0c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:34.957380 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-226c070e-3c14-44f4-82b8-08c1c5c2c0c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:35.148795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced10eca-b91c-4f6f-8093-1c376de20c2c None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:35.164573 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26563eb-ddc9-4f7c-9703-9ae06a9b074f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:35.167008 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26563eb-ddc9-4f7c-9703-9ae06a9b074f admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:35.168504 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26563eb-ddc9-4f7c-9703-9ae06a9b074f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:35.169625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26563eb-ddc9-4f7c-9703-9ae06a9b074f admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:35.172413 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26563eb-ddc9-4f7c-9703-9ae06a9b074f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:35.176808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26563eb-ddc9-4f7c-9703-9ae06a9b074f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:35.211400 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 733/1466] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:35.216037 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a148d-8a4b-4d5b-a6d9-7f2e6630be73 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:35.218010 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a148d-8a4b-4d5b-a6d9-7f2e6630be73 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:35.219762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a148d-8a4b-4d5b-a6d9-7f2e6630be73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:35.300063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c070e-3c14-44f4-82b8-08c1c5c2c0c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:35.302364 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c070e-3c14-44f4-82b8-08c1c5c2c0c1 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:35.306166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-e43a148d-8a4b-4d5b-a6d9-7f2e6630be73 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:35.310022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e43a148d-8a4b-4d5b-a6d9-7f2e6630be73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:35.351491 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 734/1467] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:35.356473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde914a6-38c5-448b-8be3-a47b154b5b65 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:35.360401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde914a6-38c5-448b-8be3-a47b154b5b65 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:35.362836 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde914a6-38c5-448b-8be3-a47b154b5b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:35.376678 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 734/1468] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 828 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:35.377547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c070e-3c14-44f4-82b8-08c1c5c2c0c1 service cinder] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:35.441497 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c070e-3c14-44f4-82b8-08c1c5c2c0c1 service cinder] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:35.444721 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-bde914a6-38c5-448b-8be3-a47b154b5b65 None None] MFA Rules not processed for user `a2ed22a974be4cfd86108df0b98c4d50`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:35.455091 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-bde914a6-38c5-448b-8be3-a47b154b5b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:35.460180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b2c60-f5ec-42a6-9674-9f3e4650fcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:35.460866 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b2c60-f5ec-42a6-9674-9f3e4650fcc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:35.461125 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b2c60-f5ec-42a6-9674-9f3e4650fcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:35.461393 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b2c60-f5ec-42a6-9674-9f3e4650fcc8 admin admin] PATH_INFO: `/v3/projects/72f616501c384b90aa54b7e74ea0077a/users/c151cbf2e8294a6c9cd3ad0afb646e1e/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:35.532948 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b2c60-f5ec-42a6-9674-9f3e4650fcc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72f616501c384b90aa54b7e74ea0077a, user_id=c151cbf2e8294a6c9cd3ad0afb646e1e, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:35.577544 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b2c60-f5ec-42a6-9674-9f3e4650fcc8 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:35.626534 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 735/1469] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:35 2022] PUT /identity/v3/projects/72f616501c384b90aa54b7e74ea0077a/users/c151cbf2e8294a6c9cd3ad0afb646e1e/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:35.628876 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b2c60-f5ec-42a6-9674-9f3e4650fcc8 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:35.637807 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-fe5b2c60-f5ec-42a6-9674-9f3e4650fcc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:35.758518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 735/1470] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:35.760843 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde914a6-38c5-448b-8be3-a47b154b5b65 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:35.800026 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde914a6-38c5-448b-8be3-a47b154b5b65 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:35.855550 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b2c60-f5ec-42a6-9674-9f3e4650fcc8 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:35.870006 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af8d12-88f2-45b0-91ac-1319c614ca07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:35.870905 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af8d12-88f2-45b0-91ac-1319c614ca07 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:35.873784 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af8d12-88f2-45b0-91ac-1319c614ca07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:35.874219 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af8d12-88f2-45b0-91ac-1319c614ca07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:35.944428 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:35.965895 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:35.987387 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f3240-958a-4475-913f-88b3a0ba7595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:35.988189 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f3240-958a-4475-913f-88b3a0ba7595 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:35.991266 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f3240-958a-4475-913f-88b3a0ba7595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:35.991686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f3240-958a-4475-913f-88b3a0ba7595 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:35.992489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f3240-958a-4475-913f-88b3a0ba7595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:35.994890 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f3240-958a-4475-913f-88b3a0ba7595 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:36.017181 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 736/1471] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:36.022651 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f3240-958a-4475-913f-88b3a0ba7595 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:36.051680 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af8d12-88f2-45b0-91ac-1319c614ca07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:36.053446 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af8d12-88f2-45b0-91ac-1319c614ca07 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:36.053995 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f3240-958a-4475-913f-88b3a0ba7595 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:36.064412 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc56c70-6681-4138-a546-4511a670ae05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:36.066968 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc56c70-6681-4138-a546-4511a670ae05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:36.068574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc56c70-6681-4138-a546-4511a670ae05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:36.069714 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc56c70-6681-4138-a546-4511a670ae05 admin admin] PATH_INFO: `/v3/projects/72f616501c384b90aa54b7e74ea0077a/users/c151cbf2e8294a6c9cd3ad0afb646e1e/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:36.074987 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc56c70-6681-4138-a546-4511a670ae05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72f616501c384b90aa54b7e74ea0077a, user_id=c151cbf2e8294a6c9cd3ad0afb646e1e, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:36.080522 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc56c70-6681-4138-a546-4511a670ae05 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:36.082840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 736/1472] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:36.104320 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 737/1473] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:36 2022] PUT /identity/v3/projects/72f616501c384b90aa54b7e74ea0077a/users/c151cbf2e8294a6c9cd3ad0afb646e1e/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:36.114944 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde74509-7215-4d26-aa89-1c8a3f0848af None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:36.115376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde74509-7215-4d26-aa89-1c8a3f0848af None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:36.115882 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde74509-7215-4d26-aa89-1c8a3f0848af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:36.211465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-bde74509-7215-4d26-aa89-1c8a3f0848af None None] MFA Rules not processed for user `c151cbf2e8294a6c9cd3ad0afb646e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:36.218132 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-bde74509-7215-4d26-aa89-1c8a3f0848af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:36.472320 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 737/1474] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:36 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:36.559040 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc56c70-6681-4138-a546-4511a670ae05 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:36.561961 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4bc56c70-6681-4138-a546-4511a670ae05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:36.794694 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc56c70-6681-4138-a546-4511a670ae05 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:36.808387 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe40ca-fa6a-46df-afb2-bba24ffb7cec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:36.809807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe40ca-fa6a-46df-afb2-bba24ffb7cec service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:36.810541 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe40ca-fa6a-46df-afb2-bba24ffb7cec service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:36.811348 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe40ca-fa6a-46df-afb2-bba24ffb7cec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:36.844620 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe40ca-fa6a-46df-afb2-bba24ffb7cec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:36.846106 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe40ca-fa6a-46df-afb2-bba24ffb7cec service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:36.876831 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 738/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:36 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:36.923937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde74509-7215-4d26-aa89-1c8a3f0848af None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:36.935690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-bde74509-7215-4d26-aa89-1c8a3f0848af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:37.080446 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde74509-7215-4d26-aa89-1c8a3f0848af None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:37.101245 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8918415-97c9-4a5f-bdd3-9866881f8148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:37.101921 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8918415-97c9-4a5f-bdd3-9866881f8148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:37.102201 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8918415-97c9-4a5f-bdd3-9866881f8148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:37.103757 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8918415-97c9-4a5f-bdd3-9866881f8148 admin admin] PATH_INFO: `/v3/users/a00d787da0dc403cae4e5bb2cba7db9c` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:37.107674 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8918415-97c9-4a5f-bdd3-9866881f8148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a00d787da0dc403cae4e5bb2cba7db9c)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:37.109974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe40ca-fa6a-46df-afb2-bba24ffb7cec service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:37.113550 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8918415-97c9-4a5f-bdd3-9866881f8148 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:37.130719 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe40ca-fa6a-46df-afb2-bba24ffb7cec service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:37.150722 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ef0db-b2bd-4c32-b96e-743df552c708 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:37.152704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ef0db-b2bd-4c32-b96e-743df552c708 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:37.154991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ef0db-b2bd-4c32-b96e-743df552c708 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:37.155949 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ef0db-b2bd-4c32-b96e-743df552c708 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:37.158151 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c96ef0db-b2bd-4c32-b96e-743df552c708 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:37.365870 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:37.372383 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e8918415-97c9-4a5f-bdd3-9866881f8148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a00d787da0dc403cae4e5bb2cba7db9c'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:37.407451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e8918415-97c9-4a5f-bdd3-9866881f8148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a00d787da0dc403cae4e5bb2cba7db9c'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:37.429399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ef0db-b2bd-4c32-b96e-743df552c708 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:37.432094 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ef0db-b2bd-4c32-b96e-743df552c708 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:37.435722 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e8918415-97c9-4a5f-bdd3-9866881f8148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a00d787da0dc403cae4e5bb2cba7db9c'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:37.478069 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 739/1476] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:37 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:37.492247 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e8918415-97c9-4a5f-bdd3-9866881f8148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a00d787da0dc403cae4e5bb2cba7db9c'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:37.495433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e8918415-97c9-4a5f-bdd3-9866881f8148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a00d787da0dc403cae4e5bb2cba7db9c'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:37.525779 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 738/1477] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:36 2022] DELETE /identity/v3/users/a00d787da0dc403cae4e5bb2cba7db9c => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:37.530065 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48892c31-b449-4e15-9423-389a6d36937e None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:37.530353 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48892c31-b449-4e15-9423-389a6d36937e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:37.530628 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48892c31-b449-4e15-9423-389a6d36937e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:37.575394 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-48892c31-b449-4e15-9423-389a6d36937e None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:37.576781 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-48892c31-b449-4e15-9423-389a6d36937e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:37.825256 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8918415-97c9-4a5f-bdd3-9866881f8148 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:37.827097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-e8918415-97c9-4a5f-bdd3-9866881f8148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:37.865942 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 740/1478] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:37.950526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48892c31-b449-4e15-9423-389a6d36937e None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:37.952204 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-48892c31-b449-4e15-9423-389a6d36937e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:37.991641 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:38.109286 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48892c31-b449-4e15-9423-389a6d36937e None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:38.116721 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3304f-f2d0-425e-8a58-f221545458d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:38.117523 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3304f-f2d0-425e-8a58-f221545458d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:38.117986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3304f-f2d0-425e-8a58-f221545458d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:38.118500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3304f-f2d0-425e-8a58-f221545458d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:38.127763 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8918415-97c9-4a5f-bdd3-9866881f8148 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:38.137133 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f230d-25bc-4b38-956d-e61a392e3ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:38.138026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f230d-25bc-4b38-956d-e61a392e3ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:38.138779 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f230d-25bc-4b38-956d-e61a392e3ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:38.139586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f230d-25bc-4b38-956d-e61a392e3ad3 admin admin] PATH_INFO: `/v3/projects/3fc68623e80b4957973c1501d5bb6502` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:38.141940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f230d-25bc-4b38-956d-e61a392e3ad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fc68623e80b4957973c1501d5bb6502)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:38.144255 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f230d-25bc-4b38-956d-e61a392e3ad3 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:38.155690 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3304f-f2d0-425e-8a58-f221545458d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:38.157543 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3304f-f2d0-425e-8a58-f221545458d0 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:38.170531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 741/1479] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:13:38.188743 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2403740-a1bd-4411-9297-ae410d9f2c22 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:38.189903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2403740-a1bd-4411-9297-ae410d9f2c22 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:38.190340 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2403740-a1bd-4411-9297-ae410d9f2c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:38.217987 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-e2403740-a1bd-4411-9297-ae410d9f2c22 None None] MFA Rules not processed for user `0f2295659f2e467d8d798bf93f731330`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:38.219689 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e2403740-a1bd-4411-9297-ae410d9f2c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:38.227182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 742/1480] 10.222.0.39 () {58 vars in 1015 bytes} [Mon Oct 24 13:13:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:38.311248 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-919f230d-25bc-4b38-956d-e61a392e3ad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fc68623e80b4957973c1501d5bb6502', 'request_id': 'req-919f230d-25bc-4b38-956d-e61a392e3ad3'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:38.344130 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-919f230d-25bc-4b38-956d-e61a392e3ad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fc68623e80b4957973c1501d5bb6502', 'request_id': 'req-919f230d-25bc-4b38-956d-e61a392e3ad3'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:38.368096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-919f230d-25bc-4b38-956d-e61a392e3ad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fc68623e80b4957973c1501d5bb6502', 'request_id': 'req-919f230d-25bc-4b38-956d-e61a392e3ad3'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:38.397511 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-919f230d-25bc-4b38-956d-e61a392e3ad3 admin admin] The token cache is being invalidate because project 3fc68623e80b4957973c1501d5bb6502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:38.398497 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-919f230d-25bc-4b38-956d-e61a392e3ad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:38.405157 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-919f230d-25bc-4b38-956d-e61a392e3ad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:38.413482 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e5141-8ef4-4b50-acb7-9a405e846468 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:38.413761 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e5141-8ef4-4b50-acb7-9a405e846468 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:38.414187 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e5141-8ef4-4b50-acb7-9a405e846468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:38.417600 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 739/1481] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:37 2022] DELETE /identity/v3/projects/3fc68623e80b4957973c1501d5bb6502 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:38.482964 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-e17e5141-8ef4-4b50-acb7-9a405e846468 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:38.485000 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e17e5141-8ef4-4b50-acb7-9a405e846468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:38.590670 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f230d-25bc-4b38-956d-e61a392e3ad3 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:38.592284 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-919f230d-25bc-4b38-956d-e61a392e3ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:38.795797 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 743/1482] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:38.818808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c6f60-a396-48dd-95fc-4bdb1686d974 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:38.819575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c6f60-a396-48dd-95fc-4bdb1686d974 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:38.827794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c6f60-a396-48dd-95fc-4bdb1686d974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:38.877271 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f230d-25bc-4b38-956d-e61a392e3ad3 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:38.884803 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-2b6c6f60-a396-48dd-95fc-4bdb1686d974 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:38.886532 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2b6c6f60-a396-48dd-95fc-4bdb1686d974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:38.886661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8076d0-496b-429b-86d1-f1a85ae0acb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:38.890700 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8076d0-496b-429b-86d1-f1a85ae0acb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:38.890700 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8076d0-496b-429b-86d1-f1a85ae0acb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:38.890700 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8076d0-496b-429b-86d1-f1a85ae0acb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:38.892574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-1c8076d0-496b-429b-86d1-f1a85ae0acb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:38.906073 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:38.909528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8076d0-496b-429b-86d1-f1a85ae0acb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:38.911658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8076d0-496b-429b-86d1-f1a85ae0acb0 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:38.926249 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 744/1483] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:38.934054 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c6f60-a396-48dd-95fc-4bdb1686d974 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:38.940440 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 740/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:13:38.955906 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c6f60-a396-48dd-95fc-4bdb1686d974 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:38.970562 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63e2ee-2bd0-4bee-a15e-2c9765f290d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:38.972323 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63e2ee-2bd0-4bee-a15e-2c9765f290d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:38.972773 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63e2ee-2bd0-4bee-a15e-2c9765f290d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:38.973265 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63e2ee-2bd0-4bee-a15e-2c9765f290d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:38.974275 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63e2ee-2bd0-4bee-a15e-2c9765f290d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:38.974735 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63e2ee-2bd0-4bee-a15e-2c9765f290d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:38.976762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63e2ee-2bd0-4bee-a15e-2c9765f290d5 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:39.028869 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 745/1485] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:39.033260 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8076d0-496b-429b-86d1-f1a85ae0acb0 service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:39.050024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8076d0-496b-429b-86d1-f1a85ae0acb0 service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:39.068671 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522f76c-6423-4130-a331-064f1a6c35d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:39.069317 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522f76c-6423-4130-a331-064f1a6c35d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:39.069581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522f76c-6423-4130-a331-064f1a6c35d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:39.089277 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522f76c-6423-4130-a331-064f1a6c35d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:39.091146 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522f76c-6423-4130-a331-064f1a6c35d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:39.095740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522f76c-6423-4130-a331-064f1a6c35d2 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:39.215150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 741/1486] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:39 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:39.220049 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63e2ee-2bd0-4bee-a15e-2c9765f290d5 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:39.234519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63e2ee-2bd0-4bee-a15e-2c9765f290d5 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:39.354462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b52af-5221-4111-9322-a28de5b1d4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:39.354976 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b52af-5221-4111-9322-a28de5b1d4f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:39.355383 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b52af-5221-4111-9322-a28de5b1d4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:39.355687 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b52af-5221-4111-9322-a28de5b1d4f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:39.357060 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b52af-5221-4111-9322-a28de5b1d4f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:39.361715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b52af-5221-4111-9322-a28de5b1d4f4 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:39.421829 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 746/1487] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:39 2022] POST /identity/v3/users => generated 287 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:39.424630 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522f76c-6423-4130-a331-064f1a6c35d2 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:39.455060 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522f76c-6423-4130-a331-064f1a6c35d2 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:39.475252 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be705468-4409-4a8a-878e-ef720fe26fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:39.475978 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be705468-4409-4a8a-878e-ef720fe26fce admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:39.476259 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be705468-4409-4a8a-878e-ef720fe26fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:39.476595 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be705468-4409-4a8a-878e-ef720fe26fce admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:39.477474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be705468-4409-4a8a-878e-ef720fe26fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:39.479919 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be705468-4409-4a8a-878e-ef720fe26fce admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:39.588153 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b52af-5221-4111-9322-a28de5b1d4f4 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:39.597373 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 742/1488] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:39.605669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b52af-5221-4111-9322-a28de5b1d4f4 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:39.623222 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc20f9-7b09-41ee-8fd7-01b1268d2dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:39.624574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc20f9-7b09-41ee-8fd7-01b1268d2dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:39.624862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc20f9-7b09-41ee-8fd7-01b1268d2dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:39.626146 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc20f9-7b09-41ee-8fd7-01b1268d2dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:39.626830 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc20f9-7b09-41ee-8fd7-01b1268d2dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:39.630059 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc20f9-7b09-41ee-8fd7-01b1268d2dc1 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:39.658659 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be705468-4409-4a8a-878e-ef720fe26fce admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:39.672852 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 747/1489] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:39.683525 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be705468-4409-4a8a-878e-ef720fe26fce admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:39.689270 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243d947-71ef-4f99-b4a3-f1d8c84d3c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:39.689947 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243d947-71ef-4f99-b4a3-f1d8c84d3c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:39.690315 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243d947-71ef-4f99-b4a3-f1d8c84d3c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:39.690740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243d947-71ef-4f99-b4a3-f1d8c84d3c4f admin admin] PATH_INFO: `/v3/projects/1f63df1ae9494c76bea0e71221cafca6/users/1e0d573030614f32a0242a7cca0ca970/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:39.728840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243d947-71ef-4f99-b4a3-f1d8c84d3c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f63df1ae9494c76bea0e71221cafca6, user_id=1e0d573030614f32a0242a7cca0ca970, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:39.737006 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243d947-71ef-4f99-b4a3-f1d8c84d3c4f admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:39.797846 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 743/1490] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:39 2022] PUT /identity/v3/projects/1f63df1ae9494c76bea0e71221cafca6/users/1e0d573030614f32a0242a7cca0ca970/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:39.809248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf7a07-0c2e-4c70-8b40-3a116cc89a1d None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:39.809826 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf7a07-0c2e-4c70-8b40-3a116cc89a1d None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:39.809826 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf7a07-0c2e-4c70-8b40-3a116cc89a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:39.904502 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d6bf7a07-0c2e-4c70-8b40-3a116cc89a1d None None] MFA Rules not processed for user `1e0d573030614f32a0242a7cca0ca970`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:39.905718 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d6bf7a07-0c2e-4c70-8b40-3a116cc89a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:39.925738 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:40.119740 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 748/1491] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:40.210065 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243d947-71ef-4f99-b4a3-f1d8c84d3c4f admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:40.213246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-0243d947-71ef-4f99-b4a3-f1d8c84d3c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:40.391763 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243d947-71ef-4f99-b4a3-f1d8c84d3c4f admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:40.412313 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f8419-abe1-4f57-9386-72ca11737608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:40.417857 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f8419-abe1-4f57-9386-72ca11737608 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:40.418387 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f8419-abe1-4f57-9386-72ca11737608 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:40.419821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f8419-abe1-4f57-9386-72ca11737608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:40.448746 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f8419-abe1-4f57-9386-72ca11737608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:40.453886 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f8419-abe1-4f57-9386-72ca11737608 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:40.491403 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 744/1492] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:40.501164 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf7a07-0c2e-4c70-8b40-3a116cc89a1d None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:40.670284 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf7a07-0c2e-4c70-8b40-3a116cc89a1d None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:40.676649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fdb55-1b3a-4362-b188-4ac3f29b5e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:40.677677 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fdb55-1b3a-4362-b188-4ac3f29b5e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:40.678218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fdb55-1b3a-4362-b188-4ac3f29b5e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:40.679399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fdb55-1b3a-4362-b188-4ac3f29b5e0f admin admin] PATH_INFO: `/v3/users/1e0d573030614f32a0242a7cca0ca970` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:40.688458 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fdb55-1b3a-4362-b188-4ac3f29b5e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e0d573030614f32a0242a7cca0ca970)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:40.690631 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fdb55-1b3a-4362-b188-4ac3f29b5e0f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:40.781228 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-2d5fdb55-1b3a-4362-b188-4ac3f29b5e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e0d573030614f32a0242a7cca0ca970'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:40.791280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-2d5fdb55-1b3a-4362-b188-4ac3f29b5e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e0d573030614f32a0242a7cca0ca970'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:40.810365 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-2d5fdb55-1b3a-4362-b188-4ac3f29b5e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e0d573030614f32a0242a7cca0ca970'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:40.826875 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-2d5fdb55-1b3a-4362-b188-4ac3f29b5e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e0d573030614f32a0242a7cca0ca970'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:40.830343 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-2d5fdb55-1b3a-4362-b188-4ac3f29b5e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e0d573030614f32a0242a7cca0ca970'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:40.853090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 749/1493] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:40 2022] DELETE /identity/v3/users/1e0d573030614f32a0242a7cca0ca970 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:40.857764 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cb006-1fb9-4352-b851-c466aa24a587 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:40.858486 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cb006-1fb9-4352-b851-c466aa24a587 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:40.858486 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cb006-1fb9-4352-b851-c466aa24a587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:40.908087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-d08cb006-1fb9-4352-b851-c466aa24a587 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:40.909380 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d08cb006-1fb9-4352-b851-c466aa24a587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:41.079500 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 745/1494] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:41.167167 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fdb55-1b3a-4362-b188-4ac3f29b5e0f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:41.169882 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cb006-1fb9-4352-b851-c466aa24a587 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:41.172242 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d08cb006-1fb9-4352-b851-c466aa24a587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:41.173759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2d5fdb55-1b3a-4362-b188-4ac3f29b5e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:41.231769 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fdb55-1b3a-4362-b188-4ac3f29b5e0f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:41.247271 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8f73c-5fd2-4c4e-9d52-a878cd73f0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:41.249088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8f73c-5fd2-4c4e-9d52-a878cd73f0d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:41.249897 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8f73c-5fd2-4c4e-9d52-a878cd73f0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:41.250434 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8f73c-5fd2-4c4e-9d52-a878cd73f0d5 admin admin] PATH_INFO: `/v3/projects/06f2866f775b41a5b5721658223e0e0f` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:41.252455 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8f73c-5fd2-4c4e-9d52-a878cd73f0d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06f2866f775b41a5b5721658223e0e0f)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:41.258256 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8f73c-5fd2-4c4e-9d52-a878cd73f0d5 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:41.352086 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:41.464664 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:41.527774 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cb006-1fb9-4352-b851-c466aa24a587 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:41.547278 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e3b8f73c-5fd2-4c4e-9d52-a878cd73f0d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06f2866f775b41a5b5721658223e0e0f', 'request_id': 'req-e3b8f73c-5fd2-4c4e-9d52-a878cd73f0d5'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:41.583063 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e3b8f73c-5fd2-4c4e-9d52-a878cd73f0d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06f2866f775b41a5b5721658223e0e0f', 'request_id': 'req-e3b8f73c-5fd2-4c4e-9d52-a878cd73f0d5'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:41.613408 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e3b8f73c-5fd2-4c4e-9d52-a878cd73f0d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06f2866f775b41a5b5721658223e0e0f', 'request_id': 'req-e3b8f73c-5fd2-4c4e-9d52-a878cd73f0d5'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:41.677889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e3b8f73c-5fd2-4c4e-9d52-a878cd73f0d5 admin admin] The token cache is being invalidate because project 06f2866f775b41a5b5721658223e0e0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:41.678309 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e3b8f73c-5fd2-4c4e-9d52-a878cd73f0d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:41.688059 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e3b8f73c-5fd2-4c4e-9d52-a878cd73f0d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:41.700571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 750/1495] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:41 2022] DELETE /identity/v3/projects/06f2866f775b41a5b5721658223e0e0f => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:41.702718 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8f73c-5fd2-4c4e-9d52-a878cd73f0d5 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:41.709529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e3b8f73c-5fd2-4c4e-9d52-a878cd73f0d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:41.786003 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e59ed-b7bf-4e64-83d7-45108a6908b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:41.794040 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e59ed-b7bf-4e64-83d7-45108a6908b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:41.795750 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e59ed-b7bf-4e64-83d7-45108a6908b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:41.799304 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e59ed-b7bf-4e64-83d7-45108a6908b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:41.803750 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-247e59ed-b7bf-4e64-83d7-45108a6908b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:42.022426 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e59ed-b7bf-4e64-83d7-45108a6908b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:42.038489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8f73c-5fd2-4c4e-9d52-a878cd73f0d5 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:42.048217 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e59ed-b7bf-4e64-83d7-45108a6908b0 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:42.072934 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbc99e-e21f-45ff-9970-3351515facf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:42.074043 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbc99e-e21f-45ff-9970-3351515facf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:42.076809 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbc99e-e21f-45ff-9970-3351515facf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:42.078525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbc99e-e21f-45ff-9970-3351515facf6 admin admin] PATH_INFO: `/v3/users/30269fdb24cd4493ae8b89b97705d929` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:42.084533 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbc99e-e21f-45ff-9970-3351515facf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30269fdb24cd4493ae8b89b97705d929)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:42.095563 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbc99e-e21f-45ff-9970-3351515facf6 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:42.101959 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 746/1496] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 932 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:42.269287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cdfbc99e-e21f-45ff-9970-3351515facf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30269fdb24cd4493ae8b89b97705d929'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:42.297631 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cdfbc99e-e21f-45ff-9970-3351515facf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30269fdb24cd4493ae8b89b97705d929'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:42.353248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cdfbc99e-e21f-45ff-9970-3351515facf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30269fdb24cd4493ae8b89b97705d929'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:42.376779 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cdfbc99e-e21f-45ff-9970-3351515facf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30269fdb24cd4493ae8b89b97705d929'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:42.377448 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cdfbc99e-e21f-45ff-9970-3351515facf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30269fdb24cd4493ae8b89b97705d929'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:42.396294 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 751/1497] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:41 2022] DELETE /identity/v3/users/30269fdb24cd4493ae8b89b97705d929 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:43.070349 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e13cfd-5192-4af6-b01e-3c42914dc1a8 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:43.070906 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e13cfd-5192-4af6-b01e-3c42914dc1a8 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:43.071660 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e13cfd-5192-4af6-b01e-3c42914dc1a8 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:43.076473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 747/1498] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 24 13:13:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:13:43.109146 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b21927-ccbc-4644-8ec6-cded592806bc None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:43.112222 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b21927-ccbc-4644-8ec6-cded592806bc None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:43.112816 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b21927-ccbc-4644-8ec6-cded592806bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:43.185295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b6b21927-ccbc-4644-8ec6-cded592806bc None None] MFA Rules not processed for user `4f6b27c7d052437a949a371169fb48ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:43.187875 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b6b21927-ccbc-4644-8ec6-cded592806bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:43.246009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:43.404737 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 752/1499] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 24 13:13:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:43.815869 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e13cfd-5192-4af6-b01e-3c42914dc1a8 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:43.818765 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-c4e13cfd-5192-4af6-b01e-3c42914dc1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:44.024832 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e13cfd-5192-4af6-b01e-3c42914dc1a8 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:44.039375 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b854b-b145-4618-8e8d-f3db86857b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:44.040699 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b854b-b145-4618-8e8d-f3db86857b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:44.041239 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b854b-b145-4618-8e8d-f3db86857b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:44.041728 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b854b-b145-4618-8e8d-f3db86857b62 admin admin] PATH_INFO: `/v3/users/7be5f9153dcf4881ac359a57afa8a694` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:44.046538 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b854b-b145-4618-8e8d-f3db86857b62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7be5f9153dcf4881ac359a57afa8a694)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:44.049222 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b854b-b145-4618-8e8d-f3db86857b62 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:44.144652 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b21927-ccbc-4644-8ec6-cded592806bc None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:44.147599 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b6b21927-ccbc-4644-8ec6-cded592806bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:44.184226 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-ca0b854b-b145-4618-8e8d-f3db86857b62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7be5f9153dcf4881ac359a57afa8a694'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:44.186610 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:44.197371 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b21927-ccbc-4644-8ec6-cded592806bc None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:44.199104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-ca0b854b-b145-4618-8e8d-f3db86857b62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7be5f9153dcf4881ac359a57afa8a694'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:44.215228 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-ca0b854b-b145-4618-8e8d-f3db86857b62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7be5f9153dcf4881ac359a57afa8a694'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:44.218880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cf357-b6ad-4f27-b1cf-2c8ee70d20dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:44.220144 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cf357-b6ad-4f27-b1cf-2c8ee70d20dc service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:44.220818 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cf357-b6ad-4f27-b1cf-2c8ee70d20dc service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:44.221506 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cf357-b6ad-4f27-b1cf-2c8ee70d20dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:44.240951 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-ca0b854b-b145-4618-8e8d-f3db86857b62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7be5f9153dcf4881ac359a57afa8a694'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:44.242095 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-ca0b854b-b145-4618-8e8d-f3db86857b62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7be5f9153dcf4881ac359a57afa8a694'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:44.246986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3cf357-b6ad-4f27-b1cf-2c8ee70d20dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:44.255615 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 748/1500] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:43 2022] DELETE /identity/v3/users/7be5f9153dcf4881ac359a57afa8a694 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:44.256085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3cf357-b6ad-4f27-b1cf-2c8ee70d20dc service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:44.260671 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fffe8-2c9e-4dd7-9a3e-9be36b86357b None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:44.261403 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fffe8-2c9e-4dd7-9a3e-9be36b86357b None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:44.261899 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fffe8-2c9e-4dd7-9a3e-9be36b86357b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:44.308644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-186fffe8-2c9e-4dd7-9a3e-9be36b86357b None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:44.309088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 753/1501] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:44.313624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-186fffe8-2c9e-4dd7-9a3e-9be36b86357b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:44.439388 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 749/1502] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:44.532168 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cf357-b6ad-4f27-b1cf-2c8ee70d20dc service nova] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:44.536142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-cf3cf357-b6ad-4f27-b1cf-2c8ee70d20dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:44.712848 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cf357-b6ad-4f27-b1cf-2c8ee70d20dc service nova] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:44.832955 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ab976-8ea8-4e21-8bed-c147188e2453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:44.833708 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ab976-8ea8-4e21-8bed-c147188e2453 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:44.834311 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ab976-8ea8-4e21-8bed-c147188e2453 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:44.834568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ab976-8ea8-4e21-8bed-c147188e2453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:44.848425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ab976-8ea8-4e21-8bed-c147188e2453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:44.871620 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ab976-8ea8-4e21-8bed-c147188e2453 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:44.890992 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 754/1503] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:45.358487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fffe8-2c9e-4dd7-9a3e-9be36b86357b None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:45.368600 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-186fffe8-2c9e-4dd7-9a3e-9be36b86357b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:45.391197 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fffe8-2c9e-4dd7-9a3e-9be36b86357b None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:45.401193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ab976-8ea8-4e21-8bed-c147188e2453 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:45.403548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9f8ab976-8ea8-4e21-8bed-c147188e2453 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:45.416086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e863ea2-d546-4852-acb0-351b897487ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:45.417130 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e863ea2-d546-4852-acb0-351b897487ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:45.417581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e863ea2-d546-4852-acb0-351b897487ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:45.418042 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e863ea2-d546-4852-acb0-351b897487ad admin admin] PATH_INFO: `/v3/projects/670967dec357493892dcc750c7795f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:45.419530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e863ea2-d546-4852-acb0-351b897487ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=670967dec357493892dcc750c7795f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:45.422129 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e863ea2-d546-4852-acb0-351b897487ad admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:45.463150 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ab976-8ea8-4e21-8bed-c147188e2453 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:45.488015 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fc609-bfa5-44b0-9473-d00cb1ff1f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:45.489000 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fc609-bfa5-44b0-9473-d00cb1ff1f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:45.495226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fc609-bfa5-44b0-9473-d00cb1ff1f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:45.496555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fc609-bfa5-44b0-9473-d00cb1ff1f1c admin admin] PATH_INFO: `/v3/projects/1f63df1ae9494c76bea0e71221cafca6` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:45.499484 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fc609-bfa5-44b0-9473-d00cb1ff1f1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f63df1ae9494c76bea0e71221cafca6)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:45.502364 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fc609-bfa5-44b0-9473-d00cb1ff1f1c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:45.523498 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1e863ea2-d546-4852-acb0-351b897487ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '670967dec357493892dcc750c7795f41', 'request_id': 'req-1e863ea2-d546-4852-acb0-351b897487ad'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.553956 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1e863ea2-d546-4852-acb0-351b897487ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '670967dec357493892dcc750c7795f41', 'request_id': 'req-1e863ea2-d546-4852-acb0-351b897487ad'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.590177 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1e863ea2-d546-4852-acb0-351b897487ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '670967dec357493892dcc750c7795f41', 'request_id': 'req-1e863ea2-d546-4852-acb0-351b897487ad'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.604651 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1e863ea2-d546-4852-acb0-351b897487ad admin admin] The token cache is being invalidate because project 670967dec357493892dcc750c7795f41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:45.605751 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1e863ea2-d546-4852-acb0-351b897487ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.607669 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1e863ea2-d546-4852-acb0-351b897487ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.607829 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0b9fc609-bfa5-44b0-9473-d00cb1ff1f1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f63df1ae9494c76bea0e71221cafca6', 'request_id': 'req-0b9fc609-bfa5-44b0-9473-d00cb1ff1f1c'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.611345 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 750/1504] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:45 2022] DELETE /identity/v3/projects/670967dec357493892dcc750c7795f41 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:45.617642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09134642-c612-40c6-a078-7c7b6ba4cc06 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:45.618686 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09134642-c612-40c6-a078-7c7b6ba4cc06 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:45.619174 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09134642-c612-40c6-a078-7c7b6ba4cc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:45.635605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0b9fc609-bfa5-44b0-9473-d00cb1ff1f1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f63df1ae9494c76bea0e71221cafca6', 'request_id': 'req-0b9fc609-bfa5-44b0-9473-d00cb1ff1f1c'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.638543 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:45.657691 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0b9fc609-bfa5-44b0-9473-d00cb1ff1f1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f63df1ae9494c76bea0e71221cafca6', 'request_id': 'req-0b9fc609-bfa5-44b0-9473-d00cb1ff1f1c'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.668271 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-09134642-c612-40c6-a078-7c7b6ba4cc06 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:45.669752 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-09134642-c612-40c6-a078-7c7b6ba4cc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:45.672051 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0b9fc609-bfa5-44b0-9473-d00cb1ff1f1c admin admin] The token cache is being invalidate because project 1f63df1ae9494c76bea0e71221cafca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:45.672713 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0b9fc609-bfa5-44b0-9473-d00cb1ff1f1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.673849 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0b9fc609-bfa5-44b0-9473-d00cb1ff1f1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.676297 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 755/1505] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:45 2022] DELETE /identity/v3/projects/1f63df1ae9494c76bea0e71221cafca6 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:45.689692 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5db2ca-673c-4d53-8484-ffb268c5de95 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:45.690920 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5db2ca-673c-4d53-8484-ffb268c5de95 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:45.691877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5db2ca-673c-4d53-8484-ffb268c5de95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:45.729474 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-3a5db2ca-673c-4d53-8484-ffb268c5de95 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:45.733742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3a5db2ca-673c-4d53-8484-ffb268c5de95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:45.762233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:45.809483 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 751/1506] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:45.815043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24579ef0-ff70-422c-823d-24c37c79b9c9 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:45.815453 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24579ef0-ff70-422c-823d-24c37c79b9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:45.815801 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24579ef0-ff70-422c-823d-24c37c79b9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:45.830090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 756/1507] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:45.841112 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d36ee5-0f5e-4223-b76a-48d776736c4a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:45.841792 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d36ee5-0f5e-4223-b76a-48d776736c4a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:45.842250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d36ee5-0f5e-4223-b76a-48d776736c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:45.856459 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-24579ef0-ff70-422c-823d-24c37c79b9c9 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:45.857796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-24579ef0-ff70-422c-823d-24c37c79b9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:45.888401 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 752/1508] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:45.889745 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24579ef0-ff70-422c-823d-24c37c79b9c9 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:45.895543 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-66d36ee5-0f5e-4223-b76a-48d776736c4a None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:45.896741 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-66d36ee5-0f5e-4223-b76a-48d776736c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:45.902167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24579ef0-ff70-422c-823d-24c37c79b9c9 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:45.910285 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 757/1509] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:45.916457 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d36ee5-0f5e-4223-b76a-48d776736c4a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:45.917852 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18877ba7-d27b-45ba-84f9-81f33b094181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:45.918482 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18877ba7-d27b-45ba-84f9-81f33b094181 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:45.918764 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18877ba7-d27b-45ba-84f9-81f33b094181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:45.919039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18877ba7-d27b-45ba-84f9-81f33b094181 admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:45.919735 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18877ba7-d27b-45ba-84f9-81f33b094181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:45.920045 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18877ba7-d27b-45ba-84f9-81f33b094181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:45.921678 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18877ba7-d27b-45ba-84f9-81f33b094181 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:45.940120 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d36ee5-0f5e-4223-b76a-48d776736c4a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:45.950122 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18b65d-49f5-4970-a804-2374c7e44c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:45.950520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 753/1510] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:13:45.953034 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18b65d-49f5-4970-a804-2374c7e44c8f admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:45.954244 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18b65d-49f5-4970-a804-2374c7e44c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:45.955174 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18b65d-49f5-4970-a804-2374c7e44c8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:45.956233 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18b65d-49f5-4970-a804-2374c7e44c8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:45.956523 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18877ba7-d27b-45ba-84f9-81f33b094181 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:45.957012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18b65d-49f5-4970-a804-2374c7e44c8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:45.980165 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18877ba7-d27b-45ba-84f9-81f33b094181 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:45.981744 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18b65d-49f5-4970-a804-2374c7e44c8f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:45.993429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443c074-241f-4563-a56b-f220fbe76e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:45.994838 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443c074-241f-4563-a56b-f220fbe76e11 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:45.995127 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443c074-241f-4563-a56b-f220fbe76e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:45.995443 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443c074-241f-4563-a56b-f220fbe76e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:45.996722 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443c074-241f-4563-a56b-f220fbe76e11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:46.003576 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443c074-241f-4563-a56b-f220fbe76e11 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:46.050322 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 758/1511] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:46.057003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18b65d-49f5-4970-a804-2374c7e44c8f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:46.067855 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 754/1512] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:45 2022] POST /identity/v3/projects => generated 407 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:13:46.072983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443c074-241f-4563-a56b-f220fbe76e11 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:46.095807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18b65d-49f5-4970-a804-2374c7e44c8f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:46.234556 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443c074-241f-4563-a56b-f220fbe76e11 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:46.241549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e3d5e-4e7e-4591-a11d-a3d18e65a157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:46.242180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e3d5e-4e7e-4591-a11d-a3d18e65a157 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:46.242465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e3d5e-4e7e-4591-a11d-a3d18e65a157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:46.242761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e3d5e-4e7e-4591-a11d-a3d18e65a157 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:46.243493 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e3d5e-4e7e-4591-a11d-a3d18e65a157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:46.245587 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e3d5e-4e7e-4591-a11d-a3d18e65a157 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:46.288398 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997f8cb-98cd-445f-ab89-1b2fd8e441c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:46.290564 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997f8cb-98cd-445f-ab89-1b2fd8e441c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:46.291233 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997f8cb-98cd-445f-ab89-1b2fd8e441c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:46.292032 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997f8cb-98cd-445f-ab89-1b2fd8e441c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:46.293440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997f8cb-98cd-445f-ab89-1b2fd8e441c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:46.295645 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 755/1513] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:46 2022] POST /identity/v3/users => generated 304 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:46.304885 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997f8cb-98cd-445f-ab89-1b2fd8e441c0 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:46.333129 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e3d5e-4e7e-4591-a11d-a3d18e65a157 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:46.377223 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e3d5e-4e7e-4591-a11d-a3d18e65a157 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:46.389662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3aa3db-e283-4d5d-97ac-4e5150b3fbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:46.393143 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 759/1514] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:46 2022] POST /identity/v3/projects => generated 375 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:46.393245 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3aa3db-e283-4d5d-97ac-4e5150b3fbcf admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:46.393245 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3aa3db-e283-4d5d-97ac-4e5150b3fbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:46.393245 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3aa3db-e283-4d5d-97ac-4e5150b3fbcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:46.393245 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3aa3db-e283-4d5d-97ac-4e5150b3fbcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:46.394447 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997f8cb-98cd-445f-ab89-1b2fd8e441c0 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:46.396207 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3aa3db-e283-4d5d-97ac-4e5150b3fbcf admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:46.436518 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 756/1515] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:46.438877 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3aa3db-e283-4d5d-97ac-4e5150b3fbcf admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:46.470348 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3aa3db-e283-4d5d-97ac-4e5150b3fbcf admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:46.534475 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:46.568950 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997f8cb-98cd-445f-ab89-1b2fd8e441c0 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:46.582072 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e13c4-afd4-452d-8d2a-75c85efaefd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:46.583289 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e13c4-afd4-452d-8d2a-75c85efaefd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:46.583647 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e13c4-afd4-452d-8d2a-75c85efaefd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:46.583915 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e13c4-afd4-452d-8d2a-75c85efaefd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:46.584942 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e13c4-afd4-452d-8d2a-75c85efaefd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:46.594517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e13c4-afd4-452d-8d2a-75c85efaefd0 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:46.630337 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467057d-04be-40e3-ae96-02527ae31e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:46.632810 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467057d-04be-40e3-ae96-02527ae31e8e admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:46.633086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467057d-04be-40e3-ae96-02527ae31e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:46.635752 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467057d-04be-40e3-ae96-02527ae31e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:46.638829 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467057d-04be-40e3-ae96-02527ae31e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:46.642180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467057d-04be-40e3-ae96-02527ae31e8e admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:46.651011 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 760/1516] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:46 2022] POST /identity/v3/users => generated 288 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:46.655825 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e13c4-afd4-452d-8d2a-75c85efaefd0 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:46.674157 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 757/1517] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:46.674990 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467057d-04be-40e3-ae96-02527ae31e8e admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:46.683370 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e13c4-afd4-452d-8d2a-75c85efaefd0 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:46.703064 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681a9c5-b71d-4a36-9dce-d10898bdc25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:46.704272 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681a9c5-b71d-4a36-9dce-d10898bdc25f admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:46.704462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681a9c5-b71d-4a36-9dce-d10898bdc25f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:46.704826 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681a9c5-b71d-4a36-9dce-d10898bdc25f admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:46.705907 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681a9c5-b71d-4a36-9dce-d10898bdc25f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:46.709809 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467057d-04be-40e3-ae96-02527ae31e8e admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:46.711125 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681a9c5-b71d-4a36-9dce-d10898bdc25f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:46.715971 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78602b-8050-49b6-9364-119e15e455f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:46.716674 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78602b-8050-49b6-9364-119e15e455f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:46.717001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78602b-8050-49b6-9364-119e15e455f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:46.717312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78602b-8050-49b6-9364-119e15e455f8 admin admin] PATH_INFO: `/v3/projects/1c6ab95d1d4548df87daf7b6287e3e18/users/31ed5b8f2fe0442bb43fd4159ccff880/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:46.752073 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 761/1518] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:46.752219 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78602b-8050-49b6-9364-119e15e455f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6ab95d1d4548df87daf7b6287e3e18, user_id=31ed5b8f2fe0442bb43fd4159ccff880, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:46.754261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681a9c5-b71d-4a36-9dce-d10898bdc25f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:46.754515 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78602b-8050-49b6-9364-119e15e455f8 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:46.778139 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:46.785532 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681a9c5-b71d-4a36-9dce-d10898bdc25f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:46.793067 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 758/1519] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:46 2022] PUT /identity/v3/projects/1c6ab95d1d4548df87daf7b6287e3e18/users/31ed5b8f2fe0442bb43fd4159ccff880/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:46.794578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac80c2-1e10-4236-a169-b86a8b8b6fdc None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:46.794847 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac80c2-1e10-4236-a169-b86a8b8b6fdc None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:46.795160 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac80c2-1e10-4236-a169-b86a8b8b6fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:46.861588 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-80ac80c2-1e10-4236-a169-b86a8b8b6fdc None None] MFA Rules not processed for user `31ed5b8f2fe0442bb43fd4159ccff880`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:46.862724 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-80ac80c2-1e10-4236-a169-b86a8b8b6fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:47.002924 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb7856-0a4e-4986-a477-1933572a1e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:47.003597 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb7856-0a4e-4986-a477-1933572a1e45 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:47.004017 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb7856-0a4e-4986-a477-1933572a1e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:47.004293 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb7856-0a4e-4986-a477-1933572a1e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:47.004998 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb7856-0a4e-4986-a477-1933572a1e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:47.006937 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb7856-0a4e-4986-a477-1933572a1e45 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:47.011464 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 759/1520] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:46 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:47.015328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac80c2-1e10-4236-a169-b86a8b8b6fdc None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:47.031060 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 762/1521] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:47.032723 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb7856-0a4e-4986-a477-1933572a1e45 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:47.047315 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac80c2-1e10-4236-a169-b86a8b8b6fdc None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:47.057988 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb7856-0a4e-4986-a477-1933572a1e45 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:47.061557 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ea358-7f5d-4a7d-b5bb-49411648e807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:47.062481 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ea358-7f5d-4a7d-b5bb-49411648e807 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:47.062760 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ea358-7f5d-4a7d-b5bb-49411648e807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:47.063027 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ea358-7f5d-4a7d-b5bb-49411648e807 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:47.064281 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ea358-7f5d-4a7d-b5bb-49411648e807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:47.066722 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ea358-7f5d-4a7d-b5bb-49411648e807 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:47.074394 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfed08-f79b-4f8c-8872-5c848a2414f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:47.075533 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfed08-f79b-4f8c-8872-5c848a2414f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:47.075951 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfed08-f79b-4f8c-8872-5c848a2414f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:47.076233 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfed08-f79b-4f8c-8872-5c848a2414f3 admin admin] PATH_INFO: `/v3/projects/22acbcf2cd23473488797e11e8b7357d/users/593b2976d256421b9a6d247642339f7b/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:47.124725 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfed08-f79b-4f8c-8872-5c848a2414f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22acbcf2cd23473488797e11e8b7357d, user_id=593b2976d256421b9a6d247642339f7b, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:47.131772 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfed08-f79b-4f8c-8872-5c848a2414f3 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:47.154878 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 760/1522] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:47 2022] POST /identity/v3/projects => generated 409 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:47.157481 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ea358-7f5d-4a7d-b5bb-49411648e807 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:47.187861 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 763/1523] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:47 2022] PUT /identity/v3/projects/22acbcf2cd23473488797e11e8b7357d/users/593b2976d256421b9a6d247642339f7b/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:47.201284 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517e456-3b83-4322-8dcf-d33980c4d423 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:47.202592 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517e456-3b83-4322-8dcf-d33980c4d423 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:47.203398 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517e456-3b83-4322-8dcf-d33980c4d423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:47.281803 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-8517e456-3b83-4322-8dcf-d33980c4d423 None None] MFA Rules not processed for user `593b2976d256421b9a6d247642339f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:47.283149 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8517e456-3b83-4322-8dcf-d33980c4d423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:47.320697 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ea358-7f5d-4a7d-b5bb-49411648e807 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:47.452011 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 764/1524] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:47.459906 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0538a-00c5-45e1-8e84-47a98a371f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:47.461698 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0538a-00c5-45e1-8e84-47a98a371f02 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:47.461698 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0538a-00c5-45e1-8e84-47a98a371f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:47.461698 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0538a-00c5-45e1-8e84-47a98a371f02 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:47.462522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0538a-00c5-45e1-8e84-47a98a371f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:47.463401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517e456-3b83-4322-8dcf-d33980c4d423 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:47.464492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0538a-00c5-45e1-8e84-47a98a371f02 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:47.465408 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8517e456-3b83-4322-8dcf-d33980c4d423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:47.502891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 761/1525] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:47 2022] POST /identity/v3/users => generated 311 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:47.504037 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0538a-00c5-45e1-8e84-47a98a371f02 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:47.512104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:47.519051 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0538a-00c5-45e1-8e84-47a98a371f02 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:47.524432 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:47.531641 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef6dcf-af57-4203-ab72-4dc362000918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:47.533991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef6dcf-af57-4203-ab72-4dc362000918 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:47.534610 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef6dcf-af57-4203-ab72-4dc362000918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:47.535282 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef6dcf-af57-4203-ab72-4dc362000918 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:47.544026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef6dcf-af57-4203-ab72-4dc362000918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:47.554173 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef6dcf-af57-4203-ab72-4dc362000918 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:47.567919 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 762/1526] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:47.572538 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef6dcf-af57-4203-ab72-4dc362000918 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:47.583400 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517e456-3b83-4322-8dcf-d33980c4d423 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:47.591096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904937b-cd0b-4a86-8cd3-1ad455f75c60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:47.592363 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904937b-cd0b-4a86-8cd3-1ad455f75c60 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:47.592363 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904937b-cd0b-4a86-8cd3-1ad455f75c60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:47.592363 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904937b-cd0b-4a86-8cd3-1ad455f75c60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:47.609078 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904937b-cd0b-4a86-8cd3-1ad455f75c60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:47.612097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef6dcf-af57-4203-ab72-4dc362000918 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:47.613768 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904937b-cd0b-4a86-8cd3-1ad455f75c60 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:47.626652 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f3c0c-4d4a-463e-b77b-22869d25bd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:47.627337 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f3c0c-4d4a-463e-b77b-22869d25bd23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:47.628636 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f3c0c-4d4a-463e-b77b-22869d25bd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:47.628938 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f3c0c-4d4a-463e-b77b-22869d25bd23 admin admin] PATH_INFO: `/v3/projects/31b89628f30f472ead1687ebc23e1f9c/users/9fc90f652ae6487888c3d62655cb230c/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:47.636731 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 765/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:47.655939 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f3c0c-4d4a-463e-b77b-22869d25bd23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b89628f30f472ead1687ebc23e1f9c, user_id=9fc90f652ae6487888c3d62655cb230c, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:47.662124 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f3c0c-4d4a-463e-b77b-22869d25bd23 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:47.684426 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 763/1528] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:47 2022] PUT /identity/v3/projects/31b89628f30f472ead1687ebc23e1f9c/users/9fc90f652ae6487888c3d62655cb230c/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:47.688566 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904937b-cd0b-4a86-8cd3-1ad455f75c60 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:47.703515 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904937b-cd0b-4a86-8cd3-1ad455f75c60 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:47.789017 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f3c0c-4d4a-463e-b77b-22869d25bd23 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:47.791708 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-0a1f3c0c-4d4a-463e-b77b-22869d25bd23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:47.800114 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08965fe-7a5a-4a06-a303-a8472a57be5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:47.801755 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08965fe-7a5a-4a06-a303-a8472a57be5d admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:47.802047 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08965fe-7a5a-4a06-a303-a8472a57be5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:47.802320 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08965fe-7a5a-4a06-a303-a8472a57be5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:47.803874 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08965fe-7a5a-4a06-a303-a8472a57be5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:47.807149 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08965fe-7a5a-4a06-a303-a8472a57be5d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:47.856601 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 766/1529] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:47.860773 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08965fe-7a5a-4a06-a303-a8472a57be5d admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:47.895248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08965fe-7a5a-4a06-a303-a8472a57be5d admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:47.902743 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611b59b-fe79-4b21-a8d8-d20f8c494a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:47.904368 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611b59b-fe79-4b21-a8d8-d20f8c494a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:47.904850 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611b59b-fe79-4b21-a8d8-d20f8c494a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:47.905343 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611b59b-fe79-4b21-a8d8-d20f8c494a10 admin admin] PATH_INFO: `/v3/projects/31b89628f30f472ead1687ebc23e1f9c/users/9fc90f652ae6487888c3d62655cb230c/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:47.909238 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611b59b-fe79-4b21-a8d8-d20f8c494a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b89628f30f472ead1687ebc23e1f9c, user_id=9fc90f652ae6487888c3d62655cb230c, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:47.909393 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f3c0c-4d4a-463e-b77b-22869d25bd23 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:47.913430 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611b59b-fe79-4b21-a8d8-d20f8c494a10 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:47.916160 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841714d-89bb-4a54-a8e1-213e1c42273a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:47.917071 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841714d-89bb-4a54-a8e1-213e1c42273a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:47.917467 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841714d-89bb-4a54-a8e1-213e1c42273a admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:47.917896 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841714d-89bb-4a54-a8e1-213e1c42273a admin admin] PATH_INFO: `/v3/projects/0865b8f7fc6e44f08ed04e88ca74817e` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:47.919503 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841714d-89bb-4a54-a8e1-213e1c42273a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0865b8f7fc6e44f08ed04e88ca74817e)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:47.922367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841714d-89bb-4a54-a8e1-213e1c42273a admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:47.933900 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 767/1530] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:47 2022] PUT /identity/v3/projects/31b89628f30f472ead1687ebc23e1f9c/users/9fc90f652ae6487888c3d62655cb230c/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:47.945514 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd2eb2-9207-4ffa-8cd5-8c37d2045dcc None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:47.945938 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd2eb2-9207-4ffa-8cd5-8c37d2045dcc None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:47.946277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd2eb2-9207-4ffa-8cd5-8c37d2045dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:47.989916 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2841714d-89bb-4a54-a8e1-213e1c42273a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0865b8f7fc6e44f08ed04e88ca74817e', 'request_id': 'req-2841714d-89bb-4a54-a8e1-213e1c42273a'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:48.007283 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2841714d-89bb-4a54-a8e1-213e1c42273a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0865b8f7fc6e44f08ed04e88ca74817e', 'request_id': 'req-2841714d-89bb-4a54-a8e1-213e1c42273a'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:48.008157 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-bcbd2eb2-9207-4ffa-8cd5-8c37d2045dcc None None] MFA Rules not processed for user `9fc90f652ae6487888c3d62655cb230c`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:48.010952 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-bcbd2eb2-9207-4ffa-8cd5-8c37d2045dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:48.019346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2841714d-89bb-4a54-a8e1-213e1c42273a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0865b8f7fc6e44f08ed04e88ca74817e', 'request_id': 'req-2841714d-89bb-4a54-a8e1-213e1c42273a'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:48.053386 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2841714d-89bb-4a54-a8e1-213e1c42273a admin admin] The token cache is being invalidate because project 0865b8f7fc6e44f08ed04e88ca74817e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:48.053985 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2841714d-89bb-4a54-a8e1-213e1c42273a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:48.056130 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2841714d-89bb-4a54-a8e1-213e1c42273a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:48.063258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 764/1531] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:47 2022] DELETE /identity/v3/projects/0865b8f7fc6e44f08ed04e88ca74817e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:48.063258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8151ef-7b78-4f1a-b526-1d35d2debe3e None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:48.063258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8151ef-7b78-4f1a-b526-1d35d2debe3e None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:48.063258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8151ef-7b78-4f1a-b526-1d35d2debe3e None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:48.066968 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 765/1532] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 24 13:13:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:13:48.069801 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8151ef-7b78-4f1a-b526-1d35d2debe3e None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:48.087831 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-dc8151ef-7b78-4f1a-b526-1d35d2debe3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:48.172192 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 768/1533] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:47 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:48.174163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd265d0-8405-4332-abaa-def42b4eab19 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:48.174552 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd265d0-8405-4332-abaa-def42b4eab19 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:48.175016 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd265d0-8405-4332-abaa-def42b4eab19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:48.218018 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-ddd265d0-8405-4332-abaa-def42b4eab19 None None] MFA Rules not processed for user `4f6b27c7d052437a949a371169fb48ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:48.233961 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ddd265d0-8405-4332-abaa-def42b4eab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:48.275522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8151ef-7b78-4f1a-b526-1d35d2debe3e None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:48.303717 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a43841-674f-4bff-81d2-92a0c1ba3665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:48.307318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a43841-674f-4bff-81d2-92a0c1ba3665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:48.307636 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a43841-674f-4bff-81d2-92a0c1ba3665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:48.307912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a43841-674f-4bff-81d2-92a0c1ba3665 admin admin] PATH_INFO: `/v3/users/c151cbf2e8294a6c9cd3ad0afb646e1e` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:48.309711 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a43841-674f-4bff-81d2-92a0c1ba3665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c151cbf2e8294a6c9cd3ad0afb646e1e)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:48.314939 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:48.315250 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a43841-674f-4bff-81d2-92a0c1ba3665 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:48.321472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:48.382936 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 769/1534] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 24 13:13:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:48.389155 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd265d0-8405-4332-abaa-def42b4eab19 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:48.392312 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ddd265d0-8405-4332-abaa-def42b4eab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:48.434150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-98a43841-674f-4bff-81d2-92a0c1ba3665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c151cbf2e8294a6c9cd3ad0afb646e1e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:48.450869 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-98a43841-674f-4bff-81d2-92a0c1ba3665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c151cbf2e8294a6c9cd3ad0afb646e1e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:48.473074 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-98a43841-674f-4bff-81d2-92a0c1ba3665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c151cbf2e8294a6c9cd3ad0afb646e1e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:48.494857 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-98a43841-674f-4bff-81d2-92a0c1ba3665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c151cbf2e8294a6c9cd3ad0afb646e1e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:48.496260 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-98a43841-674f-4bff-81d2-92a0c1ba3665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c151cbf2e8294a6c9cd3ad0afb646e1e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:48.511192 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 766/1535] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:48 2022] DELETE /identity/v3/users/c151cbf2e8294a6c9cd3ad0afb646e1e => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:48.517240 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd265d0-8405-4332-abaa-def42b4eab19 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:48.577419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36385ae4-d23c-4cba-9f41-5ec3ba68c0a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:48.578352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36385ae4-d23c-4cba-9f41-5ec3ba68c0a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:48.578696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36385ae4-d23c-4cba-9f41-5ec3ba68c0a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:48.579227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36385ae4-d23c-4cba-9f41-5ec3ba68c0a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:48.579916 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a43841-674f-4bff-81d2-92a0c1ba3665 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:48.581543 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-36385ae4-d23c-4cba-9f41-5ec3ba68c0a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:48.581664 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-98a43841-674f-4bff-81d2-92a0c1ba3665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:48.712613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36385ae4-d23c-4cba-9f41-5ec3ba68c0a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:48.716587 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36385ae4-d23c-4cba-9f41-5ec3ba68c0a3 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:48.717304 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a43841-674f-4bff-81d2-92a0c1ba3665 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:48.725768 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd1209-f30c-4002-96e5-7e53eff18b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:48.728504 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd1209-f30c-4002-96e5-7e53eff18b2d service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:48.729298 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd1209-f30c-4002-96e5-7e53eff18b2d service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:48.730583 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd1209-f30c-4002-96e5-7e53eff18b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:48.735675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-ffbd1209-f30c-4002-96e5-7e53eff18b2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:48.746435 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 770/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:48 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:48.754695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd1209-f30c-4002-96e5-7e53eff18b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:48.756740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd1209-f30c-4002-96e5-7e53eff18b2d service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:48.773477 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 767/1537] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:48.992229 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36385ae4-d23c-4cba-9f41-5ec3ba68c0a3 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:48.993444 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-36385ae4-d23c-4cba-9f41-5ec3ba68c0a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:49.005055 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36385ae4-d23c-4cba-9f41-5ec3ba68c0a3 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:49.009357 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc199fd-2751-4d3b-8fc7-ad91bb9f9acb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:49.009989 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc199fd-2751-4d3b-8fc7-ad91bb9f9acb service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:49.010271 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc199fd-2751-4d3b-8fc7-ad91bb9f9acb service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:49.010548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc199fd-2751-4d3b-8fc7-ad91bb9f9acb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:49.012373 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-adc199fd-2751-4d3b-8fc7-ad91bb9f9acb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:49.065817 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:49.089483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc199fd-2751-4d3b-8fc7-ad91bb9f9acb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:49.091144 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc199fd-2751-4d3b-8fc7-ad91bb9f9acb service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:49.101520 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 771/1538] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:48 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:49.995732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd1209-f30c-4002-96e5-7e53eff18b2d service nova] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:49.998651 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-ffbd1209-f30c-4002-96e5-7e53eff18b2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:50.132912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd1209-f30c-4002-96e5-7e53eff18b2d service nova] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:50.139011 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46790d-ea79-49d9-83cf-cbe5694eca7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:50.139703 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46790d-ea79-49d9-83cf-cbe5694eca7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:50.139981 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46790d-ea79-49d9-83cf-cbe5694eca7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:50.140261 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46790d-ea79-49d9-83cf-cbe5694eca7e admin admin] PATH_INFO: `/v3/projects/72f616501c384b90aa54b7e74ea0077a` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:50.141399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46790d-ea79-49d9-83cf-cbe5694eca7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=72f616501c384b90aa54b7e74ea0077a)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:50.143632 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46790d-ea79-49d9-83cf-cbe5694eca7e admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:50.151863 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:50.216361 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-ff46790d-ea79-49d9-83cf-cbe5694eca7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72f616501c384b90aa54b7e74ea0077a', 'request_id': 'req-ff46790d-ea79-49d9-83cf-cbe5694eca7e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:50.226706 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-ff46790d-ea79-49d9-83cf-cbe5694eca7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72f616501c384b90aa54b7e74ea0077a', 'request_id': 'req-ff46790d-ea79-49d9-83cf-cbe5694eca7e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:50.233862 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-ff46790d-ea79-49d9-83cf-cbe5694eca7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72f616501c384b90aa54b7e74ea0077a', 'request_id': 'req-ff46790d-ea79-49d9-83cf-cbe5694eca7e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:50.247620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-ff46790d-ea79-49d9-83cf-cbe5694eca7e admin admin] The token cache is being invalidate because project 72f616501c384b90aa54b7e74ea0077a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:50.247928 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-ff46790d-ea79-49d9-83cf-cbe5694eca7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:50.248754 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-ff46790d-ea79-49d9-83cf-cbe5694eca7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:50.250406 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 768/1539] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:49 2022] DELETE /identity/v3/projects/72f616501c384b90aa54b7e74ea0077a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:50.256442 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943acf4-af6b-4b46-a470-a46360d1b31a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:50.256933 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943acf4-af6b-4b46-a470-a46360d1b31a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:50.257012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943acf4-af6b-4b46-a470-a46360d1b31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:50.285525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-0943acf4-af6b-4b46-a470-a46360d1b31a None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:50.287999 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0943acf4-af6b-4b46-a470-a46360d1b31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:50.424491 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 772/1540] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:50.447022 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed21433-946a-4b47-b850-2febba9421b1 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:50.447520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed21433-946a-4b47-b850-2febba9421b1 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:50.447916 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed21433-946a-4b47-b850-2febba9421b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:50.470699 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-2ed21433-946a-4b47-b850-2febba9421b1 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:50.472056 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-2ed21433-946a-4b47-b850-2febba9421b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:50.485775 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 769/1541] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:50.485963 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943acf4-af6b-4b46-a470-a46360d1b31a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:50.494835 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943acf4-af6b-4b46-a470-a46360d1b31a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:50.499824 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8093cce-a35e-4714-a4f3-d6fcdf2187af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:50.500443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8093cce-a35e-4714-a4f3-d6fcdf2187af admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:50.500726 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8093cce-a35e-4714-a4f3-d6fcdf2187af admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:50.500994 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8093cce-a35e-4714-a4f3-d6fcdf2187af admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:50.501632 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8093cce-a35e-4714-a4f3-d6fcdf2187af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:50.501927 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8093cce-a35e-4714-a4f3-d6fcdf2187af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:50.503581 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8093cce-a35e-4714-a4f3-d6fcdf2187af admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:50.517156 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 773/1542] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:50.521278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed21433-946a-4b47-b850-2febba9421b1 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:50.532103 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed21433-946a-4b47-b850-2febba9421b1 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:50.541176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb01c6d-5f34-493d-a4c9-372fb51e631a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:50.541176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb01c6d-5f34-493d-a4c9-372fb51e631a admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:50.541176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb01c6d-5f34-493d-a4c9-372fb51e631a admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:50.541176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb01c6d-5f34-493d-a4c9-372fb51e631a admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:50.541763 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb01c6d-5f34-493d-a4c9-372fb51e631a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:50.542692 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb01c6d-5f34-493d-a4c9-372fb51e631a admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:50.587640 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 770/1543] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:50 2022] POST /identity/v3/projects => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:13:50.592307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8093cce-a35e-4714-a4f3-d6fcdf2187af admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:50.604584 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8093cce-a35e-4714-a4f3-d6fcdf2187af admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:50.691905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acf8ea-6499-4435-93ee-487348a05dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:50.693085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acf8ea-6499-4435-93ee-487348a05dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:50.693375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acf8ea-6499-4435-93ee-487348a05dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:50.693657 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acf8ea-6499-4435-93ee-487348a05dd6 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:50.694440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acf8ea-6499-4435-93ee-487348a05dd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:50.697388 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acf8ea-6499-4435-93ee-487348a05dd6 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:50.727512 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 774/1544] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:50 2022] POST /identity/v3/users => generated 291 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:50.731648 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb01c6d-5f34-493d-a4c9-372fb51e631a admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:50.747323 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb01c6d-5f34-493d-a4c9-372fb51e631a admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:50.754617 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a297218-8b7f-44e7-a57e-8688cc921473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:50.755257 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a297218-8b7f-44e7-a57e-8688cc921473 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:50.755953 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a297218-8b7f-44e7-a57e-8688cc921473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:50.756236 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a297218-8b7f-44e7-a57e-8688cc921473 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:50.757018 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a297218-8b7f-44e7-a57e-8688cc921473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:50.760641 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a297218-8b7f-44e7-a57e-8688cc921473 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:50.778974 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 771/1545] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:13:50.782556 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acf8ea-6499-4435-93ee-487348a05dd6 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:50.796080 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acf8ea-6499-4435-93ee-487348a05dd6 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:50.803995 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6fffc-318a-49e6-83e3-32d487f63a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:50.804621 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6fffc-318a-49e6-83e3-32d487f63a83 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:50.804903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6fffc-318a-49e6-83e3-32d487f63a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:50.806170 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6fffc-318a-49e6-83e3-32d487f63a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:50.806840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6fffc-318a-49e6-83e3-32d487f63a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:50.808601 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6fffc-318a-49e6-83e3-32d487f63a83 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:50.828118 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 775/1546] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:50.832729 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a297218-8b7f-44e7-a57e-8688cc921473 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:50.849846 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a297218-8b7f-44e7-a57e-8688cc921473 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:50.858923 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebb774-d5af-476b-a0e9-8f3fd5ee3edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:50.859679 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebb774-d5af-476b-a0e9-8f3fd5ee3edc admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:50.859949 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebb774-d5af-476b-a0e9-8f3fd5ee3edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:50.860228 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebb774-d5af-476b-a0e9-8f3fd5ee3edc admin admin] PATH_INFO: `/v3/projects/2325a537a32a4d708cd6a78dcd942e76/users/68db285bf0974f73ace8746010ec45dc/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:50.885015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebb774-d5af-476b-a0e9-8f3fd5ee3edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2325a537a32a4d708cd6a78dcd942e76, user_id=68db285bf0974f73ace8746010ec45dc, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:50.888386 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebb774-d5af-476b-a0e9-8f3fd5ee3edc admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:50.912972 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 772/1547] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:50 2022] PUT /identity/v3/projects/2325a537a32a4d708cd6a78dcd942e76/users/68db285bf0974f73ace8746010ec45dc/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:50.926229 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444d861-569c-4437-bd36-ff169d775ae3 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:50.926563 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444d861-569c-4437-bd36-ff169d775ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:50.927035 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444d861-569c-4437-bd36-ff169d775ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:51.025320 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-a444d861-569c-4437-bd36-ff169d775ae3 None None] MFA Rules not processed for user `68db285bf0974f73ace8746010ec45dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:51.027615 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a444d861-569c-4437-bd36-ff169d775ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:51.122183 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:51.206095 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 776/1548] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:51.208110 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebb774-d5af-476b-a0e9-8f3fd5ee3edc admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:51.324882 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebb774-d5af-476b-a0e9-8f3fd5ee3edc admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:51.330204 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde6a5d-b302-4f82-a5cf-fac8ed5eef8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:51.330935 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde6a5d-b302-4f82-a5cf-fac8ed5eef8c admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:51.331218 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde6a5d-b302-4f82-a5cf-fac8ed5eef8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:51.331525 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde6a5d-b302-4f82-a5cf-fac8ed5eef8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:51.332473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde6a5d-b302-4f82-a5cf-fac8ed5eef8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:51.334548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde6a5d-b302-4f82-a5cf-fac8ed5eef8c admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:51.390687 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 773/1549] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:51 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:51.392054 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444d861-569c-4437-bd36-ff169d775ae3 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:51.420708 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444d861-569c-4437-bd36-ff169d775ae3 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:51.521489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f5af9-22c9-4c20-bd24-1a828b1031fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:51.521806 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f5af9-22c9-4c20-bd24-1a828b1031fe admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:51.522132 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f5af9-22c9-4c20-bd24-1a828b1031fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:51.522406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f5af9-22c9-4c20-bd24-1a828b1031fe admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:51.523048 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f5af9-22c9-4c20-bd24-1a828b1031fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:51.527691 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f5af9-22c9-4c20-bd24-1a828b1031fe admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:51.582738 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde6a5d-b302-4f82-a5cf-fac8ed5eef8c admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:51.583473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 777/1550] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:51 2022] POST /identity/v3/users => generated 298 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:51.596013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde6a5d-b302-4f82-a5cf-fac8ed5eef8c admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:51.601676 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdfdc0-e3ea-48df-a498-712ad80e8b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:51.602328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdfdc0-e3ea-48df-a498-712ad80e8b10 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:51.602608 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdfdc0-e3ea-48df-a498-712ad80e8b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:51.602887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdfdc0-e3ea-48df-a498-712ad80e8b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:51.603559 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fdfdc0-e3ea-48df-a498-712ad80e8b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:51.605186 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fdfdc0-e3ea-48df-a498-712ad80e8b10 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:51.617498 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 774/1551] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:51.621655 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f5af9-22c9-4c20-bd24-1a828b1031fe admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:51.643386 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f5af9-22c9-4c20-bd24-1a828b1031fe admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:51.650139 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4296383-8bcf-49de-8fe0-fd91a788c415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:51.650824 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4296383-8bcf-49de-8fe0-fd91a788c415 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:51.651093 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4296383-8bcf-49de-8fe0-fd91a788c415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:51.651364 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4296383-8bcf-49de-8fe0-fd91a788c415 admin admin] PATH_INFO: `/v3/projects/88a210e2d5ed4f959e29e7514c7a6a81/users/135cf32596224c3ab945addcd43d35d6/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:51.670611 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4296383-8bcf-49de-8fe0-fd91a788c415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a210e2d5ed4f959e29e7514c7a6a81, user_id=135cf32596224c3ab945addcd43d35d6, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:51.673567 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4296383-8bcf-49de-8fe0-fd91a788c415 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:51.689871 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 778/1552] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:51 2022] PUT /identity/v3/projects/88a210e2d5ed4f959e29e7514c7a6a81/users/135cf32596224c3ab945addcd43d35d6/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:51.694103 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdfdc0-e3ea-48df-a498-712ad80e8b10 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:51.703307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:51.709712 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdfdc0-e3ea-48df-a498-712ad80e8b10 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:51.779154 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee35267-cf8c-409a-b54f-61e43cc420c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:51.780041 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee35267-cf8c-409a-b54f-61e43cc420c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:51.780294 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee35267-cf8c-409a-b54f-61e43cc420c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:51.780641 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee35267-cf8c-409a-b54f-61e43cc420c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:51.781343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee35267-cf8c-409a-b54f-61e43cc420c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:51.782973 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee35267-cf8c-409a-b54f-61e43cc420c1 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:51.799476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 775/1553] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:13:51.803680 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4296383-8bcf-49de-8fe0-fd91a788c415 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:51.818048 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4296383-8bcf-49de-8fe0-fd91a788c415 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:51.824778 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865808ab-30b6-4a5b-9c57-18494ab9132a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:51.825452 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865808ab-30b6-4a5b-9c57-18494ab9132a admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:51.825734 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865808ab-30b6-4a5b-9c57-18494ab9132a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:51.826011 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865808ab-30b6-4a5b-9c57-18494ab9132a admin admin] PATH_INFO: `/v3/projects/88a210e2d5ed4f959e29e7514c7a6a81/users/135cf32596224c3ab945addcd43d35d6/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:51.831256 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865808ab-30b6-4a5b-9c57-18494ab9132a admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a210e2d5ed4f959e29e7514c7a6a81, user_id=135cf32596224c3ab945addcd43d35d6, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:51.831256 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865808ab-30b6-4a5b-9c57-18494ab9132a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:51.842834 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 779/1554] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:51 2022] PUT /identity/v3/projects/88a210e2d5ed4f959e29e7514c7a6a81/users/135cf32596224c3ab945addcd43d35d6/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:51.852867 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123aa22-a788-490b-b39d-ff93008dca0b None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:51.853155 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123aa22-a788-490b-b39d-ff93008dca0b None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:51.853429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123aa22-a788-490b-b39d-ff93008dca0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:51.881949 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-b123aa22-a788-490b-b39d-ff93008dca0b None None] MFA Rules not processed for user `135cf32596224c3ab945addcd43d35d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:51.883201 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b123aa22-a788-490b-b39d-ff93008dca0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:51.953149 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 776/1555] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:51.965181 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865808ab-30b6-4a5b-9c57-18494ab9132a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:51.966853 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-865808ab-30b6-4a5b-9c57-18494ab9132a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:52.023629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865808ab-30b6-4a5b-9c57-18494ab9132a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:52.027704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286edbfc-5685-4dcd-926c-72530ce1c25d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:52.028306 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286edbfc-5685-4dcd-926c-72530ce1c25d service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:52.028579 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286edbfc-5685-4dcd-926c-72530ce1c25d service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:52.028844 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286edbfc-5685-4dcd-926c-72530ce1c25d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:52.038065 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286edbfc-5685-4dcd-926c-72530ce1c25d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:52.039565 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286edbfc-5685-4dcd-926c-72530ce1c25d service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:52.049715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 780/1556] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:52.178270 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123aa22-a788-490b-b39d-ff93008dca0b None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:52.179979 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b123aa22-a788-490b-b39d-ff93008dca0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:52.199093 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123aa22-a788-490b-b39d-ff93008dca0b None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:52.206368 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c52c7-f9d6-4f09-a4e4-bc90d4cc532e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:52.207158 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c52c7-f9d6-4f09-a4e4-bc90d4cc532e service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:52.207807 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c52c7-f9d6-4f09-a4e4-bc90d4cc532e service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:52.208172 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c52c7-f9d6-4f09-a4e4-bc90d4cc532e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:52.325773 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c52c7-f9d6-4f09-a4e4-bc90d4cc532e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:52.327205 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c52c7-f9d6-4f09-a4e4-bc90d4cc532e service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:52.341625 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 777/1557] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:53.650804 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464227bc-5992-4358-bf97-f21438ac33dc None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:53.651336 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464227bc-5992-4358-bf97-f21438ac33dc None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:53.651448 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464227bc-5992-4358-bf97-f21438ac33dc None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:53.653439 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 781/1558] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 24 13:13:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:13:53.676889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f7afa-6dba-4923-ba47-a600539d96d0 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:53.677383 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f7afa-6dba-4923-ba47-a600539d96d0 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:53.677648 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f7afa-6dba-4923-ba47-a600539d96d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:53.731640 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-6f2f7afa-6dba-4923-ba47-a600539d96d0 None None] MFA Rules not processed for user `4f6b27c7d052437a949a371169fb48ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:53.732756 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-6f2f7afa-6dba-4923-ba47-a600539d96d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:53.820689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:53.907758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 778/1559] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 24 13:13:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:53.928673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464227bc-5992-4358-bf97-f21438ac33dc None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:53.931547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-464227bc-5992-4358-bf97-f21438ac33dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:53.960683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464227bc-5992-4358-bf97-f21438ac33dc None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:53.967001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a302ca6-ad3e-44a9-9ad0-bc9dee8a9f36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:53.967632 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a302ca6-ad3e-44a9-9ad0-bc9dee8a9f36 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:53.967906 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a302ca6-ad3e-44a9-9ad0-bc9dee8a9f36 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:53.968169 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a302ca6-ad3e-44a9-9ad0-bc9dee8a9f36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:53.976961 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a302ca6-ad3e-44a9-9ad0-bc9dee8a9f36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:53.978944 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a302ca6-ad3e-44a9-9ad0-bc9dee8a9f36 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:53.988999 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 782/1560] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:55.389743 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f7afa-6dba-4923-ba47-a600539d96d0 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:55.391182 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-6f2f7afa-6dba-4923-ba47-a600539d96d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:55.444200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a302ca6-ad3e-44a9-9ad0-bc9dee8a9f36 service nova] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:55.471644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f7afa-6dba-4923-ba47-a600539d96d0 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:55.477572 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be63272-ebd4-454c-b38c-17e213d3340a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:55.477808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:55.478951 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be63272-ebd4-454c-b38c-17e213d3340a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:55.479265 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be63272-ebd4-454c-b38c-17e213d3340a admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:55.479579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be63272-ebd4-454c-b38c-17e213d3340a admin admin] PATH_INFO: `/v3/users/31ed5b8f2fe0442bb43fd4159ccff880` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:55.480864 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be63272-ebd4-454c-b38c-17e213d3340a admin admin] RBAC: Authorizing `identity:delete_user(user_id=31ed5b8f2fe0442bb43fd4159ccff880)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:55.484071 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be63272-ebd4-454c-b38c-17e213d3340a admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:55.545275 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-3be63272-ebd4-454c-b38c-17e213d3340a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31ed5b8f2fe0442bb43fd4159ccff880'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:55.554233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-3be63272-ebd4-454c-b38c-17e213d3340a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31ed5b8f2fe0442bb43fd4159ccff880'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:55.570776 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-3be63272-ebd4-454c-b38c-17e213d3340a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31ed5b8f2fe0442bb43fd4159ccff880'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:55.580499 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a302ca6-ad3e-44a9-9ad0-bc9dee8a9f36 service nova] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:55.587677 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2aa90e-eaba-4afb-aa20-d44f3ebe0ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:55.588448 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aa90e-eaba-4afb-aa20-d44f3ebe0ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:55.588914 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aa90e-eaba-4afb-aa20-d44f3ebe0ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:55.589319 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aa90e-eaba-4afb-aa20-d44f3ebe0ec9 admin admin] PATH_INFO: `/v3/users/68db285bf0974f73ace8746010ec45dc` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:55.591586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2aa90e-eaba-4afb-aa20-d44f3ebe0ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68db285bf0974f73ace8746010ec45dc)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:55.593687 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2aa90e-eaba-4afb-aa20-d44f3ebe0ec9 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:55.598878 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-3be63272-ebd4-454c-b38c-17e213d3340a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31ed5b8f2fe0442bb43fd4159ccff880'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:55.601079 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-3be63272-ebd4-454c-b38c-17e213d3340a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31ed5b8f2fe0442bb43fd4159ccff880'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:55.611903 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 779/1561] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:55 2022] DELETE /identity/v3/users/31ed5b8f2fe0442bb43fd4159ccff880 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:55.616215 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304d7c8-4b2a-4afc-a396-9076becacb43 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:55.616900 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304d7c8-4b2a-4afc-a396-9076becacb43 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:55.617343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304d7c8-4b2a-4afc-a396-9076becacb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:55.644980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-0304d7c8-4b2a-4afc-a396-9076becacb43 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:55.646196 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-0304d7c8-4b2a-4afc-a396-9076becacb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:55.686549 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1a2aa90e-eaba-4afb-aa20-d44f3ebe0ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68db285bf0974f73ace8746010ec45dc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:55.687518 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:55.694285 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1a2aa90e-eaba-4afb-aa20-d44f3ebe0ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68db285bf0974f73ace8746010ec45dc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:55.712526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1a2aa90e-eaba-4afb-aa20-d44f3ebe0ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68db285bf0974f73ace8746010ec45dc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:55.722937 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1a2aa90e-eaba-4afb-aa20-d44f3ebe0ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68db285bf0974f73ace8746010ec45dc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:55.723599 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 780/1562] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:55.723853 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1a2aa90e-eaba-4afb-aa20-d44f3ebe0ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68db285bf0974f73ace8746010ec45dc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:55.731692 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 783/1563] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:55 2022] DELETE /identity/v3/users/68db285bf0974f73ace8746010ec45dc => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:55.735616 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304d7c8-4b2a-4afc-a396-9076becacb43 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:55.735955 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf6df6-2580-40b8-b214-69537adedf8d None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:55.736247 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf6df6-2580-40b8-b214-69537adedf8d None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:55.736670 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf6df6-2580-40b8-b214-69537adedf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:55.737182 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-0304d7c8-4b2a-4afc-a396-9076becacb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:55.757030 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-88cf6df6-2580-40b8-b214-69537adedf8d None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:55.758308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-88cf6df6-2580-40b8-b214-69537adedf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:55.826836 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 784/1564] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:55.837907 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf6df6-2580-40b8-b214-69537adedf8d None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:55.839532 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-88cf6df6-2580-40b8-b214-69537adedf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:55.888828 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:55.911325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf6df6-2580-40b8-b214-69537adedf8d None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:55.917208 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a06aea-edd4-4aee-937f-7c7a4672f1d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:55.918149 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a06aea-edd4-4aee-937f-7c7a4672f1d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:55.918435 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a06aea-edd4-4aee-937f-7c7a4672f1d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:55.918703 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a06aea-edd4-4aee-937f-7c7a4672f1d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:55.928687 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a06aea-edd4-4aee-937f-7c7a4672f1d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:55.930228 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a06aea-edd4-4aee-937f-7c7a4672f1d7 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:55.938171 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304d7c8-4b2a-4afc-a396-9076becacb43 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:55.941639 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 785/1565] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:13:55.942402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59c701-ae4c-458f-9935-f772c329e51d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:55.943011 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59c701-ae4c-458f-9935-f772c329e51d service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:55.943377 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59c701-ae4c-458f-9935-f772c329e51d service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:55.943669 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59c701-ae4c-458f-9935-f772c329e51d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:55.945412 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-7d59c701-ae4c-458f-9935-f772c329e51d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:55.959953 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59c701-ae4c-458f-9935-f772c329e51d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:55.962484 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59c701-ae4c-458f-9935-f772c329e51d service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:55.972411 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 781/1566] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:56.674516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a06aea-edd4-4aee-937f-7c7a4672f1d7 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:56.677897 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-16a06aea-edd4-4aee-937f-7c7a4672f1d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:56.701698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a06aea-edd4-4aee-937f-7c7a4672f1d7 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:56.714680 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db216f-d690-4181-91b8-6841c3eb7777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:56.715751 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db216f-d690-4181-91b8-6841c3eb7777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:56.716437 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db216f-d690-4181-91b8-6841c3eb7777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:56.717198 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db216f-d690-4181-91b8-6841c3eb7777 admin admin] PATH_INFO: `/v3/users/1ce500fb3a9042c59e7868379261f7a3` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:56.719598 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db216f-d690-4181-91b8-6841c3eb7777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ce500fb3a9042c59e7868379261f7a3)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:56.725776 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db216f-d690-4181-91b8-6841c3eb7777 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:56.736432 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59c701-ae4c-458f-9935-f772c329e51d service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:56.738053 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-7d59c701-ae4c-458f-9935-f772c329e51d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:56.756053 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59c701-ae4c-458f-9935-f772c329e51d service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:56.770758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f56ee-3ee6-428d-b272-c160c3d95cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:56.775889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f56ee-3ee6-428d-b272-c160c3d95cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:56.778614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f56ee-3ee6-428d-b272-c160c3d95cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:56.779090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f56ee-3ee6-428d-b272-c160c3d95cf5 admin admin] PATH_INFO: `/v3/projects/2325a537a32a4d708cd6a78dcd942e76` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:56.780775 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f56ee-3ee6-428d-b272-c160c3d95cf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2325a537a32a4d708cd6a78dcd942e76)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:56.786256 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f56ee-3ee6-428d-b272-c160c3d95cf5 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:56.845387 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c0db216f-d690-4181-91b8-6841c3eb7777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ce500fb3a9042c59e7868379261f7a3'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:56.870985 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c0db216f-d690-4181-91b8-6841c3eb7777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ce500fb3a9042c59e7868379261f7a3'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:56.884677 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8b0f56ee-3ee6-428d-b272-c160c3d95cf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2325a537a32a4d708cd6a78dcd942e76', 'request_id': 'req-8b0f56ee-3ee6-428d-b272-c160c3d95cf5'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:56.895514 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c0db216f-d690-4181-91b8-6841c3eb7777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ce500fb3a9042c59e7868379261f7a3'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:56.901000 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8b0f56ee-3ee6-428d-b272-c160c3d95cf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2325a537a32a4d708cd6a78dcd942e76', 'request_id': 'req-8b0f56ee-3ee6-428d-b272-c160c3d95cf5'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:56.909060 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8b0f56ee-3ee6-428d-b272-c160c3d95cf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2325a537a32a4d708cd6a78dcd942e76', 'request_id': 'req-8b0f56ee-3ee6-428d-b272-c160c3d95cf5'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:56.912707 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c0db216f-d690-4181-91b8-6841c3eb7777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ce500fb3a9042c59e7868379261f7a3'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:56.913519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c0db216f-d690-4181-91b8-6841c3eb7777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ce500fb3a9042c59e7868379261f7a3'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:56.928098 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 786/1567] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:56 2022] DELETE /identity/v3/users/1ce500fb3a9042c59e7868379261f7a3 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:56.930955 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b28bd-1ccc-446a-b1ea-beaf2aa05b7f None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:56.932180 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b28bd-1ccc-446a-b1ea-beaf2aa05b7f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:56.932559 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b28bd-1ccc-446a-b1ea-beaf2aa05b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:56.938819 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8b0f56ee-3ee6-428d-b272-c160c3d95cf5 admin admin] The token cache is being invalidate because project 2325a537a32a4d708cd6a78dcd942e76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:56.939514 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8b0f56ee-3ee6-428d-b272-c160c3d95cf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:56.940669 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8b0f56ee-3ee6-428d-b272-c160c3d95cf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:56.943360 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 782/1568] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:56 2022] DELETE /identity/v3/projects/2325a537a32a4d708cd6a78dcd942e76 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:56.949332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f56ee-3ee6-428d-b272-c160c3d95cf5 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:56.952120 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-8b0f56ee-3ee6-428d-b272-c160c3d95cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:56.969215 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-aa5b28bd-1ccc-446a-b1ea-beaf2aa05b7f None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:56.970614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-aa5b28bd-1ccc-446a-b1ea-beaf2aa05b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:57.053108 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f56ee-3ee6-428d-b272-c160c3d95cf5 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:57.057952 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 787/1569] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:57.057952 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b28bd-1ccc-446a-b1ea-beaf2aa05b7f None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:57.057952 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-aa5b28bd-1ccc-446a-b1ea-beaf2aa05b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:57.061127 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf26619-dc3e-4f7a-9a79-0b004bd2c73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:57.061854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf26619-dc3e-4f7a-9a79-0b004bd2c73d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:57.062131 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf26619-dc3e-4f7a-9a79-0b004bd2c73d admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:57.062398 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf26619-dc3e-4f7a-9a79-0b004bd2c73d admin admin] PATH_INFO: `/v3/users/135cf32596224c3ab945addcd43d35d6` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:57.063662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf26619-dc3e-4f7a-9a79-0b004bd2c73d admin admin] RBAC: Authorizing `identity:delete_user(user_id=135cf32596224c3ab945addcd43d35d6)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:57.065730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf26619-dc3e-4f7a-9a79-0b004bd2c73d admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:57.068419 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:57.072208 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b28bd-1ccc-446a-b1ea-beaf2aa05b7f None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:57.078032 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b598d3-bf0c-40e0-9d68-7d5697daf945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:57.078675 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b598d3-bf0c-40e0-9d68-7d5697daf945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:57.078960 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b598d3-bf0c-40e0-9d68-7d5697daf945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:57.079558 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b598d3-bf0c-40e0-9d68-7d5697daf945 admin admin] PATH_INFO: `/v3/projects/1c6ab95d1d4548df87daf7b6287e3e18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:57.080388 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b598d3-bf0c-40e0-9d68-7d5697daf945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c6ab95d1d4548df87daf7b6287e3e18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:57.082650 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b598d3-bf0c-40e0-9d68-7d5697daf945 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:57.128264 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-5bf26619-dc3e-4f7a-9a79-0b004bd2c73d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '135cf32596224c3ab945addcd43d35d6'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.138718 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:57.138937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-5bf26619-dc3e-4f7a-9a79-0b004bd2c73d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '135cf32596224c3ab945addcd43d35d6'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.142004 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-79b598d3-bf0c-40e0-9d68-7d5697daf945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c6ab95d1d4548df87daf7b6287e3e18', 'request_id': 'req-79b598d3-bf0c-40e0-9d68-7d5697daf945'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.149698 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-5bf26619-dc3e-4f7a-9a79-0b004bd2c73d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '135cf32596224c3ab945addcd43d35d6'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.153645 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-79b598d3-bf0c-40e0-9d68-7d5697daf945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c6ab95d1d4548df87daf7b6287e3e18', 'request_id': 'req-79b598d3-bf0c-40e0-9d68-7d5697daf945'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.160116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-79b598d3-bf0c-40e0-9d68-7d5697daf945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c6ab95d1d4548df87daf7b6287e3e18', 'request_id': 'req-79b598d3-bf0c-40e0-9d68-7d5697daf945'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.165474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-5bf26619-dc3e-4f7a-9a79-0b004bd2c73d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '135cf32596224c3ab945addcd43d35d6'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.166390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-5bf26619-dc3e-4f7a-9a79-0b004bd2c73d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '135cf32596224c3ab945addcd43d35d6'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.172670 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-79b598d3-bf0c-40e0-9d68-7d5697daf945 admin admin] The token cache is being invalidate because project 1c6ab95d1d4548df87daf7b6287e3e18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:57.173142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-79b598d3-bf0c-40e0-9d68-7d5697daf945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.173481 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 783/1570] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:56 2022] DELETE /identity/v3/users/135cf32596224c3ab945addcd43d35d6 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:57.173717 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-79b598d3-bf0c-40e0-9d68-7d5697daf945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.174522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf26619-dc3e-4f7a-9a79-0b004bd2c73d admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:57.175238 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 788/1571] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:57 2022] DELETE /identity/v3/projects/1c6ab95d1d4548df87daf7b6287e3e18 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:57.181019 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-5bf26619-dc3e-4f7a-9a79-0b004bd2c73d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:57.186631 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b598d3-bf0c-40e0-9d68-7d5697daf945 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:57.188783 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-79b598d3-bf0c-40e0-9d68-7d5697daf945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:57.275646 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf26619-dc3e-4f7a-9a79-0b004bd2c73d admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:57.281360 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d5552-29b3-434f-a31e-51c9717bead4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:57.282035 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d5552-29b3-434f-a31e-51c9717bead4 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:57.282319 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d5552-29b3-434f-a31e-51c9717bead4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:57.282589 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d5552-29b3-434f-a31e-51c9717bead4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:57.284978 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-011d5552-29b3-434f-a31e-51c9717bead4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:57.306812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b598d3-bf0c-40e0-9d68-7d5697daf945 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:57.418058 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d5552-29b3-434f-a31e-51c9717bead4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:57.419335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc997873-26bb-429f-9a62-6f284ac6965b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:57.419555 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d5552-29b3-434f-a31e-51c9717bead4 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:57.421891 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc997873-26bb-429f-9a62-6f284ac6965b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:57.422412 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc997873-26bb-429f-9a62-6f284ac6965b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:57.422835 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc997873-26bb-429f-9a62-6f284ac6965b admin admin] PATH_INFO: `/v3/users/9fc90f652ae6487888c3d62655cb230c` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:57.425144 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc997873-26bb-429f-9a62-6f284ac6965b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fc90f652ae6487888c3d62655cb230c)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:57.427107 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc997873-26bb-429f-9a62-6f284ac6965b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:57.431219 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 784/1572] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:57.514055 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cc997873-26bb-429f-9a62-6f284ac6965b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fc90f652ae6487888c3d62655cb230c'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.529865 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cc997873-26bb-429f-9a62-6f284ac6965b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fc90f652ae6487888c3d62655cb230c'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.561093 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cc997873-26bb-429f-9a62-6f284ac6965b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fc90f652ae6487888c3d62655cb230c'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.575024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d5552-29b3-434f-a31e-51c9717bead4 service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:57.576658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-011d5552-29b3-434f-a31e-51c9717bead4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:57.576965 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cc997873-26bb-429f-9a62-6f284ac6965b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fc90f652ae6487888c3d62655cb230c'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.578118 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cc997873-26bb-429f-9a62-6f284ac6965b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fc90f652ae6487888c3d62655cb230c'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.597177 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d5552-29b3-434f-a31e-51c9717bead4 service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:57.605771 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 789/1573] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:57 2022] DELETE /identity/v3/users/9fc90f652ae6487888c3d62655cb230c => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:57.612577 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89385e82-c01a-4209-809c-2436b7fa1d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:57.613292 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89385e82-c01a-4209-809c-2436b7fa1d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:57.613571 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89385e82-c01a-4209-809c-2436b7fa1d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:57.614330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89385e82-c01a-4209-809c-2436b7fa1d3c admin admin] PATH_INFO: `/v3/projects/88a210e2d5ed4f959e29e7514c7a6a81` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:57.615560 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89385e82-c01a-4209-809c-2436b7fa1d3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a210e2d5ed4f959e29e7514c7a6a81)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:57.619004 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89385e82-c01a-4209-809c-2436b7fa1d3c admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:57.704949 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:57.736669 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-89385e82-c01a-4209-809c-2436b7fa1d3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a210e2d5ed4f959e29e7514c7a6a81', 'request_id': 'req-89385e82-c01a-4209-809c-2436b7fa1d3c'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.748063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-89385e82-c01a-4209-809c-2436b7fa1d3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a210e2d5ed4f959e29e7514c7a6a81', 'request_id': 'req-89385e82-c01a-4209-809c-2436b7fa1d3c'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.762418 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-89385e82-c01a-4209-809c-2436b7fa1d3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a210e2d5ed4f959e29e7514c7a6a81', 'request_id': 'req-89385e82-c01a-4209-809c-2436b7fa1d3c'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.793048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-89385e82-c01a-4209-809c-2436b7fa1d3c admin admin] The token cache is being invalidate because project 88a210e2d5ed4f959e29e7514c7a6a81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:57.793723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-89385e82-c01a-4209-809c-2436b7fa1d3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.795176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-89385e82-c01a-4209-809c-2436b7fa1d3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.797569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 785/1574] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:57 2022] DELETE /identity/v3/projects/88a210e2d5ed4f959e29e7514c7a6a81 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:57.802354 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2214b7-eabe-4a1a-89c2-467765ad0e7f None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:57.802865 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2214b7-eabe-4a1a-89c2-467765ad0e7f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:57.803122 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2214b7-eabe-4a1a-89c2-467765ad0e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:57.812419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:57.831776 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-cf2214b7-eabe-4a1a-89c2-467765ad0e7f None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:57.834957 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-cf2214b7-eabe-4a1a-89c2-467765ad0e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:57.938579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89385e82-c01a-4209-809c-2436b7fa1d3c admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:57.940627 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-89385e82-c01a-4209-809c-2436b7fa1d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:57.957802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 790/1575] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:57.968267 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b2057-484e-4e62-a619-a35b1f6b1398 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:57.968623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b2057-484e-4e62-a619-a35b1f6b1398 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:57.968942 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b2057-484e-4e62-a619-a35b1f6b1398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:57.996998 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-e43b2057-484e-4e62-a619-a35b1f6b1398 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:57.998243 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e43b2057-484e-4e62-a619-a35b1f6b1398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:58.009056 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 791/1576] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:58.013326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b2057-484e-4e62-a619-a35b1f6b1398 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:58.024758 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b2057-484e-4e62-a619-a35b1f6b1398 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:58.040597 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ed0c6-d393-4d08-9d72-99b654cf16cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:58.042329 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ed0c6-d393-4d08-9d72-99b654cf16cf admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:58.042620 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ed0c6-d393-4d08-9d72-99b654cf16cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:58.042898 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ed0c6-d393-4d08-9d72-99b654cf16cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:58.043605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ed0c6-d393-4d08-9d72-99b654cf16cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:58.043911 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ed0c6-d393-4d08-9d72-99b654cf16cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:58.045811 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ed0c6-d393-4d08-9d72-99b654cf16cf admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:58.071014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 792/1577] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:13:58.075063 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ed0c6-d393-4d08-9d72-99b654cf16cf admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:58.092948 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ed0c6-d393-4d08-9d72-99b654cf16cf admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:58.108854 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4617dcc-cc68-45a1-af20-a122f7728c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:58.109545 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4617dcc-cc68-45a1-af20-a122f7728c1e admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:58.109891 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4617dcc-cc68-45a1-af20-a122f7728c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:58.110287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4617dcc-cc68-45a1-af20-a122f7728c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:58.111027 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4617dcc-cc68-45a1-af20-a122f7728c1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:58.116964 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4617dcc-cc68-45a1-af20-a122f7728c1e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:58.127779 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89385e82-c01a-4209-809c-2436b7fa1d3c admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:58.140698 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f63015-09ad-42e9-b624-cea825f5edda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:58.141421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f63015-09ad-42e9-b624-cea825f5edda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:58.141932 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f63015-09ad-42e9-b624-cea825f5edda admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:58.142275 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f63015-09ad-42e9-b624-cea825f5edda admin admin] PATH_INFO: `/v3/projects/a6f77e9963b143e384cca8b56fa591e5` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:58.147370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f63015-09ad-42e9-b624-cea825f5edda admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6f77e9963b143e384cca8b56fa591e5)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:58.152865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f63015-09ad-42e9-b624-cea825f5edda admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:58.214266 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 793/1578] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:58 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:13:58.215374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4617dcc-cc68-45a1-af20-a122f7728c1e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:58.325730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-50f63015-09ad-42e9-b624-cea825f5edda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6f77e9963b143e384cca8b56fa591e5', 'request_id': 'req-50f63015-09ad-42e9-b624-cea825f5edda'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:58.338407 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-50f63015-09ad-42e9-b624-cea825f5edda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6f77e9963b143e384cca8b56fa591e5', 'request_id': 'req-50f63015-09ad-42e9-b624-cea825f5edda'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:58.354201 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-50f63015-09ad-42e9-b624-cea825f5edda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6f77e9963b143e384cca8b56fa591e5', 'request_id': 'req-50f63015-09ad-42e9-b624-cea825f5edda'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:58.382916 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-50f63015-09ad-42e9-b624-cea825f5edda admin admin] The token cache is being invalidate because project a6f77e9963b143e384cca8b56fa591e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:58.382916 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-50f63015-09ad-42e9-b624-cea825f5edda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:58.385809 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-50f63015-09ad-42e9-b624-cea825f5edda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:58.388631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 786/1579] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:57 2022] DELETE /identity/v3/projects/a6f77e9963b143e384cca8b56fa591e5 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:58.396178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f63015-09ad-42e9-b624-cea825f5edda admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:58.397948 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-50f63015-09ad-42e9-b624-cea825f5edda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:58.452884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4617dcc-cc68-45a1-af20-a122f7728c1e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:58.490872 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:58.522986 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f63015-09ad-42e9-b624-cea825f5edda admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:58.530398 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d7b68-b3d6-48e4-bbff-ade362c39498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:58.531229 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d7b68-b3d6-48e4-bbff-ade362c39498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:58.531669 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d7b68-b3d6-48e4-bbff-ade362c39498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:58.532041 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d7b68-b3d6-48e4-bbff-ade362c39498 admin admin] PATH_INFO: `/v3/users/0d854ee2f06a42b8841aee2f11d4817f` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:58.533301 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d7b68-b3d6-48e4-bbff-ade362c39498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d854ee2f06a42b8841aee2f11d4817f)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:58.543404 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d7b68-b3d6-48e4-bbff-ade362c39498 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:58.604999 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482d005-d16d-4c28-8bc5-d6e2b0788c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:58.605752 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482d005-d16d-4c28-8bc5-d6e2b0788c20 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:58.606185 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482d005-d16d-4c28-8bc5-d6e2b0788c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:58.606300 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482d005-d16d-4c28-8bc5-d6e2b0788c20 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:58.607519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482d005-d16d-4c28-8bc5-d6e2b0788c20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:58.609749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482d005-d16d-4c28-8bc5-d6e2b0788c20 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:58.637587 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:58.640027 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-bd7d7b68-b3d6-48e4-bbff-ade362c39498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d854ee2f06a42b8841aee2f11d4817f'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:58.657407 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 794/1580] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:58 2022] POST /identity/v3/users => generated 289 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:58.659466 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482d005-d16d-4c28-8bc5-d6e2b0788c20 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:58.662744 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7482d005-d16d-4c28-8bc5-d6e2b0788c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:58.664594 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-bd7d7b68-b3d6-48e4-bbff-ade362c39498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d854ee2f06a42b8841aee2f11d4817f'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:58.676731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-bd7d7b68-b3d6-48e4-bbff-ade362c39498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d854ee2f06a42b8841aee2f11d4817f'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:58.689008 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482d005-d16d-4c28-8bc5-d6e2b0788c20 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:58.696757 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-bd7d7b68-b3d6-48e4-bbff-ade362c39498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d854ee2f06a42b8841aee2f11d4817f'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:58.697574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-bd7d7b68-b3d6-48e4-bbff-ade362c39498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d854ee2f06a42b8841aee2f11d4817f'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:58.702481 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f21ff-1888-4119-b30a-4b4ed7562b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:58.704266 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f21ff-1888-4119-b30a-4b4ed7562b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:58.704770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f21ff-1888-4119-b30a-4b4ed7562b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:58.705154 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 787/1581] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:58 2022] DELETE /identity/v3/users/0d854ee2f06a42b8841aee2f11d4817f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:58.705917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f21ff-1888-4119-b30a-4b4ed7562b48 admin admin] PATH_INFO: `/v3/projects/31b89628f30f472ead1687ebc23e1f9c` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:58.707673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f21ff-1888-4119-b30a-4b4ed7562b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31b89628f30f472ead1687ebc23e1f9c)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:58.710100 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d7b68-b3d6-48e4-bbff-ade362c39498 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:58.710792 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f21ff-1888-4119-b30a-4b4ed7562b48 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:58.712067 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-bd7d7b68-b3d6-48e4-bbff-ade362c39498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:58.793505 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-573f21ff-1888-4119-b30a-4b4ed7562b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31b89628f30f472ead1687ebc23e1f9c', 'request_id': 'req-573f21ff-1888-4119-b30a-4b4ed7562b48'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:58.801679 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d7b68-b3d6-48e4-bbff-ade362c39498 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:58.806567 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-573f21ff-1888-4119-b30a-4b4ed7562b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31b89628f30f472ead1687ebc23e1f9c', 'request_id': 'req-573f21ff-1888-4119-b30a-4b4ed7562b48'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:58.817564 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-573f21ff-1888-4119-b30a-4b4ed7562b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31b89628f30f472ead1687ebc23e1f9c', 'request_id': 'req-573f21ff-1888-4119-b30a-4b4ed7562b48'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:58.835561 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-573f21ff-1888-4119-b30a-4b4ed7562b48 admin admin] The token cache is being invalidate because project 31b89628f30f472ead1687ebc23e1f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:58.835851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-573f21ff-1888-4119-b30a-4b4ed7562b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:58.836822 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-573f21ff-1888-4119-b30a-4b4ed7562b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:58.842302 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 795/1582] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:58 2022] DELETE /identity/v3/projects/31b89628f30f472ead1687ebc23e1f9c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:58.844182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd8570-29a7-41fd-bdac-24e5d735aeb9 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:58.844473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd8570-29a7-41fd-bdac-24e5d735aeb9 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:58.844753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd8570-29a7-41fd-bdac-24e5d735aeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:58.876412 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-8edd8570-29a7-41fd-bdac-24e5d735aeb9 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:58.877641 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8edd8570-29a7-41fd-bdac-24e5d735aeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:58.878666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e1b49-563f-461d-a126-64f116414222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:58.879556 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e1b49-563f-461d-a126-64f116414222 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:58.879990 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e1b49-563f-461d-a126-64f116414222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:58.880562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e1b49-563f-461d-a126-64f116414222 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:58.881476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e1b49-563f-461d-a126-64f116414222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:58.883850 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e1b49-563f-461d-a126-64f116414222 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:58.886969 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 796/1583] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:58.895599 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb5fed-86a8-4809-9a7e-d0db0b48ec88 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:58.895888 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb5fed-86a8-4809-9a7e-d0db0b48ec88 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:58.896159 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb5fed-86a8-4809-9a7e-d0db0b48ec88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:58.901236 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 788/1584] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:58.902558 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e1b49-563f-461d-a126-64f116414222 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:58.909859 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-e84e1b49-563f-461d-a126-64f116414222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:58.920912 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-a9fb5fed-86a8-4809-9a7e-d0db0b48ec88 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:58.923972 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a9fb5fed-86a8-4809-9a7e-d0db0b48ec88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:58.927049 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e1b49-563f-461d-a126-64f116414222 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:58.933677 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 797/1585] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:58.934628 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a677853-b30b-4bb6-a4d7-2dd95fe9ad39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:58.936111 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a677853-b30b-4bb6-a4d7-2dd95fe9ad39 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:58.936390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a677853-b30b-4bb6-a4d7-2dd95fe9ad39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:58.936918 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a677853-b30b-4bb6-a4d7-2dd95fe9ad39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:58.938171 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a677853-b30b-4bb6-a4d7-2dd95fe9ad39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:58.938355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb5fed-86a8-4809-9a7e-d0db0b48ec88 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:58.939280 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a677853-b30b-4bb6-a4d7-2dd95fe9ad39 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:58.941007 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:58.950391 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb5fed-86a8-4809-9a7e-d0db0b48ec88 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:58.964883 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c1925-e493-41bd-81ed-a887543c5f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:58.967261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c1925-e493-41bd-81ed-a887543c5f5e admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:58.968257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c1925-e493-41bd-81ed-a887543c5f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:58.968744 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c1925-e493-41bd-81ed-a887543c5f5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:58.970963 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c1925-e493-41bd-81ed-a887543c5f5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:58.971338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c1925-e493-41bd-81ed-a887543c5f5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:58.975992 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c1925-e493-41bd-81ed-a887543c5f5e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:58.979283 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 789/1586] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:58.984112 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a677853-b30b-4bb6-a4d7-2dd95fe9ad39 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:59.000352 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a677853-b30b-4bb6-a4d7-2dd95fe9ad39 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:59.006712 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40da85-134b-4637-944c-7351c2006d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:59.007868 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40da85-134b-4637-944c-7351c2006d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:59.007978 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 798/1587] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:59.008069 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40da85-134b-4637-944c-7351c2006d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:59.008903 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40da85-134b-4637-944c-7351c2006d3d admin admin] PATH_INFO: `/v3/projects/9289b3b90f384dda8eb2a7694bf094b0/users/e3a2fe8a774846dba0997047594a7368/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:59.009928 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c1925-e493-41bd-81ed-a887543c5f5e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:59.022028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c1925-e493-41bd-81ed-a887543c5f5e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:59.028942 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dd041-3287-4f43-9545-85773a7744ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:59.029663 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dd041-3287-4f43-9545-85773a7744ef admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:59.030012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dd041-3287-4f43-9545-85773a7744ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:59.030347 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dd041-3287-4f43-9545-85773a7744ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:59.031052 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0dd041-3287-4f43-9545-85773a7744ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:59.031822 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40da85-134b-4637-944c-7351c2006d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9289b3b90f384dda8eb2a7694bf094b0, user_id=e3a2fe8a774846dba0997047594a7368, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:59.033168 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0dd041-3287-4f43-9545-85773a7744ef admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:59.035587 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40da85-134b-4637-944c-7351c2006d3d admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:59.058029 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 790/1588] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:58 2022] PUT /identity/v3/projects/9289b3b90f384dda8eb2a7694bf094b0/users/e3a2fe8a774846dba0997047594a7368/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:59.069079 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a2c17-21a2-4e04-afd3-bd2f92b781e4 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:59.069564 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a2c17-21a2-4e04-afd3-bd2f92b781e4 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:59.070520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a2c17-21a2-4e04-afd3-bd2f92b781e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:59.073801 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 799/1589] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:59 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:59.077950 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dd041-3287-4f43-9545-85773a7744ef admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:59.124741 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-052a2c17-21a2-4e04-afd3-bd2f92b781e4 None None] MFA Rules not processed for user `e3a2fe8a774846dba0997047594a7368`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:59.127463 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-052a2c17-21a2-4e04-afd3-bd2f92b781e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:59.204776 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dd041-3287-4f43-9545-85773a7744ef admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:59.212240 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcc7aa-4ae8-4a66-9690-6f5486d2c9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:59.213016 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcc7aa-4ae8-4a66-9690-6f5486d2c9d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:59.214134 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcc7aa-4ae8-4a66-9690-6f5486d2c9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:59.214583 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcc7aa-4ae8-4a66-9690-6f5486d2c9d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:59.215781 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffcc7aa-4ae8-4a66-9690-6f5486d2c9d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:59.218161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffcc7aa-4ae8-4a66-9690-6f5486d2c9d0 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:59.260603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 800/1590] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:59 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:59.262491 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcc7aa-4ae8-4a66-9690-6f5486d2c9d0 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:59.267729 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 791/1591] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:59.267911 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-dffcc7aa-4ae8-4a66-9690-6f5486d2c9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:59.267999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a2c17-21a2-4e04-afd3-bd2f92b781e4 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:59.302117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a2c17-21a2-4e04-afd3-bd2f92b781e4 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:59.306776 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcc7aa-4ae8-4a66-9690-6f5486d2c9d0 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:59.314266 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef2a92-ff0a-4b1b-a415-ae3a0a20c6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:59.315739 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef2a92-ff0a-4b1b-a415-ae3a0a20c6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:59.316905 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef2a92-ff0a-4b1b-a415-ae3a0a20c6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:59.317843 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b760b0c-6a7c-478a-9c0d-2d51f55905fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:59.318207 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef2a92-ff0a-4b1b-a415-ae3a0a20c6f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:59.319627 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef2a92-ff0a-4b1b-a415-ae3a0a20c6f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:59.319871 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b760b0c-6a7c-478a-9c0d-2d51f55905fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:59.320874 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b760b0c-6a7c-478a-9c0d-2d51f55905fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:59.321222 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b760b0c-6a7c-478a-9c0d-2d51f55905fd admin admin] PATH_INFO: `/v3/projects/3cc21de6a27648449b5fc24e8ecd81bf` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:59.322440 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef2a92-ff0a-4b1b-a415-ae3a0a20c6f6 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:59.324716 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b760b0c-6a7c-478a-9c0d-2d51f55905fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cc21de6a27648449b5fc24e8ecd81bf)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:59.328459 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b760b0c-6a7c-478a-9c0d-2d51f55905fd admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:59.349741 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 792/1592] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:59.350753 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef2a92-ff0a-4b1b-a415-ae3a0a20c6f6 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:59.372451 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:59.373345 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef2a92-ff0a-4b1b-a415-ae3a0a20c6f6 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:59.385415 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4242b1-5fc1-43a2-a39a-2c40b136876a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:59.385918 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4242b1-5fc1-43a2-a39a-2c40b136876a admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:59.388004 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4242b1-5fc1-43a2-a39a-2c40b136876a admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:59.388183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4242b1-5fc1-43a2-a39a-2c40b136876a admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:59.388823 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4242b1-5fc1-43a2-a39a-2c40b136876a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:59.390732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4242b1-5fc1-43a2-a39a-2c40b136876a admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:59.455183 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5b760b0c-6a7c-478a-9c0d-2d51f55905fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cc21de6a27648449b5fc24e8ecd81bf', 'request_id': 'req-5b760b0c-6a7c-478a-9c0d-2d51f55905fd'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:59.470710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5b760b0c-6a7c-478a-9c0d-2d51f55905fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cc21de6a27648449b5fc24e8ecd81bf', 'request_id': 'req-5b760b0c-6a7c-478a-9c0d-2d51f55905fd'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:59.479231 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5b760b0c-6a7c-478a-9c0d-2d51f55905fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cc21de6a27648449b5fc24e8ecd81bf', 'request_id': 'req-5b760b0c-6a7c-478a-9c0d-2d51f55905fd'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:59.501070 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 793/1593] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:59 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:59.501070 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4242b1-5fc1-43a2-a39a-2c40b136876a admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:59.501306 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5b760b0c-6a7c-478a-9c0d-2d51f55905fd admin admin] The token cache is being invalidate because project 3cc21de6a27648449b5fc24e8ecd81bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:59.501306 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5b760b0c-6a7c-478a-9c0d-2d51f55905fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:59.505530 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5b760b0c-6a7c-478a-9c0d-2d51f55905fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:59.512756 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 801/1594] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:59 2022] DELETE /identity/v3/projects/3cc21de6a27648449b5fc24e8ecd81bf => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:59.512756 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b760b0c-6a7c-478a-9c0d-2d51f55905fd admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:59.513005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-7f4242b1-5fc1-43a2-a39a-2c40b136876a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:59.514652 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5b760b0c-6a7c-478a-9c0d-2d51f55905fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:59.653998 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b760b0c-6a7c-478a-9c0d-2d51f55905fd admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:59.661802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac2d59-3dd8-44dd-980d-2e8142d33f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:59.665280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac2d59-3dd8-44dd-980d-2e8142d33f52 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:59.665666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac2d59-3dd8-44dd-980d-2e8142d33f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:59.666087 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac2d59-3dd8-44dd-980d-2e8142d33f52 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:59.666891 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac2d59-3dd8-44dd-980d-2e8142d33f52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:59.669368 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac2d59-3dd8-44dd-980d-2e8142d33f52 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:59.670986 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4242b1-5fc1-43a2-a39a-2c40b136876a admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:59.677168 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb840c1-9684-4636-afab-c535d3ed2f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:59.677945 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb840c1-9684-4636-afab-c535d3ed2f58 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:59.679467 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb840c1-9684-4636-afab-c535d3ed2f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:59.679981 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb840c1-9684-4636-afab-c535d3ed2f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:59.681701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb840c1-9684-4636-afab-c535d3ed2f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:59.685754 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb840c1-9684-4636-afab-c535d3ed2f58 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:59.712137 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 794/1595] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:59.714646 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7790f96-2ca3-4694-9b6a-0ea7d1c2e7f9 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:59.715003 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7790f96-2ca3-4694-9b6a-0ea7d1c2e7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:59.715292 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7790f96-2ca3-4694-9b6a-0ea7d1c2e7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:59.719821 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 802/1596] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:59 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:59.721553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac2d59-3dd8-44dd-980d-2e8142d33f52 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:59.736416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac2d59-3dd8-44dd-980d-2e8142d33f52 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:59.741965 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad5ade-f661-400d-8d7e-f4cfd6ef2e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:59.743398 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad5ade-f661-400d-8d7e-f4cfd6ef2e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:59.743903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad5ade-f661-400d-8d7e-f4cfd6ef2e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:59.744350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad5ade-f661-400d-8d7e-f4cfd6ef2e14 admin admin] PATH_INFO: `/v3/projects/98fc8ad096474c76bc2bdfecf22c3777/users/73a1fc7915e14d6996f668dde44d2def/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:59.764044 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-b7790f96-2ca3-4694-9b6a-0ea7d1c2e7f9 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:59.765422 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b7790f96-2ca3-4694-9b6a-0ea7d1c2e7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:59.777451 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad5ade-f661-400d-8d7e-f4cfd6ef2e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98fc8ad096474c76bc2bdfecf22c3777, user_id=73a1fc7915e14d6996f668dde44d2def, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:59.780807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad5ade-f661-400d-8d7e-f4cfd6ef2e14 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:59.787394 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 795/1597] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:59.789265 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7790f96-2ca3-4694-9b6a-0ea7d1c2e7f9 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:59.800582 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7790f96-2ca3-4694-9b6a-0ea7d1c2e7f9 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:59.808636 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 803/1598] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:59 2022] PUT /identity/v3/projects/98fc8ad096474c76bc2bdfecf22c3777/users/73a1fc7915e14d6996f668dde44d2def/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:59.818796 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869bb42-bbfd-4cf8-a150-e17fd7aca2e5 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:59.819098 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869bb42-bbfd-4cf8-a150-e17fd7aca2e5 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:59.819444 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869bb42-bbfd-4cf8-a150-e17fd7aca2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:59.823629 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:59.844260 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d869bb42-bbfd-4cf8-a150-e17fd7aca2e5 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:59.845657 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d869bb42-bbfd-4cf8-a150-e17fd7aca2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:59.908323 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c97fb-2e3a-42a8-b704-9d13bc6479a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:59.909289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c97fb-2e3a-42a8-b704-9d13bc6479a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:59.909589 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c97fb-2e3a-42a8-b704-9d13bc6479a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:59.909884 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c97fb-2e3a-42a8-b704-9d13bc6479a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:59.910749 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c97fb-2e3a-42a8-b704-9d13bc6479a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:59.920714 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c97fb-2e3a-42a8-b704-9d13bc6479a1 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:59.939695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 796/1599] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:59.939695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d98791-a66f-4014-b602-fcb91511eae0 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:59.939936 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d98791-a66f-4014-b602-fcb91511eae0 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:59.940766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d98791-a66f-4014-b602-fcb91511eae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:59.973161 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-b5d98791-a66f-4014-b602-fcb91511eae0 None None] MFA Rules not processed for user `73a1fc7915e14d6996f668dde44d2def`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:59.973648 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 804/1600] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:59.974716 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869bb42-bbfd-4cf8-a150-e17fd7aca2e5 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:59.978955 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b5d98791-a66f-4014-b602-fcb91511eae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:59.988423 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869bb42-bbfd-4cf8-a150-e17fd7aca2e5 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:59.998844 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6b7f2-2d1e-4ff2-833d-79aa6494337a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:59.999613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6b7f2-2d1e-4ff2-833d-79aa6494337a admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:59.999959 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6b7f2-2d1e-4ff2-833d-79aa6494337a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:00.000289 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6b7f2-2d1e-4ff2-833d-79aa6494337a admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:00.001187 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6b7f2-2d1e-4ff2-833d-79aa6494337a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:00.003156 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6b7f2-2d1e-4ff2-833d-79aa6494337a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:00.013029 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:00.024637 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 805/1601] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:00.024637 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6b7f2-2d1e-4ff2-833d-79aa6494337a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:00.041347 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6b7f2-2d1e-4ff2-833d-79aa6494337a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:00.046917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b7ca1-c406-4b25-94d3-027da03c40d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:00.047857 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b7ca1-c406-4b25-94d3-027da03c40d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:00.048346 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b7ca1-c406-4b25-94d3-027da03c40d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:00.048811 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b7ca1-c406-4b25-94d3-027da03c40d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:00.049477 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b7ca1-c406-4b25-94d3-027da03c40d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:00.049799 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b7ca1-c406-4b25-94d3-027da03c40d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:00.051484 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b7ca1-c406-4b25-94d3-027da03c40d3 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:00.073020 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 797/1602] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:13:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:00.073961 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d98791-a66f-4014-b602-fcb91511eae0 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:00.077959 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 806/1603] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:14:00.079696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b7ca1-c406-4b25-94d3-027da03c40d3 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:00.093339 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d98791-a66f-4014-b602-fcb91511eae0 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:00.094986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b7ca1-c406-4b25-94d3-027da03c40d3 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:00.103227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f699c5-562a-4560-81fa-00edf3405916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:00.104246 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f699c5-562a-4560-81fa-00edf3405916 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:00.104623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f699c5-562a-4560-81fa-00edf3405916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:00.105036 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f699c5-562a-4560-81fa-00edf3405916 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:00.105713 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0217e34-78c6-47bd-a932-211c244f28bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:00.105840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f699c5-562a-4560-81fa-00edf3405916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:00.106791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0217e34-78c6-47bd-a932-211c244f28bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:00.108028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f699c5-562a-4560-81fa-00edf3405916 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:00.108321 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0217e34-78c6-47bd-a932-211c244f28bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:00.108759 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0217e34-78c6-47bd-a932-211c244f28bd admin admin] PATH_INFO: `/v3/projects/5f6dbffe6de7478882ef937e34eba673/users/b730d37d8ebb470e9525762954cf954e/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:00.132426 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0217e34-78c6-47bd-a932-211c244f28bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f6dbffe6de7478882ef937e34eba673, user_id=b730d37d8ebb470e9525762954cf954e, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:00.137716 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0217e34-78c6-47bd-a932-211c244f28bd admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:00.156626 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 807/1604] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:00 2022] POST /identity/v3/projects => generated 379 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:00.156626 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f699c5-562a-4560-81fa-00edf3405916 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:00.159575 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 798/1605] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:00 2022] PUT /identity/v3/projects/5f6dbffe6de7478882ef937e34eba673/users/b730d37d8ebb470e9525762954cf954e/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:00.167625 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0217e34-78c6-47bd-a932-211c244f28bd admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:00.245685 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f699c5-562a-4560-81fa-00edf3405916 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:00.246707 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0217e34-78c6-47bd-a932-211c244f28bd admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:00.251141 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bb500-fa57-4e0d-b7c8-49eeaf3f5e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:00.252065 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bb500-fa57-4e0d-b7c8-49eeaf3f5e6f admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:00.252351 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bb500-fa57-4e0d-b7c8-49eeaf3f5e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:00.252473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2659cb4-9bbf-476a-8ef9-49fdcdda3a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:00.252625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bb500-fa57-4e0d-b7c8-49eeaf3f5e6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:00.253178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2659cb4-9bbf-476a-8ef9-49fdcdda3a72 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:00.253303 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bb500-fa57-4e0d-b7c8-49eeaf3f5e6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:00.253387 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2659cb4-9bbf-476a-8ef9-49fdcdda3a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:00.253662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2659cb4-9bbf-476a-8ef9-49fdcdda3a72 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:00.254628 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2659cb4-9bbf-476a-8ef9-49fdcdda3a72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:00.255190 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bb500-fa57-4e0d-b7c8-49eeaf3f5e6f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:00.256445 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2659cb4-9bbf-476a-8ef9-49fdcdda3a72 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:00.286433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 799/1606] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:00 2022] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:00.287545 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 808/1607] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:00 2022] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:00.288986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bb500-fa57-4e0d-b7c8-49eeaf3f5e6f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:00.291663 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09617b9-ee91-40d1-acb8-cc18ad815144 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:00.291942 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09617b9-ee91-40d1-acb8-cc18ad815144 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:00.292217 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09617b9-ee91-40d1-acb8-cc18ad815144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:00.314223 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:00.323172 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-f09617b9-ee91-40d1-acb8-cc18ad815144 None None] MFA Rules not processed for user `b730d37d8ebb470e9525762954cf954e`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:00.325371 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f09617b9-ee91-40d1-acb8-cc18ad815144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:00.381537 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bb500-fa57-4e0d-b7c8-49eeaf3f5e6f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:00.388665 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f62db-6a13-4cc0-9454-63bbffa2f5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:00.389363 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f62db-6a13-4cc0-9454-63bbffa2f5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:00.389843 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f62db-6a13-4cc0-9454-63bbffa2f5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:00.390118 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f62db-6a13-4cc0-9454-63bbffa2f5c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:00.391118 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f62db-6a13-4cc0-9454-63bbffa2f5c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:00.393376 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f62db-6a13-4cc0-9454-63bbffa2f5c3 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:00.407484 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 809/1608] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:00.408598 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f62db-6a13-4cc0-9454-63bbffa2f5c3 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:00.417554 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 800/1609] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:00.418277 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09617b9-ee91-40d1-acb8-cc18ad815144 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:00.420987 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f62db-6a13-4cc0-9454-63bbffa2f5c3 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:00.426938 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01507f-c9b7-41ac-ab05-62af0e7fcc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:00.427497 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01507f-c9b7-41ac-ab05-62af0e7fcc22 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:00.427845 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01507f-c9b7-41ac-ab05-62af0e7fcc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:00.428038 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01507f-c9b7-41ac-ab05-62af0e7fcc22 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:00.428667 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01507f-c9b7-41ac-ab05-62af0e7fcc22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:00.430873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09617b9-ee91-40d1-acb8-cc18ad815144 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:00.431038 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01507f-c9b7-41ac-ab05-62af0e7fcc22 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:00.436242 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930760ee-9fd1-4ceb-89b1-4d40a8e16691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:00.436907 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930760ee-9fd1-4ceb-89b1-4d40a8e16691 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:00.437189 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930760ee-9fd1-4ceb-89b1-4d40a8e16691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:00.437464 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930760ee-9fd1-4ceb-89b1-4d40a8e16691 admin admin] PATH_INFO: `/v3/projects/45d469c10480495cb8a4b1068f5f05d3/users/2519a5ecbe0b484daa357bd8577a049e/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:00.454036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930760ee-9fd1-4ceb-89b1-4d40a8e16691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d469c10480495cb8a4b1068f5f05d3, user_id=2519a5ecbe0b484daa357bd8577a049e, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:00.457042 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930760ee-9fd1-4ceb-89b1-4d40a8e16691 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:00.457980 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 810/1610] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:00 2022] POST /identity/v3/users => generated 283 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:00.459037 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01507f-c9b7-41ac-ab05-62af0e7fcc22 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:00.474040 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01507f-c9b7-41ac-ab05-62af0e7fcc22 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:00.478111 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 801/1611] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:00 2022] PUT /identity/v3/projects/45d469c10480495cb8a4b1068f5f05d3/users/2519a5ecbe0b484daa357bd8577a049e/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:00.478723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930760ee-9fd1-4ceb-89b1-4d40a8e16691 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:00.506961 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:00.567731 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561e7d7-edb9-403d-9a8f-60b19c32ef40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:00.568300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930760ee-9fd1-4ceb-89b1-4d40a8e16691 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:00.568412 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561e7d7-edb9-403d-9a8f-60b19c32ef40 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:00.568621 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561e7d7-edb9-403d-9a8f-60b19c32ef40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:00.568894 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561e7d7-edb9-403d-9a8f-60b19c32ef40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:00.569641 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561e7d7-edb9-403d-9a8f-60b19c32ef40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:00.572342 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561e7d7-edb9-403d-9a8f-60b19c32ef40 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:00.575268 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160c34a-e3e1-4f24-ae87-0b665044d595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:00.576004 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160c34a-e3e1-4f24-ae87-0b665044d595 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:00.576389 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160c34a-e3e1-4f24-ae87-0b665044d595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:00.576750 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160c34a-e3e1-4f24-ae87-0b665044d595 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:00.577569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160c34a-e3e1-4f24-ae87-0b665044d595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:00.579303 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160c34a-e3e1-4f24-ae87-0b665044d595 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:00.595018 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 802/1612] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:00.595018 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160c34a-e3e1-4f24-ae87-0b665044d595 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:00.610622 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 811/1613] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:00 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:00.612348 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561e7d7-edb9-403d-9a8f-60b19c32ef40 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:00.615251 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160c34a-e3e1-4f24-ae87-0b665044d595 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:00.740303 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18f39a-9a7a-416c-b474-f5ce1c7cde45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:00.748310 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561e7d7-edb9-403d-9a8f-60b19c32ef40 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:00.748681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18f39a-9a7a-416c-b474-f5ce1c7cde45 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:00.753650 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c15f0-2824-4971-ac93-789fa509d502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:00.753846 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18f39a-9a7a-416c-b474-f5ce1c7cde45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:00.754146 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18f39a-9a7a-416c-b474-f5ce1c7cde45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:00.754274 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c15f0-2824-4971-ac93-789fa509d502 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:00.754559 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c15f0-2824-4971-ac93-789fa509d502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:00.754827 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c15f0-2824-4971-ac93-789fa509d502 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:00.754929 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18f39a-9a7a-416c-b474-f5ce1c7cde45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:00.755506 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c15f0-2824-4971-ac93-789fa509d502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:00.760763 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18f39a-9a7a-416c-b474-f5ce1c7cde45 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:00.777932 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 803/1614] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:00.778920 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18f39a-9a7a-416c-b474-f5ce1c7cde45 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:00.791510 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c15f0-2824-4971-ac93-789fa509d502 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:00.792318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18f39a-9a7a-416c-b474-f5ce1c7cde45 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:00.797443 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b0c01-44ca-4457-9a49-866afde4e222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:00.798250 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b0c01-44ca-4457-9a49-866afde4e222 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:00.798533 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b0c01-44ca-4457-9a49-866afde4e222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:00.798965 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b0c01-44ca-4457-9a49-866afde4e222 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:00.799659 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b0c01-44ca-4457-9a49-866afde4e222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:00.801606 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b0c01-44ca-4457-9a49-866afde4e222 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:00.810236 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 812/1615] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:00.811258 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c15f0-2824-4971-ac93-789fa509d502 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:00.811503 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:00.830487 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c15f0-2824-4971-ac93-789fa509d502 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:00.838250 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 804/1616] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:00 2022] POST /identity/v3/users => generated 296 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:00.839964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b0c01-44ca-4457-9a49-866afde4e222 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:00.843276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2acfc-bbfa-43d3-ad03-1adc8eb35cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:00.844190 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2acfc-bbfa-43d3-ad03-1adc8eb35cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:00.844577 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2acfc-bbfa-43d3-ad03-1adc8eb35cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:00.844952 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2acfc-bbfa-43d3-ad03-1adc8eb35cbe admin admin] PATH_INFO: `/v3/projects/45d469c10480495cb8a4b1068f5f05d3/users/2519a5ecbe0b484daa357bd8577a049e/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:00.847799 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2acfc-bbfa-43d3-ad03-1adc8eb35cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d469c10480495cb8a4b1068f5f05d3, user_id=2519a5ecbe0b484daa357bd8577a049e, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:00.854946 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b0c01-44ca-4457-9a49-866afde4e222 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:00.863353 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bd1c8-6504-4dc6-9a9e-b4a1774f08d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:00.864178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bd1c8-6504-4dc6-9a9e-b4a1774f08d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:00.864612 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bd1c8-6504-4dc6-9a9e-b4a1774f08d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:00.864888 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bd1c8-6504-4dc6-9a9e-b4a1774f08d6 admin admin] PATH_INFO: `/v3/projects/2ea31f6d5d064ade9c73bde3a3cb1eb4/users/02f9f2e877d5445ea24fd69d45218493/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:00.867468 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2acfc-bbfa-43d3-ad03-1adc8eb35cbe admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:00.881435 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bd1c8-6504-4dc6-9a9e-b4a1774f08d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea31f6d5d064ade9c73bde3a3cb1eb4, user_id=02f9f2e877d5445ea24fd69d45218493, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:00.884828 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bd1c8-6504-4dc6-9a9e-b4a1774f08d6 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:00.891647 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 813/1617] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:00 2022] PUT /identity/v3/projects/45d469c10480495cb8a4b1068f5f05d3/users/2519a5ecbe0b484daa357bd8577a049e/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:00.892576 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2acfc-bbfa-43d3-ad03-1adc8eb35cbe admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:00.915464 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 805/1618] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:00 2022] PUT /identity/v3/projects/2ea31f6d5d064ade9c73bde3a3cb1eb4/users/02f9f2e877d5445ea24fd69d45218493/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:00.917404 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675091d-caad-4af6-8eea-61f4f22c204d None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:00.918241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675091d-caad-4af6-8eea-61f4f22c204d None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:00.918655 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675091d-caad-4af6-8eea-61f4f22c204d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:00.956243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-2675091d-caad-4af6-8eea-61f4f22c204d None None] MFA Rules not processed for user `2519a5ecbe0b484daa357bd8577a049e`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:00.961020 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-2675091d-caad-4af6-8eea-61f4f22c204d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:00.986937 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2acfc-bbfa-43d3-ad03-1adc8eb35cbe admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:01.049773 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:01.067068 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 806/1619] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:00 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:01.068463 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bcb2b-f911-4aeb-b0b4-28e636b8091a None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:01.068736 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bab101-515e-4f9a-8f6b-0a62a5f9d7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:01.068880 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bcb2b-f911-4aeb-b0b4-28e636b8091a None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:01.069032 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bcb2b-f911-4aeb-b0b4-28e636b8091a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:01.069525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bab101-515e-4f9a-8f6b-0a62a5f9d7cf admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:01.069869 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bab101-515e-4f9a-8f6b-0a62a5f9d7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:01.070235 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bab101-515e-4f9a-8f6b-0a62a5f9d7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:01.071004 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bab101-515e-4f9a-8f6b-0a62a5f9d7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:01.073361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bab101-515e-4f9a-8f6b-0a62a5f9d7cf admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:01.085925 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 814/1620] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:01.087382 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bab101-515e-4f9a-8f6b-0a62a5f9d7cf admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:01.092851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-07bab101-515e-4f9a-8f6b-0a62a5f9d7cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:01.109194 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bab101-515e-4f9a-8f6b-0a62a5f9d7cf admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:01.110263 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-604bcb2b-f911-4aeb-b0b4-28e636b8091a None None] MFA Rules not processed for user `02f9f2e877d5445ea24fd69d45218493`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:01.111698 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-604bcb2b-f911-4aeb-b0b4-28e636b8091a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:01.115669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e1705-4417-45d1-bc76-bbb2da187217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:01.116316 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e1705-4417-45d1-bc76-bbb2da187217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:01.116602 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e1705-4417-45d1-bc76-bbb2da187217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:01.116879 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e1705-4417-45d1-bc76-bbb2da187217 admin admin] PATH_INFO: `/v3/users/593b2976d256421b9a6d247642339f7b` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:01.118425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e1705-4417-45d1-bc76-bbb2da187217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=593b2976d256421b9a6d247642339f7b)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:01.120561 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e1705-4417-45d1-bc76-bbb2da187217 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:01.178530 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-536e1705-4417-45d1-bc76-bbb2da187217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '593b2976d256421b9a6d247642339f7b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:01.187406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-536e1705-4417-45d1-bc76-bbb2da187217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '593b2976d256421b9a6d247642339f7b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:01.201794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-536e1705-4417-45d1-bc76-bbb2da187217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '593b2976d256421b9a6d247642339f7b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:01.215986 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 807/1621] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:01.216919 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bcb2b-f911-4aeb-b0b4-28e636b8091a None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:01.218418 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-604bcb2b-f911-4aeb-b0b4-28e636b8091a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:01.219907 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-536e1705-4417-45d1-bc76-bbb2da187217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '593b2976d256421b9a6d247642339f7b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:01.221476 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-536e1705-4417-45d1-bc76-bbb2da187217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '593b2976d256421b9a6d247642339f7b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:01.231311 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 815/1622] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:01 2022] DELETE /identity/v3/users/593b2976d256421b9a6d247642339f7b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:01.232334 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e1705-4417-45d1-bc76-bbb2da187217 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:01.233701 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-536e1705-4417-45d1-bc76-bbb2da187217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:01.284417 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:01.305068 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bcb2b-f911-4aeb-b0b4-28e636b8091a None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:01.407899 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e1705-4417-45d1-bc76-bbb2da187217 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:01.424931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bdf98-26a0-446b-b8fa-77e8f36c44db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:01.425647 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bdf98-26a0-446b-b8fa-77e8f36c44db admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:01.427754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bdf98-26a0-446b-b8fa-77e8f36c44db admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:01.428048 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bdf98-26a0-446b-b8fa-77e8f36c44db admin admin] PATH_INFO: `/v3/projects/7781bf2870e847a8af6335e1f6a8cf17/users/0f9bed2953e146dfa54f190a9c4e3c1d/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:01.429539 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63587cf-2ae4-4db3-99e8-89bb28864fbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:01.430348 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63587cf-2ae4-4db3-99e8-89bb28864fbb service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:01.430688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63587cf-2ae4-4db3-99e8-89bb28864fbb service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:01.431004 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63587cf-2ae4-4db3-99e8-89bb28864fbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:01.433555 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b63587cf-2ae4-4db3-99e8-89bb28864fbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:01.474611 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055bdf98-26a0-446b-b8fa-77e8f36c44db admin admin] RBAC: Authorizing `identity:create_grant(project_id=7781bf2870e847a8af6335e1f6a8cf17, user_id=0f9bed2953e146dfa54f190a9c4e3c1d, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:01.491561 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055bdf98-26a0-446b-b8fa-77e8f36c44db admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:01.536500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 816/1623] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:01 2022] PUT /identity/v3/projects/7781bf2870e847a8af6335e1f6a8cf17/users/0f9bed2953e146dfa54f190a9c4e3c1d/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:01.545900 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bdf98-26a0-446b-b8fa-77e8f36c44db admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:01.561868 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-055bdf98-26a0-446b-b8fa-77e8f36c44db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:01.603836 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63587cf-2ae4-4db3-99e8-89bb28864fbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:01.605429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63587cf-2ae4-4db3-99e8-89bb28864fbb service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:01.616158 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 808/1624] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:01.617613 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110a1b6-3d53-467f-9c67-379e5434a532 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:01.618041 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110a1b6-3d53-467f-9c67-379e5434a532 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:01.618324 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110a1b6-3d53-467f-9c67-379e5434a532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:01.658108 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-d110a1b6-3d53-467f-9c67-379e5434a532 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:01.659368 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:01.661890 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d110a1b6-3d53-467f-9c67-379e5434a532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:01.722033 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bdf98-26a0-446b-b8fa-77e8f36c44db admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:01.733487 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0eabb-a916-41df-9f37-2068d08c7b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:01.734203 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0eabb-a916-41df-9f37-2068d08c7b45 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:01.734485 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0eabb-a916-41df-9f37-2068d08c7b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:01.734757 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0eabb-a916-41df-9f37-2068d08c7b45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:01.735441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0eabb-a916-41df-9f37-2068d08c7b45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:01.737380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0eabb-a916-41df-9f37-2068d08c7b45 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:01.793123 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 817/1625] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:01 2022] POST /identity/v3/projects => generated 361 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:01.794266 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0eabb-a916-41df-9f37-2068d08c7b45 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:01.798372 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 809/1626] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:01.799224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110a1b6-3d53-467f-9c67-379e5434a532 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:01.818965 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110a1b6-3d53-467f-9c67-379e5434a532 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:01.927116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:01.934444 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0eabb-a916-41df-9f37-2068d08c7b45 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:01.940584 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9ca15-6814-4aaf-a591-5dc76d1049ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:01.941299 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9ca15-6814-4aaf-a591-5dc76d1049ab admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:01.941661 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9ca15-6814-4aaf-a591-5dc76d1049ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:01.947089 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9ca15-6814-4aaf-a591-5dc76d1049ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:01.947089 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9ca15-6814-4aaf-a591-5dc76d1049ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:01.947089 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9ca15-6814-4aaf-a591-5dc76d1049ab admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:01.958192 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc7b22-d4ae-44f8-b809-1f41789058b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:01.960425 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc7b22-d4ae-44f8-b809-1f41789058b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:01.960716 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc7b22-d4ae-44f8-b809-1f41789058b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:01.961205 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc7b22-d4ae-44f8-b809-1f41789058b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:01.962114 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc7b22-d4ae-44f8-b809-1f41789058b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:01.969790 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc7b22-d4ae-44f8-b809-1f41789058b5 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:01.988297 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 818/1627] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:01.990535 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9ca15-6814-4aaf-a591-5dc76d1049ab admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:01.996262 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4cb9ca15-6814-4aaf-a591-5dc76d1049ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:02.037728 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 810/1628] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:01 2022] POST /identity/v3/users => generated 287 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:02.037728 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc7b22-d4ae-44f8-b809-1f41789058b5 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:02.085516 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc7b22-d4ae-44f8-b809-1f41789058b5 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:02.094526 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8a723-9136-4a69-b5ad-b44316faf441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:02.094526 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8a723-9136-4a69-b5ad-b44316faf441 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:02.095034 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8a723-9136-4a69-b5ad-b44316faf441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:02.095336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8a723-9136-4a69-b5ad-b44316faf441 admin admin] PATH_INFO: `/v3/projects/7781bf2870e847a8af6335e1f6a8cf17/users/0f9bed2953e146dfa54f190a9c4e3c1d/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:02.097984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8a723-9136-4a69-b5ad-b44316faf441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7781bf2870e847a8af6335e1f6a8cf17, user_id=0f9bed2953e146dfa54f190a9c4e3c1d, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:02.101076 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8a723-9136-4a69-b5ad-b44316faf441 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:02.119990 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 811/1629] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:02 2022] PUT /identity/v3/projects/7781bf2870e847a8af6335e1f6a8cf17/users/0f9bed2953e146dfa54f190a9c4e3c1d/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:02.121673 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8a723-9136-4a69-b5ad-b44316faf441 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:02.168136 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9ca15-6814-4aaf-a591-5dc76d1049ab admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:02.212039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8a723-9136-4a69-b5ad-b44316faf441 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:02.218133 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e8bd1-55b9-4a42-8dfe-4634bccfe4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:02.219519 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e8bd1-55b9-4a42-8dfe-4634bccfe4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:02.220028 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e8bd1-55b9-4a42-8dfe-4634bccfe4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:02.220498 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e8bd1-55b9-4a42-8dfe-4634bccfe4f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:02.221652 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e8bd1-55b9-4a42-8dfe-4634bccfe4f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:02.223539 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e8bd1-55b9-4a42-8dfe-4634bccfe4f1 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:02.247243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 812/1630] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:02.250605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cf233-ed1b-442c-9573-6f0968d4b2ae None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:02.251197 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cf233-ed1b-442c-9573-6f0968d4b2ae None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:02.251831 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cf233-ed1b-442c-9573-6f0968d4b2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:02.272703 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b6edc-6cc8-43ed-823c-cc2d70420ad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:02.273543 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b6edc-6cc8-43ed-823c-cc2d70420ad2 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:02.274759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b6edc-6cc8-43ed-823c-cc2d70420ad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:02.275470 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b6edc-6cc8-43ed-823c-cc2d70420ad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:02.297088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b6edc-6cc8-43ed-823c-cc2d70420ad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:02.298826 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b6edc-6cc8-43ed-823c-cc2d70420ad2 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:02.309787 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-fe5cf233-ed1b-442c-9573-6f0968d4b2ae None None] MFA Rules not processed for user `0f9bed2953e146dfa54f190a9c4e3c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:02.311634 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-fe5cf233-ed1b-442c-9573-6f0968d4b2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:02.314045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 819/1631] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:02.315159 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b6edc-6cc8-43ed-823c-cc2d70420ad2 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:02.326989 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b6edc-6cc8-43ed-823c-cc2d70420ad2 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:02.333816 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f14a61-ea4b-4d40-99b4-139e66112fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:02.334740 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f14a61-ea4b-4d40-99b4-139e66112fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:02.335169 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f14a61-ea4b-4d40-99b4-139e66112fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:02.335621 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f14a61-ea4b-4d40-99b4-139e66112fb5 admin admin] PATH_INFO: `/v3/projects/c21cbf7e7a8f42c2b9cc419a1e6a6bb1/users/5a4d334773c44f1883c9e17172e2aabc/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:02.366597 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:02.370484 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f14a61-ea4b-4d40-99b4-139e66112fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c21cbf7e7a8f42c2b9cc419a1e6a6bb1, user_id=5a4d334773c44f1883c9e17172e2aabc, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:02.373665 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f14a61-ea4b-4d40-99b4-139e66112fb5 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:02.401298 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 820/1632] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:02 2022] PUT /identity/v3/projects/c21cbf7e7a8f42c2b9cc419a1e6a6bb1/users/5a4d334773c44f1883c9e17172e2aabc/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:02.405300 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f14a61-ea4b-4d40-99b4-139e66112fb5 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:02.472604 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 813/1633] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:02.493641 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cf233-ed1b-442c-9573-6f0968d4b2ae None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:02.496894 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-fe5cf233-ed1b-442c-9573-6f0968d4b2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:02.500674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f14a61-ea4b-4d40-99b4-139e66112fb5 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:02.507489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d0b71-864b-4b17-b2e3-553ed0e963ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:02.509175 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d0b71-864b-4b17-b2e3-553ed0e963ad admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:02.509765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d0b71-864b-4b17-b2e3-553ed0e963ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:02.510079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d0b71-864b-4b17-b2e3-553ed0e963ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:02.510726 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d0b71-864b-4b17-b2e3-553ed0e963ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:02.512488 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d0b71-864b-4b17-b2e3-553ed0e963ad admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:02.531310 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 821/1634] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:02.542224 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d0b71-864b-4b17-b2e3-553ed0e963ad admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:02.572425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d0b71-864b-4b17-b2e3-553ed0e963ad admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:02.587326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a07ac-74f8-4a93-8541-cdee9bfd4a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:02.588353 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a07ac-74f8-4a93-8541-cdee9bfd4a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:02.588353 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a07ac-74f8-4a93-8541-cdee9bfd4a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:02.588575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a07ac-74f8-4a93-8541-cdee9bfd4a8f admin admin] PATH_INFO: `/v3/projects/c21cbf7e7a8f42c2b9cc419a1e6a6bb1/users/5a4d334773c44f1883c9e17172e2aabc/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:02.593759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a07ac-74f8-4a93-8541-cdee9bfd4a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c21cbf7e7a8f42c2b9cc419a1e6a6bb1, user_id=5a4d334773c44f1883c9e17172e2aabc, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:02.598622 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:02.603659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a07ac-74f8-4a93-8541-cdee9bfd4a8f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:02.615386 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cf233-ed1b-442c-9573-6f0968d4b2ae None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:02.627349 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 822/1635] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:02 2022] PUT /identity/v3/projects/c21cbf7e7a8f42c2b9cc419a1e6a6bb1/users/5a4d334773c44f1883c9e17172e2aabc/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:02.639215 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f6530-d88b-41fa-9e18-66c6d27a26ef None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:02.639531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f6530-d88b-41fa-9e18-66c6d27a26ef None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:02.639814 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f6530-d88b-41fa-9e18-66c6d27a26ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:02.694003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-7e6f6530-d88b-41fa-9e18-66c6d27a26ef None None] MFA Rules not processed for user `5a4d334773c44f1883c9e17172e2aabc`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:02.695271 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7e6f6530-d88b-41fa-9e18-66c6d27a26ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:02.699969 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bb3fd-a294-4ef2-85d8-65cba4f46730 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:02.699969 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bb3fd-a294-4ef2-85d8-65cba4f46730 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:02.699969 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bb3fd-a294-4ef2-85d8-65cba4f46730 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:02.699969 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bb3fd-a294-4ef2-85d8-65cba4f46730 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:02.789979 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42bb3fd-a294-4ef2-85d8-65cba4f46730 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:02.791994 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42bb3fd-a294-4ef2-85d8-65cba4f46730 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:02.814241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 814/1636] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:02 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:02.827548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bb3fd-a294-4ef2-85d8-65cba4f46730 service cinder] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:02.829661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d42bb3fd-a294-4ef2-85d8-65cba4f46730 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:02.849256 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 823/1637] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:02 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:14:02.864818 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f6530-d88b-41fa-9e18-66c6d27a26ef None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:02.889040 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f6530-d88b-41fa-9e18-66c6d27a26ef None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:02.896890 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc0b51-1916-4be9-bc1d-5f77aa988501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:02.897575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc0b51-1916-4be9-bc1d-5f77aa988501 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:02.898382 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc0b51-1916-4be9-bc1d-5f77aa988501 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:02.898929 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc0b51-1916-4be9-bc1d-5f77aa988501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:02.916148 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc0b51-1916-4be9-bc1d-5f77aa988501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:02.917963 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc0b51-1916-4be9-bc1d-5f77aa988501 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:02.932236 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 824/1638] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:02 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:14:02.953422 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bb3fd-a294-4ef2-85d8-65cba4f46730 service cinder] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:02.961733 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1be96-e546-41c9-b732-9f51eb9aae49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:02.962065 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1be96-e546-41c9-b732-9f51eb9aae49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:02.962344 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1be96-e546-41c9-b732-9f51eb9aae49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:02.962618 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1be96-e546-41c9-b732-9f51eb9aae49 admin admin] PATH_INFO: `/v3/users/73a1fc7915e14d6996f668dde44d2def` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:02.963916 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1be96-e546-41c9-b732-9f51eb9aae49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73a1fc7915e14d6996f668dde44d2def)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:02.966028 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1be96-e546-41c9-b732-9f51eb9aae49 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:02.991595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc0b51-1916-4be9-bc1d-5f77aa988501 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:03.004592 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc0b51-1916-4be9-bc1d-5f77aa988501 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:03.009757 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61fc21a-c643-43e6-9d4a-471fb22fa520 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:03.010219 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fc21a-c643-43e6-9d4a-471fb22fa520 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:03.010453 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fc21a-c643-43e6-9d4a-471fb22fa520 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:03.010740 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fc21a-c643-43e6-9d4a-471fb22fa520 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:03.012555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d61fc21a-c643-43e6-9d4a-471fb22fa520 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:03.075547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2ca1be96-e546-41c9-b732-9f51eb9aae49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73a1fc7915e14d6996f668dde44d2def'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:03.077827 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:03.080937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:03.086175 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2ca1be96-e546-41c9-b732-9f51eb9aae49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73a1fc7915e14d6996f668dde44d2def'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:03.094974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61fc21a-c643-43e6-9d4a-471fb22fa520 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:03.095257 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2ca1be96-e546-41c9-b732-9f51eb9aae49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73a1fc7915e14d6996f668dde44d2def'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:03.096610 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61fc21a-c643-43e6-9d4a-471fb22fa520 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:03.106376 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 825/1639] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:14:03.108305 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2ca1be96-e546-41c9-b732-9f51eb9aae49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73a1fc7915e14d6996f668dde44d2def'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:03.108448 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61fc21a-c643-43e6-9d4a-471fb22fa520 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:03.108969 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2ca1be96-e546-41c9-b732-9f51eb9aae49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73a1fc7915e14d6996f668dde44d2def'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:03.109723 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d61fc21a-c643-43e6-9d4a-471fb22fa520 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:03.115266 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 815/1640] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:02 2022] DELETE /identity/v3/users/73a1fc7915e14d6996f668dde44d2def => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:03.116144 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1be96-e546-41c9-b732-9f51eb9aae49 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:03.121276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-2ca1be96-e546-41c9-b732-9f51eb9aae49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:03.126759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61fc21a-c643-43e6-9d4a-471fb22fa520 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:03.186131 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1be96-e546-41c9-b732-9f51eb9aae49 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:03.189952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dac82d-8f36-4c29-8271-d69268315a23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:03.190559 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dac82d-8f36-4c29-8271-d69268315a23 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:03.190835 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dac82d-8f36-4c29-8271-d69268315a23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:03.191101 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dac82d-8f36-4c29-8271-d69268315a23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:03.193207 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-23dac82d-8f36-4c29-8271-d69268315a23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:03.195376 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09ea42-55e5-45ca-bb4d-f6835e1e1447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:03.196712 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09ea42-55e5-45ca-bb4d-f6835e1e1447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:03.197105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09ea42-55e5-45ca-bb4d-f6835e1e1447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:03.197379 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09ea42-55e5-45ca-bb4d-f6835e1e1447 admin admin] PATH_INFO: `/v3/projects/22acbcf2cd23473488797e11e8b7357d` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:03.198497 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09ea42-55e5-45ca-bb4d-f6835e1e1447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22acbcf2cd23473488797e11e8b7357d)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:03.200868 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09ea42-55e5-45ca-bb4d-f6835e1e1447 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:03.261998 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9a09ea42-55e5-45ca-bb4d-f6835e1e1447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22acbcf2cd23473488797e11e8b7357d', 'request_id': 'req-9a09ea42-55e5-45ca-bb4d-f6835e1e1447'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:03.264422 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dac82d-8f36-4c29-8271-d69268315a23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:03.265869 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dac82d-8f36-4c29-8271-d69268315a23 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:03.271258 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9a09ea42-55e5-45ca-bb4d-f6835e1e1447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22acbcf2cd23473488797e11e8b7357d', 'request_id': 'req-9a09ea42-55e5-45ca-bb4d-f6835e1e1447'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:03.276828 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 816/1641] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:03.277983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c38d2-3d7f-4262-9c69-bfb5608ad8d4 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:03.278396 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c38d2-3d7f-4262-9c69-bfb5608ad8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:03.278798 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c38d2-3d7f-4262-9c69-bfb5608ad8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:03.280088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9a09ea42-55e5-45ca-bb4d-f6835e1e1447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22acbcf2cd23473488797e11e8b7357d', 'request_id': 'req-9a09ea42-55e5-45ca-bb4d-f6835e1e1447'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:03.294453 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9a09ea42-55e5-45ca-bb4d-f6835e1e1447 admin admin] The token cache is being invalidate because project 22acbcf2cd23473488797e11e8b7357d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:03.295347 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9a09ea42-55e5-45ca-bb4d-f6835e1e1447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:03.296051 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9a09ea42-55e5-45ca-bb4d-f6835e1e1447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:03.301294 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 826/1642] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:03 2022] DELETE /identity/v3/projects/22acbcf2cd23473488797e11e8b7357d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:03.302988 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84fcef-1331-4f78-bba5-1fca6dc08316 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:03.303209 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-4d2c38d2-3d7f-4262-9c69-bfb5608ad8d4 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:03.303331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84fcef-1331-4f78-bba5-1fca6dc08316 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:03.303568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84fcef-1331-4f78-bba5-1fca6dc08316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:03.304859 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-4d2c38d2-3d7f-4262-9c69-bfb5608ad8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:03.329816 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-9f84fcef-1331-4f78-bba5-1fca6dc08316 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:03.331079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9f84fcef-1331-4f78-bba5-1fca6dc08316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:03.401469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 817/1643] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:03.410816 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 827/1644] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:03.412122 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c38d2-3d7f-4262-9c69-bfb5608ad8d4 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:03.414242 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-4d2c38d2-3d7f-4262-9c69-bfb5608ad8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:03.419123 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7e4e2-8817-4e51-a8c7-78cb37a34238 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:03.420178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7e4e2-8817-4e51-a8c7-78cb37a34238 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:03.420526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7e4e2-8817-4e51-a8c7-78cb37a34238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:03.448970 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-edd7e4e2-8817-4e51-a8c7-78cb37a34238 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:03.455346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:03.463154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-edd7e4e2-8817-4e51-a8c7-78cb37a34238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:03.485856 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 828/1645] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:03.489664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7e4e2-8817-4e51-a8c7-78cb37a34238 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:03.509776 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7e4e2-8817-4e51-a8c7-78cb37a34238 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:03.525007 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18542159-5d88-4f67-b4a9-70b63d32affa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:03.525644 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18542159-5d88-4f67-b4a9-70b63d32affa admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:03.525927 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18542159-5d88-4f67-b4a9-70b63d32affa admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:03.526200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18542159-5d88-4f67-b4a9-70b63d32affa admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:03.526857 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18542159-5d88-4f67-b4a9-70b63d32affa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:03.527852 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18542159-5d88-4f67-b4a9-70b63d32affa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:03.531409 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18542159-5d88-4f67-b4a9-70b63d32affa admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:03.543174 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:03.554506 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c38d2-3d7f-4262-9c69-bfb5608ad8d4 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:03.559739 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 829/1646] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:14:03.564346 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18542159-5d88-4f67-b4a9-70b63d32affa admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:03.569714 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be14c7f-f189-4708-8abb-4f0c6971f816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:03.570376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be14c7f-f189-4708-8abb-4f0c6971f816 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:03.570714 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be14c7f-f189-4708-8abb-4f0c6971f816 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:03.570994 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be14c7f-f189-4708-8abb-4f0c6971f816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:03.587689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be14c7f-f189-4708-8abb-4f0c6971f816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:03.589751 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18542159-5d88-4f67-b4a9-70b63d32affa admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:03.590171 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be14c7f-f189-4708-8abb-4f0c6971f816 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:03.604079 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 818/1647] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:14:03.611057 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814bba8-11dc-49e6-95c1-d0ea87f98c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:03.611868 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814bba8-11dc-49e6-95c1-d0ea87f98c17 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:03.612149 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814bba8-11dc-49e6-95c1-d0ea87f98c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:03.612472 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814bba8-11dc-49e6-95c1-d0ea87f98c17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:03.613235 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814bba8-11dc-49e6-95c1-d0ea87f98c17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:03.615392 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814bba8-11dc-49e6-95c1-d0ea87f98c17 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:03.675462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 830/1648] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:03 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:03.677494 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be14c7f-f189-4708-8abb-4f0c6971f816 service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:03.689289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be14c7f-f189-4708-8abb-4f0c6971f816 service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:03.786271 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb03dd-4300-4d76-9da7-3d6c840ea494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:03.786881 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb03dd-4300-4d76-9da7-3d6c840ea494 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:03.787218 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb03dd-4300-4d76-9da7-3d6c840ea494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:03.787515 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb03dd-4300-4d76-9da7-3d6c840ea494 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:03.788172 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb03dd-4300-4d76-9da7-3d6c840ea494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:03.790945 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb03dd-4300-4d76-9da7-3d6c840ea494 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:03.817082 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 819/1649] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:03 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:03.818284 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814bba8-11dc-49e6-95c1-d0ea87f98c17 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:03.829039 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814bba8-11dc-49e6-95c1-d0ea87f98c17 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:03.834226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672cd61-7980-4626-8901-93c8bed08747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:03.834825 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672cd61-7980-4626-8901-93c8bed08747 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:03.835105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672cd61-7980-4626-8901-93c8bed08747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:03.835375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672cd61-7980-4626-8901-93c8bed08747 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:03.836048 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672cd61-7980-4626-8901-93c8bed08747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:03.837982 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672cd61-7980-4626-8901-93c8bed08747 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:03.848414 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 831/1650] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:14:03.854850 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb03dd-4300-4d76-9da7-3d6c840ea494 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:03.864953 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb03dd-4300-4d76-9da7-3d6c840ea494 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:03.870702 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348066c9-b5c8-4423-8faa-947a6e569954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:03.871312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348066c9-b5c8-4423-8faa-947a6e569954 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:03.871762 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348066c9-b5c8-4423-8faa-947a6e569954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:03.872037 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348066c9-b5c8-4423-8faa-947a6e569954 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:03.873076 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348066c9-b5c8-4423-8faa-947a6e569954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:03.874451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348066c9-b5c8-4423-8faa-947a6e569954 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:03.889684 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 820/1651] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:03.891114 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672cd61-7980-4626-8901-93c8bed08747 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:03.902326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672cd61-7980-4626-8901-93c8bed08747 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:03.907021 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3e10e-ef17-4a2c-acbe-8532b44c470b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:03.907712 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3e10e-ef17-4a2c-acbe-8532b44c470b admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:03.907986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3e10e-ef17-4a2c-acbe-8532b44c470b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:03.908262 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3e10e-ef17-4a2c-acbe-8532b44c470b admin admin] PATH_INFO: `/v3/projects/0a077ef759f34b3f9bd19d1264448c59/users/88773edcba8a4de3bcfc25d934a04995/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:03.923680 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3e10e-ef17-4a2c-acbe-8532b44c470b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a077ef759f34b3f9bd19d1264448c59, user_id=88773edcba8a4de3bcfc25d934a04995, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:03.926419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3e10e-ef17-4a2c-acbe-8532b44c470b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:03.942906 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 832/1652] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:03 2022] PUT /identity/v3/projects/0a077ef759f34b3f9bd19d1264448c59/users/88773edcba8a4de3bcfc25d934a04995/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:03.954429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe615361-4545-4b85-bda1-b6eb7dfb9ee3 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:03.954956 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe615361-4545-4b85-bda1-b6eb7dfb9ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:03.954956 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe615361-4545-4b85-bda1-b6eb7dfb9ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:03.991010 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-fe615361-4545-4b85-bda1-b6eb7dfb9ee3 None None] MFA Rules not processed for user `88773edcba8a4de3bcfc25d934a04995`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:03.999974 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-fe615361-4545-4b85-bda1-b6eb7dfb9ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:04.075403 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3e10e-ef17-4a2c-acbe-8532b44c470b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:04.077370 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-69f3e10e-ef17-4a2c-acbe-8532b44c470b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:04.103227 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 821/1653] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:04.114467 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe615361-4545-4b85-bda1-b6eb7dfb9ee3 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:04.115960 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-fe615361-4545-4b85-bda1-b6eb7dfb9ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:04.149960 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3e10e-ef17-4a2c-acbe-8532b44c470b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:04.154795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ed898-a980-429d-b9ae-3b253e3d4e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:04.155490 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ed898-a980-429d-b9ae-3b253e3d4e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:04.155605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:04.155774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ed898-a980-429d-b9ae-3b253e3d4e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:04.156048 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ed898-a980-429d-b9ae-3b253e3d4e5f admin admin] PATH_INFO: `/v3/projects/98fc8ad096474c76bc2bdfecf22c3777` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:04.157400 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ed898-a980-429d-b9ae-3b253e3d4e5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=98fc8ad096474c76bc2bdfecf22c3777)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:04.159412 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ed898-a980-429d-b9ae-3b253e3d4e5f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:04.173898 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe615361-4545-4b85-bda1-b6eb7dfb9ee3 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:04.177920 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cfeb5-6926-4f36-bfb1-94aa034ceedf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:04.178590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cfeb5-6926-4f36-bfb1-94aa034ceedf service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:04.178934 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cfeb5-6926-4f36-bfb1-94aa034ceedf service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:04.179266 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cfeb5-6926-4f36-bfb1-94aa034ceedf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:04.188260 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8cfeb5-6926-4f36-bfb1-94aa034ceedf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:04.189785 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8cfeb5-6926-4f36-bfb1-94aa034ceedf service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:04.199077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 822/1654] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:14:04.211763 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-4f0ed898-a980-429d-b9ae-3b253e3d4e5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98fc8ad096474c76bc2bdfecf22c3777', 'request_id': 'req-4f0ed898-a980-429d-b9ae-3b253e3d4e5f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:04.220759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-4f0ed898-a980-429d-b9ae-3b253e3d4e5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98fc8ad096474c76bc2bdfecf22c3777', 'request_id': 'req-4f0ed898-a980-429d-b9ae-3b253e3d4e5f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:04.227450 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-4f0ed898-a980-429d-b9ae-3b253e3d4e5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98fc8ad096474c76bc2bdfecf22c3777', 'request_id': 'req-4f0ed898-a980-429d-b9ae-3b253e3d4e5f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:04.239359 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-4f0ed898-a980-429d-b9ae-3b253e3d4e5f admin admin] The token cache is being invalidate because project 98fc8ad096474c76bc2bdfecf22c3777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:04.239697 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-4f0ed898-a980-429d-b9ae-3b253e3d4e5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:04.240356 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-4f0ed898-a980-429d-b9ae-3b253e3d4e5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:04.241856 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 833/1655] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:04 2022] DELETE /identity/v3/projects/98fc8ad096474c76bc2bdfecf22c3777 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:04.246016 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cfeb5-6926-4f36-bfb1-94aa034ceedf service cinder] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:04.260029 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cfeb5-6926-4f36-bfb1-94aa034ceedf service cinder] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:04.321978 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963fcf16-96ad-4264-b662-1ceac0a6e1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:04.322557 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fcf16-96ad-4264-b662-1ceac0a6e1af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:04.322833 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fcf16-96ad-4264-b662-1ceac0a6e1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:04.323103 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fcf16-96ad-4264-b662-1ceac0a6e1af admin admin] PATH_INFO: `/v3/users/2519a5ecbe0b484daa357bd8577a049e` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:04.324312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963fcf16-96ad-4264-b662-1ceac0a6e1af admin admin] RBAC: Authorizing `identity:delete_user(user_id=2519a5ecbe0b484daa357bd8577a049e)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:04.326265 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963fcf16-96ad-4264-b662-1ceac0a6e1af admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:04.373318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-963fcf16-96ad-4264-b662-1ceac0a6e1af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2519a5ecbe0b484daa357bd8577a049e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:04.380390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-963fcf16-96ad-4264-b662-1ceac0a6e1af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2519a5ecbe0b484daa357bd8577a049e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:04.388124 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-963fcf16-96ad-4264-b662-1ceac0a6e1af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2519a5ecbe0b484daa357bd8577a049e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:04.401313 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-963fcf16-96ad-4264-b662-1ceac0a6e1af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2519a5ecbe0b484daa357bd8577a049e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:04.402076 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-963fcf16-96ad-4264-b662-1ceac0a6e1af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2519a5ecbe0b484daa357bd8577a049e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:04.408918 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 823/1656] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:04 2022] DELETE /identity/v3/users/2519a5ecbe0b484daa357bd8577a049e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:05.167069 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ed898-a980-429d-b9ae-3b253e3d4e5f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:05.169509 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4f0ed898-a980-429d-b9ae-3b253e3d4e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:05.189797 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ed898-a980-429d-b9ae-3b253e3d4e5f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:05.249735 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:05.304602 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10a1f4-af16-4322-9acc-d3dfe80ce568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:05.306340 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10a1f4-af16-4322-9acc-d3dfe80ce568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:05.306717 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10a1f4-af16-4322-9acc-d3dfe80ce568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:05.307126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10a1f4-af16-4322-9acc-d3dfe80ce568 admin admin] PATH_INFO: `/v3/projects/45d469c10480495cb8a4b1068f5f05d3` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:05.308519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10a1f4-af16-4322-9acc-d3dfe80ce568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d469c10480495cb8a4b1068f5f05d3)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:05.311779 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10a1f4-af16-4322-9acc-d3dfe80ce568 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:05.396130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0b10a1f4-af16-4322-9acc-d3dfe80ce568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d469c10480495cb8a4b1068f5f05d3', 'request_id': 'req-0b10a1f4-af16-4322-9acc-d3dfe80ce568'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:05.408619 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0b10a1f4-af16-4322-9acc-d3dfe80ce568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d469c10480495cb8a4b1068f5f05d3', 'request_id': 'req-0b10a1f4-af16-4322-9acc-d3dfe80ce568'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:05.422539 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0b10a1f4-af16-4322-9acc-d3dfe80ce568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d469c10480495cb8a4b1068f5f05d3', 'request_id': 'req-0b10a1f4-af16-4322-9acc-d3dfe80ce568'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:05.435231 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0b10a1f4-af16-4322-9acc-d3dfe80ce568 admin admin] The token cache is being invalidate because project 45d469c10480495cb8a4b1068f5f05d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:05.441498 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0b10a1f4-af16-4322-9acc-d3dfe80ce568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:05.442013 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0b10a1f4-af16-4322-9acc-d3dfe80ce568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:05.444384 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 834/1657] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:05 2022] DELETE /identity/v3/projects/45d469c10480495cb8a4b1068f5f05d3 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:05.449472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3ac6c-2a31-45be-8adb-60ced45d7eff None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:05.449977 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3ac6c-2a31-45be-8adb-60ced45d7eff None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:05.450081 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3ac6c-2a31-45be-8adb-60ced45d7eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:05.474799 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-44f3ac6c-2a31-45be-8adb-60ced45d7eff None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:05.476267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-44f3ac6c-2a31-45be-8adb-60ced45d7eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:05.568605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:05.587374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 824/1658] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:05.595171 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae18aff-cd4d-470e-b29c-67298107408a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:05.595535 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae18aff-cd4d-470e-b29c-67298107408a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:05.595811 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae18aff-cd4d-470e-b29c-67298107408a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:05.626488 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-4ae18aff-cd4d-470e-b29c-67298107408a None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:05.627625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4ae18aff-cd4d-470e-b29c-67298107408a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:05.639626 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 835/1659] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:05.642317 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3ac6c-2a31-45be-8adb-60ced45d7eff None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:05.656757 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3ac6c-2a31-45be-8adb-60ced45d7eff None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:05.661623 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecf4e8-9c98-4bed-958e-9d3fb9f133f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:05.662225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecf4e8-9c98-4bed-958e-9d3fb9f133f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:05.662499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecf4e8-9c98-4bed-958e-9d3fb9f133f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:05.662769 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecf4e8-9c98-4bed-958e-9d3fb9f133f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:05.663409 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ecf4e8-9c98-4bed-958e-9d3fb9f133f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:05.663730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ecf4e8-9c98-4bed-958e-9d3fb9f133f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:05.671122 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ecf4e8-9c98-4bed-958e-9d3fb9f133f8 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:05.686695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 825/1660] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:14:05.691463 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae18aff-cd4d-470e-b29c-67298107408a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:05.701281 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae18aff-cd4d-470e-b29c-67298107408a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:05.707000 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a00f6-4ddb-4cf9-bd3d-dd7fde20db34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:05.708073 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a00f6-4ddb-4cf9-bd3d-dd7fde20db34 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:05.708596 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a00f6-4ddb-4cf9-bd3d-dd7fde20db34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:05.708596 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a00f6-4ddb-4cf9-bd3d-dd7fde20db34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:05.709243 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a00f6-4ddb-4cf9-bd3d-dd7fde20db34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:05.711713 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a00f6-4ddb-4cf9-bd3d-dd7fde20db34 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:05.761975 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 836/1661] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:05 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:05.765939 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecf4e8-9c98-4bed-958e-9d3fb9f133f8 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:05.778994 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecf4e8-9c98-4bed-958e-9d3fb9f133f8 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:05.842689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191e074-66b8-4f5d-b8c4-8b29f28b82e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:05.843213 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191e074-66b8-4f5d-b8c4-8b29f28b82e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:05.843509 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191e074-66b8-4f5d-b8c4-8b29f28b82e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:05.843777 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191e074-66b8-4f5d-b8c4-8b29f28b82e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:05.844399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191e074-66b8-4f5d-b8c4-8b29f28b82e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:05.846309 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191e074-66b8-4f5d-b8c4-8b29f28b82e1 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:05.871940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 826/1662] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:05 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:05.877086 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a00f6-4ddb-4cf9-bd3d-dd7fde20db34 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:05.893281 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a00f6-4ddb-4cf9-bd3d-dd7fde20db34 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:05.900073 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ead46d-7ad5-4585-8af7-ca3f9b7bb899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:05.900699 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ead46d-7ad5-4585-8af7-ca3f9b7bb899 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:05.901026 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ead46d-7ad5-4585-8af7-ca3f9b7bb899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:05.901305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ead46d-7ad5-4585-8af7-ca3f9b7bb899 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:05.902555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ead46d-7ad5-4585-8af7-ca3f9b7bb899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:05.904129 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ead46d-7ad5-4585-8af7-ca3f9b7bb899 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:05.916027 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 837/1663] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:05.920446 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191e074-66b8-4f5d-b8c4-8b29f28b82e1 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:05.931330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191e074-66b8-4f5d-b8c4-8b29f28b82e1 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:05.936685 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71796e6c-2ddd-43a4-8289-183114aa7c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:05.937290 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71796e6c-2ddd-43a4-8289-183114aa7c2d admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:05.937566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71796e6c-2ddd-43a4-8289-183114aa7c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:05.937834 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71796e6c-2ddd-43a4-8289-183114aa7c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:05.938463 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71796e6c-2ddd-43a4-8289-183114aa7c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:05.940124 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71796e6c-2ddd-43a4-8289-183114aa7c2d admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:05.951531 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 827/1664] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:14:05.960525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ead46d-7ad5-4585-8af7-ca3f9b7bb899 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:05.972953 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ead46d-7ad5-4585-8af7-ca3f9b7bb899 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:05.978448 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c37a6-d9f5-45ea-b138-c555e94bc964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:05.979105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c37a6-d9f5-45ea-b138-c555e94bc964 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:05.979531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c37a6-d9f5-45ea-b138-c555e94bc964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:05.979809 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c37a6-d9f5-45ea-b138-c555e94bc964 admin admin] PATH_INFO: `/v3/projects/30e283d079fb4dfbbe69d2ae92bc9f89/users/9450a9c2e6d845f1a5dff3aba0ecb3e6/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:05.995947 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c37a6-d9f5-45ea-b138-c555e94bc964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e283d079fb4dfbbe69d2ae92bc9f89, user_id=9450a9c2e6d845f1a5dff3aba0ecb3e6, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:05.998795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c37a6-d9f5-45ea-b138-c555e94bc964 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:06.023531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 838/1665] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:05 2022] PUT /identity/v3/projects/30e283d079fb4dfbbe69d2ae92bc9f89/users/9450a9c2e6d845f1a5dff3aba0ecb3e6/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:06.024117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704afab-9e69-434c-994c-bdbc480f1527 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:06.024391 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704afab-9e69-434c-994c-bdbc480f1527 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:06.024845 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704afab-9e69-434c-994c-bdbc480f1527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:06.057194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-f704afab-9e69-434c-994c-bdbc480f1527 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:06.058455 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f704afab-9e69-434c-994c-bdbc480f1527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:06.159668 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 828/1666] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:06.168454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c37a6-d9f5-45ea-b138-c555e94bc964 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:06.170202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-285c37a6-d9f5-45ea-b138-c555e94bc964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:06.237072 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c37a6-d9f5-45ea-b138-c555e94bc964 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:06.240948 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40a18c-0c75-4fbc-af1a-08cbec628fec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:06.241692 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40a18c-0c75-4fbc-af1a-08cbec628fec service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:06.242408 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40a18c-0c75-4fbc-af1a-08cbec628fec service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:06.242408 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40a18c-0c75-4fbc-af1a-08cbec628fec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:06.252853 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40a18c-0c75-4fbc-af1a-08cbec628fec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:06.254310 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40a18c-0c75-4fbc-af1a-08cbec628fec service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:06.258747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:06.269480 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 839/1667] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:06.653334 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704afab-9e69-434c-994c-bdbc480f1527 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:06.654908 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f704afab-9e69-434c-994c-bdbc480f1527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:06.667361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40a18c-0c75-4fbc-af1a-08cbec628fec service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:06.668888 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704afab-9e69-434c-994c-bdbc480f1527 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:06.669001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ef40a18c-0c75-4fbc-af1a-08cbec628fec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:06.674245 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87573c-fa71-4256-9f6a-50cf6acbd058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:06.675047 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87573c-fa71-4256-9f6a-50cf6acbd058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:06.675328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87573c-fa71-4256-9f6a-50cf6acbd058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:06.675636 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87573c-fa71-4256-9f6a-50cf6acbd058 admin admin] PATH_INFO: `/v3/users/02f9f2e877d5445ea24fd69d45218493` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:06.677794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87573c-fa71-4256-9f6a-50cf6acbd058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f9f2e877d5445ea24fd69d45218493)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:06.683899 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87573c-fa71-4256-9f6a-50cf6acbd058 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:06.686880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40a18c-0c75-4fbc-af1a-08cbec628fec service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:06.694247 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a45b77-7c81-461b-bf59-2f355d9d79ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:06.695094 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a45b77-7c81-461b-bf59-2f355d9d79ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:06.696114 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a45b77-7c81-461b-bf59-2f355d9d79ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:06.696539 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a45b77-7c81-461b-bf59-2f355d9d79ee admin admin] PATH_INFO: `/v3/users/e3a2fe8a774846dba0997047594a7368` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:06.697880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a45b77-7c81-461b-bf59-2f355d9d79ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a2fe8a774846dba0997047594a7368)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:06.700396 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a45b77-7c81-461b-bf59-2f355d9d79ee admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:06.761747 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-de87573c-fa71-4256-9f6a-50cf6acbd058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f9f2e877d5445ea24fd69d45218493'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:06.777989 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-de87573c-fa71-4256-9f6a-50cf6acbd058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f9f2e877d5445ea24fd69d45218493'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:06.779817 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-94a45b77-7c81-461b-bf59-2f355d9d79ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a2fe8a774846dba0997047594a7368'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:06.781444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:06.790808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-94a45b77-7c81-461b-bf59-2f355d9d79ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a2fe8a774846dba0997047594a7368'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:06.805928 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-de87573c-fa71-4256-9f6a-50cf6acbd058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f9f2e877d5445ea24fd69d45218493'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:06.815682 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-94a45b77-7c81-461b-bf59-2f355d9d79ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a2fe8a774846dba0997047594a7368'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:06.832984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-de87573c-fa71-4256-9f6a-50cf6acbd058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f9f2e877d5445ea24fd69d45218493'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:06.833694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-de87573c-fa71-4256-9f6a-50cf6acbd058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f9f2e877d5445ea24fd69d45218493'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:06.839973 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-94a45b77-7c81-461b-bf59-2f355d9d79ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a2fe8a774846dba0997047594a7368'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:06.840732 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-94a45b77-7c81-461b-bf59-2f355d9d79ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a2fe8a774846dba0997047594a7368'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:06.842202 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 829/1668] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:06 2022] DELETE /identity/v3/users/02f9f2e877d5445ea24fd69d45218493 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:06.847345 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161270b-d75f-4a27-82bf-2cbc577a08a9 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:06.847835 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161270b-d75f-4a27-82bf-2cbc577a08a9 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:06.848295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 840/1669] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:06 2022] DELETE /identity/v3/users/e3a2fe8a774846dba0997047594a7368 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:06.848422 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161270b-d75f-4a27-82bf-2cbc577a08a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:06.852651 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d4abf-5bd6-4941-978a-662e0e93dae3 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:06.852936 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d4abf-5bd6-4941-978a-662e0e93dae3 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:06.853210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d4abf-5bd6-4941-978a-662e0e93dae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:06.883710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-f161270b-d75f-4a27-82bf-2cbc577a08a9 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:06.889559 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f161270b-d75f-4a27-82bf-2cbc577a08a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:06.899682 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d43d4abf-5bd6-4941-978a-662e0e93dae3 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:06.901464 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d43d4abf-5bd6-4941-978a-662e0e93dae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:07.029332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 830/1670] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:14:07.039861 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161270b-d75f-4a27-82bf-2cbc577a08a9 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:07.041841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 841/1671] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:14:07.044952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f161270b-d75f-4a27-82bf-2cbc577a08a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:07.052473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d4abf-5bd6-4941-978a-662e0e93dae3 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:07.053977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d43d4abf-5bd6-4941-978a-662e0e93dae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:07.121793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161270b-d75f-4a27-82bf-2cbc577a08a9 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:07.126423 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f7335-de7f-4d7a-8f42-bf3ec355bf73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:07.127215 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f7335-de7f-4d7a-8f42-bf3ec355bf73 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:07.127897 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f7335-de7f-4d7a-8f42-bf3ec355bf73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:07.128544 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f7335-de7f-4d7a-8f42-bf3ec355bf73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:07.148068 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f7335-de7f-4d7a-8f42-bf3ec355bf73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:07.150006 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f7335-de7f-4d7a-8f42-bf3ec355bf73 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:07.171403 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 831/1672] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:07.194203 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d4abf-5bd6-4941-978a-662e0e93dae3 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:07.205802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0069e7f-9a99-4b31-b403-1fe2e2a19477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:07.206553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0069e7f-9a99-4b31-b403-1fe2e2a19477 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:07.206739 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0069e7f-9a99-4b31-b403-1fe2e2a19477 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:07.207905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0069e7f-9a99-4b31-b403-1fe2e2a19477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:07.237737 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0069e7f-9a99-4b31-b403-1fe2e2a19477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:07.239368 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0069e7f-9a99-4b31-b403-1fe2e2a19477 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:07.299390 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 842/1673] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:14:07.309790 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe97217-17c1-432d-80cf-f9f67798e747 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:07.310083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe97217-17c1-432d-80cf-f9f67798e747 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:07.310358 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe97217-17c1-432d-80cf-f9f67798e747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:07.375402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-fbe97217-17c1-432d-80cf-f9f67798e747 None None] MFA Rules not processed for user `9450a9c2e6d845f1a5dff3aba0ecb3e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:07.376232 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-fbe97217-17c1-432d-80cf-f9f67798e747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:07.531078 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 832/1674] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:14:07.532384 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0069e7f-9a99-4b31-b403-1fe2e2a19477 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:07.533884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d0069e7f-9a99-4b31-b403-1fe2e2a19477 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:07.569769 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0069e7f-9a99-4b31-b403-1fe2e2a19477 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:07.585533 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7b7ba-795c-4a52-99fe-7627ed4e482f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:07.586445 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7b7ba-795c-4a52-99fe-7627ed4e482f admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:07.586740 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7b7ba-795c-4a52-99fe-7627ed4e482f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:07.587036 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7b7ba-795c-4a52-99fe-7627ed4e482f admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:07.587740 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7b7ba-795c-4a52-99fe-7627ed4e482f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:07.590753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7b7ba-795c-4a52-99fe-7627ed4e482f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:07.612324 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:07.645360 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 843/1675] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:07 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:07.651265 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe97217-17c1-432d-80cf-f9f67798e747 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:07.665999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe97217-17c1-432d-80cf-f9f67798e747 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:07.678153 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:07.824640 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473415e1-f8ff-433a-ba42-7f10326d7665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:07.826081 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473415e1-f8ff-433a-ba42-7f10326d7665 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:07.827086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473415e1-f8ff-433a-ba42-7f10326d7665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:07.828485 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473415e1-f8ff-433a-ba42-7f10326d7665 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:07.829736 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473415e1-f8ff-433a-ba42-7f10326d7665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:07.839136 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473415e1-f8ff-433a-ba42-7f10326d7665 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:07.896421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 833/1676] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:07 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:07.901498 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7b7ba-795c-4a52-99fe-7627ed4e482f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:07.922143 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7b7ba-795c-4a52-99fe-7627ed4e482f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:07.940149 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cdf2b-4f3f-44a2-88ab-3db717c0e213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:07.940766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cdf2b-4f3f-44a2-88ab-3db717c0e213 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:07.941128 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cdf2b-4f3f-44a2-88ab-3db717c0e213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:07.941404 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cdf2b-4f3f-44a2-88ab-3db717c0e213 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:07.942057 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2cdf2b-4f3f-44a2-88ab-3db717c0e213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:07.943830 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2cdf2b-4f3f-44a2-88ab-3db717c0e213 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:07.966671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 844/1677] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:07.967884 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473415e1-f8ff-433a-ba42-7f10326d7665 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:07.994425 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473415e1-f8ff-433a-ba42-7f10326d7665 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:08.010871 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dadc65c-f2ed-4e51-a3ce-8ece14404211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:08.012646 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadc65c-f2ed-4e51-a3ce-8ece14404211 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:08.016055 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadc65c-f2ed-4e51-a3ce-8ece14404211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:08.016340 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadc65c-f2ed-4e51-a3ce-8ece14404211 admin admin] PATH_INFO: `/v3/projects/bd3d97cd5882427fb2fe68a35e316d8d/users/7b4bdc7135134560a1f30daaa09ee804/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:08.049356 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dadc65c-f2ed-4e51-a3ce-8ece14404211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd3d97cd5882427fb2fe68a35e316d8d, user_id=7b4bdc7135134560a1f30daaa09ee804, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:08.053936 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dadc65c-f2ed-4e51-a3ce-8ece14404211 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:08.086037 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 834/1678] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:07 2022] PUT /identity/v3/projects/bd3d97cd5882427fb2fe68a35e316d8d/users/7b4bdc7135134560a1f30daaa09ee804/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:08.090603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cdf2b-4f3f-44a2-88ab-3db717c0e213 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:08.105173 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cdf2b-4f3f-44a2-88ab-3db717c0e213 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:08.217418 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523f20b-e7cf-43b8-9c28-e37f2fb4c587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:08.218111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523f20b-e7cf-43b8-9c28-e37f2fb4c587 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:08.218485 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523f20b-e7cf-43b8-9c28-e37f2fb4c587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:08.218764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523f20b-e7cf-43b8-9c28-e37f2fb4c587 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:08.219644 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523f20b-e7cf-43b8-9c28-e37f2fb4c587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:08.221299 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523f20b-e7cf-43b8-9c28-e37f2fb4c587 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:08.232481 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 845/1679] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:14:08.237485 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dadc65c-f2ed-4e51-a3ce-8ece14404211 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:08.251031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dadc65c-f2ed-4e51-a3ce-8ece14404211 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:08.259915 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5497c14-7172-41d0-80ac-8fa6c9428e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:08.261072 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5497c14-7172-41d0-80ac-8fa6c9428e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:08.261574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5497c14-7172-41d0-80ac-8fa6c9428e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:08.262273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5497c14-7172-41d0-80ac-8fa6c9428e47 admin admin] PATH_INFO: `/v3/projects/bd3d97cd5882427fb2fe68a35e316d8d/users/7b4bdc7135134560a1f30daaa09ee804/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:08.266784 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5497c14-7172-41d0-80ac-8fa6c9428e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd3d97cd5882427fb2fe68a35e316d8d, user_id=7b4bdc7135134560a1f30daaa09ee804, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:08.272522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5497c14-7172-41d0-80ac-8fa6c9428e47 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:08.299548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 835/1680] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:08 2022] PUT /identity/v3/projects/bd3d97cd5882427fb2fe68a35e316d8d/users/7b4bdc7135134560a1f30daaa09ee804/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:08.469208 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523f20b-e7cf-43b8-9c28-e37f2fb4c587 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:08.471046 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d523f20b-e7cf-43b8-9c28-e37f2fb4c587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:08.484849 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523f20b-e7cf-43b8-9c28-e37f2fb4c587 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:08.560089 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5c840-b38e-4bbf-8f8a-7a2f005cd087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:08.560868 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5c840-b38e-4bbf-8f8a-7a2f005cd087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:08.561074 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5c840-b38e-4bbf-8f8a-7a2f005cd087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:08.561357 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5c840-b38e-4bbf-8f8a-7a2f005cd087 admin admin] PATH_INFO: `/v3/projects/2ea31f6d5d064ade9c73bde3a3cb1eb4` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:08.562710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5c840-b38e-4bbf-8f8a-7a2f005cd087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea31f6d5d064ade9c73bde3a3cb1eb4)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:08.564747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5c840-b38e-4bbf-8f8a-7a2f005cd087 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:08.623078 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-21b5c840-b38e-4bbf-8f8a-7a2f005cd087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea31f6d5d064ade9c73bde3a3cb1eb4', 'request_id': 'req-21b5c840-b38e-4bbf-8f8a-7a2f005cd087'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:08.631334 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-21b5c840-b38e-4bbf-8f8a-7a2f005cd087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea31f6d5d064ade9c73bde3a3cb1eb4', 'request_id': 'req-21b5c840-b38e-4bbf-8f8a-7a2f005cd087'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:08.638784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-21b5c840-b38e-4bbf-8f8a-7a2f005cd087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea31f6d5d064ade9c73bde3a3cb1eb4', 'request_id': 'req-21b5c840-b38e-4bbf-8f8a-7a2f005cd087'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:08.651026 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-21b5c840-b38e-4bbf-8f8a-7a2f005cd087 admin admin] The token cache is being invalidate because project 2ea31f6d5d064ade9c73bde3a3cb1eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:08.651321 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-21b5c840-b38e-4bbf-8f8a-7a2f005cd087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:08.652014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-21b5c840-b38e-4bbf-8f8a-7a2f005cd087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:08.653549 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 846/1681] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:08 2022] DELETE /identity/v3/projects/2ea31f6d5d064ade9c73bde3a3cb1eb4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:08.657583 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5497c14-7172-41d0-80ac-8fa6c9428e47 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:08.659306 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d5497c14-7172-41d0-80ac-8fa6c9428e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:08.673131 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5497c14-7172-41d0-80ac-8fa6c9428e47 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:08.740296 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db039644-9ebe-4c1b-97a1-72f709ab77ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:08.741757 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db039644-9ebe-4c1b-97a1-72f709ab77ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:08.742085 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db039644-9ebe-4c1b-97a1-72f709ab77ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:08.742273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db039644-9ebe-4c1b-97a1-72f709ab77ae admin admin] PATH_INFO: `/v3/users/5a4d334773c44f1883c9e17172e2aabc` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:08.744236 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db039644-9ebe-4c1b-97a1-72f709ab77ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a4d334773c44f1883c9e17172e2aabc)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:08.746346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db039644-9ebe-4c1b-97a1-72f709ab77ae admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:08.786228 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5c840-b38e-4bbf-8f8a-7a2f005cd087 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:08.788210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-21b5c840-b38e-4bbf-8f8a-7a2f005cd087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:08.806716 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5c840-b38e-4bbf-8f8a-7a2f005cd087 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:08.814687 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1be7b-7a05-4db2-94a7-19596ae41d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:08.815862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1be7b-7a05-4db2-94a7-19596ae41d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:08.816387 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1be7b-7a05-4db2-94a7-19596ae41d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:08.816992 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1be7b-7a05-4db2-94a7-19596ae41d90 admin admin] PATH_INFO: `/v3/projects/9289b3b90f384dda8eb2a7694bf094b0` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:08.818784 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-db039644-9ebe-4c1b-97a1-72f709ab77ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a4d334773c44f1883c9e17172e2aabc'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:08.819201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1be7b-7a05-4db2-94a7-19596ae41d90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9289b3b90f384dda8eb2a7694bf094b0)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:08.823977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1be7b-7a05-4db2-94a7-19596ae41d90 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:08.827955 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:08.836924 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-db039644-9ebe-4c1b-97a1-72f709ab77ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a4d334773c44f1883c9e17172e2aabc'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:08.859390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-db039644-9ebe-4c1b-97a1-72f709ab77ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a4d334773c44f1883c9e17172e2aabc'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:08.865618 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:08.892641 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-db039644-9ebe-4c1b-97a1-72f709ab77ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a4d334773c44f1883c9e17172e2aabc'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:08.894312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-db039644-9ebe-4c1b-97a1-72f709ab77ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a4d334773c44f1883c9e17172e2aabc'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:08.903109 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 836/1682] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:08 2022] DELETE /identity/v3/users/5a4d334773c44f1883c9e17172e2aabc => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:09.009954 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1ec1be7b-7a05-4db2-94a7-19596ae41d90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9289b3b90f384dda8eb2a7694bf094b0', 'request_id': 'req-1ec1be7b-7a05-4db2-94a7-19596ae41d90'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:09.026704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1ec1be7b-7a05-4db2-94a7-19596ae41d90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9289b3b90f384dda8eb2a7694bf094b0', 'request_id': 'req-1ec1be7b-7a05-4db2-94a7-19596ae41d90'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:09.038520 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1ec1be7b-7a05-4db2-94a7-19596ae41d90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9289b3b90f384dda8eb2a7694bf094b0', 'request_id': 'req-1ec1be7b-7a05-4db2-94a7-19596ae41d90'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:09.070674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1ec1be7b-7a05-4db2-94a7-19596ae41d90 admin admin] The token cache is being invalidate because project 9289b3b90f384dda8eb2a7694bf094b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:09.070674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1ec1be7b-7a05-4db2-94a7-19596ae41d90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:09.072433 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1ec1be7b-7a05-4db2-94a7-19596ae41d90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:09.075032 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 847/1683] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:08 2022] DELETE /identity/v3/projects/9289b3b90f384dda8eb2a7694bf094b0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:09.080329 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db039644-9ebe-4c1b-97a1-72f709ab77ae admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:09.083271 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-db039644-9ebe-4c1b-97a1-72f709ab77ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:09.269108 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db039644-9ebe-4c1b-97a1-72f709ab77ae admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:09.424946 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc57dd-f78c-4ab9-8ba8-5d3e82aebcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:09.425614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc57dd-f78c-4ab9-8ba8-5d3e82aebcdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:09.425896 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc57dd-f78c-4ab9-8ba8-5d3e82aebcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:09.426225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc57dd-f78c-4ab9-8ba8-5d3e82aebcdb admin admin] PATH_INFO: `/v3/users/b730d37d8ebb470e9525762954cf954e` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:09.431763 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc57dd-f78c-4ab9-8ba8-5d3e82aebcdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b730d37d8ebb470e9525762954cf954e)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:09.454150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc57dd-f78c-4ab9-8ba8-5d3e82aebcdb admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:09.471345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1be7b-7a05-4db2-94a7-19596ae41d90 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:09.480607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1ec1be7b-7a05-4db2-94a7-19596ae41d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:09.506146 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1be7b-7a05-4db2-94a7-19596ae41d90 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:09.517176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ff1d5-eba2-453a-b08f-8cdd96686dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:09.518105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ff1d5-eba2-453a-b08f-8cdd96686dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:09.518708 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ff1d5-eba2-453a-b08f-8cdd96686dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:09.519318 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ff1d5-eba2-453a-b08f-8cdd96686dbf admin admin] PATH_INFO: `/v3/projects/c21cbf7e7a8f42c2b9cc419a1e6a6bb1` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:09.520874 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ff1d5-eba2-453a-b08f-8cdd96686dbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c21cbf7e7a8f42c2b9cc419a1e6a6bb1)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:09.523087 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ff1d5-eba2-453a-b08f-8cdd96686dbf admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:09.556722 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e8fc57dd-f78c-4ab9-8ba8-5d3e82aebcdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b730d37d8ebb470e9525762954cf954e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:09.568571 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e8fc57dd-f78c-4ab9-8ba8-5d3e82aebcdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b730d37d8ebb470e9525762954cf954e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:09.592807 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e8fc57dd-f78c-4ab9-8ba8-5d3e82aebcdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b730d37d8ebb470e9525762954cf954e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:09.601797 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-554ff1d5-eba2-453a-b08f-8cdd96686dbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c21cbf7e7a8f42c2b9cc419a1e6a6bb1', 'request_id': 'req-554ff1d5-eba2-453a-b08f-8cdd96686dbf'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:09.612436 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e8fc57dd-f78c-4ab9-8ba8-5d3e82aebcdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b730d37d8ebb470e9525762954cf954e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:09.613367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e8fc57dd-f78c-4ab9-8ba8-5d3e82aebcdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b730d37d8ebb470e9525762954cf954e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:09.619370 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-554ff1d5-eba2-453a-b08f-8cdd96686dbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c21cbf7e7a8f42c2b9cc419a1e6a6bb1', 'request_id': 'req-554ff1d5-eba2-453a-b08f-8cdd96686dbf'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:09.630657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 837/1684] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:09 2022] DELETE /identity/v3/users/b730d37d8ebb470e9525762954cf954e => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:09.633876 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-554ff1d5-eba2-453a-b08f-8cdd96686dbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c21cbf7e7a8f42c2b9cc419a1e6a6bb1', 'request_id': 'req-554ff1d5-eba2-453a-b08f-8cdd96686dbf'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:09.666707 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-554ff1d5-eba2-453a-b08f-8cdd96686dbf admin admin] The token cache is being invalidate because project c21cbf7e7a8f42c2b9cc419a1e6a6bb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:09.667009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-554ff1d5-eba2-453a-b08f-8cdd96686dbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:09.668852 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-554ff1d5-eba2-453a-b08f-8cdd96686dbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:09.672134 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 848/1685] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:09 2022] DELETE /identity/v3/projects/c21cbf7e7a8f42c2b9cc419a1e6a6bb1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:09.677178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e1405-6fc6-4ef9-9ea8-241d2d11eb07 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:09.677725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e1405-6fc6-4ef9-9ea8-241d2d11eb07 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:09.677725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e1405-6fc6-4ef9-9ea8-241d2d11eb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:09.694673 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:09.708002 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-5b9e1405-6fc6-4ef9-9ea8-241d2d11eb07 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:09.709766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-5b9e1405-6fc6-4ef9-9ea8-241d2d11eb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:09.857409 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 838/1686] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:14:09.870558 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7653798-f97d-4309-bce5-c2c0e3ee59cc None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:09.871155 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7653798-f97d-4309-bce5-c2c0e3ee59cc None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:09.872516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7653798-f97d-4309-bce5-c2c0e3ee59cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:09.910326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-f7653798-f97d-4309-bce5-c2c0e3ee59cc None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:09.915597 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f7653798-f97d-4309-bce5-c2c0e3ee59cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:09.944600 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 849/1687] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:09.949437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e1405-6fc6-4ef9-9ea8-241d2d11eb07 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:09.958891 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b0f80-c9f6-43b6-b99c-56568519964a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:09.960634 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b0f80-c9f6-43b6-b99c-56568519964a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:09.963598 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b0f80-c9f6-43b6-b99c-56568519964a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:09.964942 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e1405-6fc6-4ef9-9ea8-241d2d11eb07 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:09.979338 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4434d9-5ca6-489e-b853-6cae4b500b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:09.980176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4434d9-5ca6-489e-b853-6cae4b500b04 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:09.981233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4434d9-5ca6-489e-b853-6cae4b500b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:09.982173 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4434d9-5ca6-489e-b853-6cae4b500b04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:09.983682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4434d9-5ca6-489e-b853-6cae4b500b04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:09.983989 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4434d9-5ca6-489e-b853-6cae4b500b04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:09.987001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4434d9-5ca6-489e-b853-6cae4b500b04 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:10.016247 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 839/1688] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:14:10.019849 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4434d9-5ca6-489e-b853-6cae4b500b04 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:10.034522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4434d9-5ca6-489e-b853-6cae4b500b04 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:10.040434 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1023f-0e01-4612-b2ee-8508559a28f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:10.041046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1023f-0e01-4612-b2ee-8508559a28f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:10.041697 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1023f-0e01-4612-b2ee-8508559a28f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:10.041697 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1023f-0e01-4612-b2ee-8508559a28f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:10.042203 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1023f-0e01-4612-b2ee-8508559a28f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:10.044242 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1023f-0e01-4612-b2ee-8508559a28f5 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:10.050321 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-195b0f80-c9f6-43b6-b99c-56568519964a None None] MFA Rules not processed for user `7b4bdc7135134560a1f30daaa09ee804`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:10.052172 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-195b0f80-c9f6-43b6-b99c-56568519964a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:10.126375 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 840/1689] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:10 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:10.126375 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1023f-0e01-4612-b2ee-8508559a28f5 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:10.128260 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-faa1023f-0e01-4612-b2ee-8508559a28f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:10.161824 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:10.205547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 850/1690] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:10.206893 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b0f80-c9f6-43b6-b99c-56568519964a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:10.220291 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b0f80-c9f6-43b6-b99c-56568519964a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:10.243716 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1023f-0e01-4612-b2ee-8508559a28f5 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:10.248500 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838988c-71b0-4062-90bf-c34f2ad119a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:10.249226 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838988c-71b0-4062-90bf-c34f2ad119a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:10.249609 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838988c-71b0-4062-90bf-c34f2ad119a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:10.249958 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838988c-71b0-4062-90bf-c34f2ad119a6 admin admin] PATH_INFO: `/v3/projects/5f6dbffe6de7478882ef937e34eba673` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:10.251179 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838988c-71b0-4062-90bf-c34f2ad119a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f6dbffe6de7478882ef937e34eba673)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:10.253195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838988c-71b0-4062-90bf-c34f2ad119a6 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:10.300555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874a332-51b7-46dc-b183-6e5d2a618047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:10.301179 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874a332-51b7-46dc-b183-6e5d2a618047 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:10.301556 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874a332-51b7-46dc-b183-6e5d2a618047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:10.301840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874a332-51b7-46dc-b183-6e5d2a618047 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:10.302481 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874a332-51b7-46dc-b183-6e5d2a618047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:10.304658 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874a332-51b7-46dc-b183-6e5d2a618047 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:10.331714 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f838988c-71b0-4062-90bf-c34f2ad119a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f6dbffe6de7478882ef937e34eba673', 'request_id': 'req-f838988c-71b0-4062-90bf-c34f2ad119a6'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:10.347796 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 851/1691] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:10 2022] POST /identity/v3/users => generated 284 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:10.347796 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f10e2-51e3-486b-801c-284aecd4529f None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:10.347796 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f10e2-51e3-486b-801c-284aecd4529f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:10.347796 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f10e2-51e3-486b-801c-284aecd4529f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:10.365282 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f838988c-71b0-4062-90bf-c34f2ad119a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f6dbffe6de7478882ef937e34eba673', 'request_id': 'req-f838988c-71b0-4062-90bf-c34f2ad119a6'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:10.371786 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-720f10e2-51e3-486b-801c-284aecd4529f None None] MFA Rules not processed for user `9450a9c2e6d845f1a5dff3aba0ecb3e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:10.374096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-720f10e2-51e3-486b-801c-284aecd4529f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:10.374384 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f838988c-71b0-4062-90bf-c34f2ad119a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f6dbffe6de7478882ef937e34eba673', 'request_id': 'req-f838988c-71b0-4062-90bf-c34f2ad119a6'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:10.386438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f838988c-71b0-4062-90bf-c34f2ad119a6 admin admin] The token cache is being invalidate because project 5f6dbffe6de7478882ef937e34eba673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:10.386856 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f838988c-71b0-4062-90bf-c34f2ad119a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:10.387643 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f838988c-71b0-4062-90bf-c34f2ad119a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:10.389437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 841/1692] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:10 2022] DELETE /identity/v3/projects/5f6dbffe6de7478882ef937e34eba673 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:10.390124 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838988c-71b0-4062-90bf-c34f2ad119a6 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:10.391569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f838988c-71b0-4062-90bf-c34f2ad119a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:10.397430 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:10.478952 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 852/1693] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:10.483128 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f10e2-51e3-486b-801c-284aecd4529f None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:10.484838 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-720f10e2-51e3-486b-801c-284aecd4529f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:10.501649 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838988c-71b0-4062-90bf-c34f2ad119a6 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:10.516830 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f10e2-51e3-486b-801c-284aecd4529f None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:10.521672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f607f8-9188-4731-a5da-c1367d635c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:10.522301 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f607f8-9188-4731-a5da-c1367d635c78 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:10.522581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f607f8-9188-4731-a5da-c1367d635c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:10.522850 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f607f8-9188-4731-a5da-c1367d635c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:10.522949 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8908d-a62c-4b38-a111-2dd4a7ff507b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:10.523669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8908d-a62c-4b38-a111-2dd4a7ff507b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:10.524063 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8908d-a62c-4b38-a111-2dd4a7ff507b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:10.524355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8908d-a62c-4b38-a111-2dd4a7ff507b admin admin] PATH_INFO: `/v3/users/0f9bed2953e146dfa54f190a9c4e3c1d` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:10.525648 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8908d-a62c-4b38-a111-2dd4a7ff507b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f9bed2953e146dfa54f190a9c4e3c1d)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:10.526465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f607f8-9188-4731-a5da-c1367d635c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:10.527615 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8908d-a62c-4b38-a111-2dd4a7ff507b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:10.528150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f607f8-9188-4731-a5da-c1367d635c78 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:10.557849 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 842/1694] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:10.559045 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f607f8-9188-4731-a5da-c1367d635c78 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:10.562273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-86f607f8-9188-4731-a5da-c1367d635c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:10.588573 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-22a8908d-a62c-4b38-a111-2dd4a7ff507b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f9bed2953e146dfa54f190a9c4e3c1d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:10.597428 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-22a8908d-a62c-4b38-a111-2dd4a7ff507b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f9bed2953e146dfa54f190a9c4e3c1d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:10.614938 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-22a8908d-a62c-4b38-a111-2dd4a7ff507b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f9bed2953e146dfa54f190a9c4e3c1d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:10.625114 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-22a8908d-a62c-4b38-a111-2dd4a7ff507b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f9bed2953e146dfa54f190a9c4e3c1d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:10.625771 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-22a8908d-a62c-4b38-a111-2dd4a7ff507b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f9bed2953e146dfa54f190a9c4e3c1d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:10.628067 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:10.639494 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 853/1695] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:10 2022] DELETE /identity/v3/users/0f9bed2953e146dfa54f190a9c4e3c1d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:10.639494 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8908d-a62c-4b38-a111-2dd4a7ff507b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:10.639494 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-22a8908d-a62c-4b38-a111-2dd4a7ff507b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:10.730439 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f607f8-9188-4731-a5da-c1367d635c78 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:10.740622 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8908d-a62c-4b38-a111-2dd4a7ff507b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:10.747408 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08b14a-172b-4037-a7cb-77e51dc778b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:10.748626 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08b14a-172b-4037-a7cb-77e51dc778b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:10.748626 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08b14a-172b-4037-a7cb-77e51dc778b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:10.748879 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08b14a-172b-4037-a7cb-77e51dc778b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:10.749538 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08b14a-172b-4037-a7cb-77e51dc778b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:10.752270 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08b14a-172b-4037-a7cb-77e51dc778b5 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:10.766225 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 854/1696] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:10.771680 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08b14a-172b-4037-a7cb-77e51dc778b5 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:10.797289 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08b14a-172b-4037-a7cb-77e51dc778b5 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:10.837466 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13534b-a5f4-4a6a-bc7c-f1f584911a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:10.838690 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13534b-a5f4-4a6a-bc7c-f1f584911a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:10.839069 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13534b-a5f4-4a6a-bc7c-f1f584911a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:10.839602 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13534b-a5f4-4a6a-bc7c-f1f584911a94 admin admin] PATH_INFO: `/v3/projects/8e83a33188cd438ba09c87d38ba9a2f3/users/93680dc2d4634c07b2a0149341fa7c84/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:10.886673 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d0097-6d76-4070-a8e1-62d396e9dd2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:10.888118 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13534b-a5f4-4a6a-bc7c-f1f584911a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e83a33188cd438ba09c87d38ba9a2f3, user_id=93680dc2d4634c07b2a0149341fa7c84, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:10.889120 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d0097-6d76-4070-a8e1-62d396e9dd2a service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:10.889399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d0097-6d76-4070-a8e1-62d396e9dd2a service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:10.891658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d0097-6d76-4070-a8e1-62d396e9dd2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:10.893628 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13534b-a5f4-4a6a-bc7c-f1f584911a94 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:10.896777 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-020d0097-6d76-4070-a8e1-62d396e9dd2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:10.920794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 855/1697] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:10 2022] PUT /identity/v3/projects/8e83a33188cd438ba09c87d38ba9a2f3/users/93680dc2d4634c07b2a0149341fa7c84/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:10.932467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a89215-86db-4b3a-a29b-cb7c554a0d37 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:10.933053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a89215-86db-4b3a-a29b-cb7c554a0d37 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:10.933510 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a89215-86db-4b3a-a29b-cb7c554a0d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:10.949063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:10.986142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-a2a89215-86db-4b3a-a29b-cb7c554a0d37 None None] MFA Rules not processed for user `93680dc2d4634c07b2a0149341fa7c84`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:10.987788 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a2a89215-86db-4b3a-a29b-cb7c554a0d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:10.988890 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d0097-6d76-4070-a8e1-62d396e9dd2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:10.991122 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d0097-6d76-4070-a8e1-62d396e9dd2a service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:11.001481 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 843/1698] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:11.060068 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d0097-6d76-4070-a8e1-62d396e9dd2a service nova] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:11.061588 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-020d0097-6d76-4070-a8e1-62d396e9dd2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:11.084928 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d0097-6d76-4070-a8e1-62d396e9dd2a service nova] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:11.125911 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 856/1699] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:14:11.130633 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a89215-86db-4b3a-a29b-cb7c554a0d37 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:11.167118 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6d1a9-c523-4bad-9929-abd0f191a81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:11.167794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6d1a9-c523-4bad-9929-abd0f191a81d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:11.168927 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6d1a9-c523-4bad-9929-abd0f191a81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:11.169204 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6d1a9-c523-4bad-9929-abd0f191a81d admin admin] PATH_INFO: `/v3/projects/7781bf2870e847a8af6335e1f6a8cf17` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:11.170341 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6d1a9-c523-4bad-9929-abd0f191a81d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7781bf2870e847a8af6335e1f6a8cf17)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:11.172502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6d1a9-c523-4bad-9929-abd0f191a81d admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:11.246383 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-d5e6d1a9-c523-4bad-9929-abd0f191a81d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7781bf2870e847a8af6335e1f6a8cf17', 'request_id': 'req-d5e6d1a9-c523-4bad-9929-abd0f191a81d'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:11.258947 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-d5e6d1a9-c523-4bad-9929-abd0f191a81d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7781bf2870e847a8af6335e1f6a8cf17', 'request_id': 'req-d5e6d1a9-c523-4bad-9929-abd0f191a81d'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:11.274669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a89215-86db-4b3a-a29b-cb7c554a0d37 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:11.278977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:11.279307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-d5e6d1a9-c523-4bad-9929-abd0f191a81d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7781bf2870e847a8af6335e1f6a8cf17', 'request_id': 'req-d5e6d1a9-c523-4bad-9929-abd0f191a81d'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:11.302603 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-d5e6d1a9-c523-4bad-9929-abd0f191a81d admin admin] The token cache is being invalidate because project 7781bf2870e847a8af6335e1f6a8cf17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:11.303750 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-d5e6d1a9-c523-4bad-9929-abd0f191a81d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:11.308572 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-d5e6d1a9-c523-4bad-9929-abd0f191a81d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:11.310317 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 844/1700] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:11 2022] DELETE /identity/v3/projects/7781bf2870e847a8af6335e1f6a8cf17 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:11.316652 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631535b-09f8-4a89-aa6e-cc348f768d87 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:11.316924 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631535b-09f8-4a89-aa6e-cc348f768d87 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:11.317200 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631535b-09f8-4a89-aa6e-cc348f768d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:11.365264 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-d631535b-09f8-4a89-aa6e-cc348f768d87 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:11.365972 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc05464-83e9-4afc-973e-7eae73e6bcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:11.366602 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc05464-83e9-4afc-973e-7eae73e6bcee admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:11.366727 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d631535b-09f8-4a89-aa6e-cc348f768d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:11.367155 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc05464-83e9-4afc-973e-7eae73e6bcee admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:11.368000 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc05464-83e9-4afc-973e-7eae73e6bcee admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:11.368761 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc05464-83e9-4afc-973e-7eae73e6bcee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:11.372139 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc05464-83e9-4afc-973e-7eae73e6bcee admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:11.382938 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 845/1701] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:11.385972 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdb2cd-8290-48e2-b362-27e2f4764bca None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:11.386271 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdb2cd-8290-48e2-b362-27e2f4764bca None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:11.386552 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdb2cd-8290-48e2-b362-27e2f4764bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:11.412062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 857/1702] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:11 2022] POST /identity/v3/projects => generated 369 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:11.417697 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-7cfdb2cd-8290-48e2-b362-27e2f4764bca None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:11.418224 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc05464-83e9-4afc-973e-7eae73e6bcee admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:11.419145 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-7cfdb2cd-8290-48e2-b362-27e2f4764bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:11.420734 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7fc05464-83e9-4afc-973e-7eae73e6bcee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:11.516856 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:11.531893 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 846/1703] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:11.535683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdb2cd-8290-48e2-b362-27e2f4764bca None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:11.546385 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdb2cd-8290-48e2-b362-27e2f4764bca None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:11.556930 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc05464-83e9-4afc-973e-7eae73e6bcee admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:11.561804 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f713f5-3691-4d5c-addf-308b5de97817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:11.564792 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438773a-30a5-45e3-9e47-2e8ebedefa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:11.564792 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438773a-30a5-45e3-9e47-2e8ebedefa62 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:11.565137 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438773a-30a5-45e3-9e47-2e8ebedefa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:11.565137 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438773a-30a5-45e3-9e47-2e8ebedefa62 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:11.565720 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438773a-30a5-45e3-9e47-2e8ebedefa62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:11.566059 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f713f5-3691-4d5c-addf-308b5de97817 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:11.566438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f713f5-3691-4d5c-addf-308b5de97817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:11.566810 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f713f5-3691-4d5c-addf-308b5de97817 admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:11.567609 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f713f5-3691-4d5c-addf-308b5de97817 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:11.567911 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438773a-30a5-45e3-9e47-2e8ebedefa62 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:11.582775 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f713f5-3691-4d5c-addf-308b5de97817 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:11.582775 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f713f5-3691-4d5c-addf-308b5de97817 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:11.601413 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 847/1704] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:14:11.604691 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 858/1705] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:11 2022] POST /identity/v3/users => generated 291 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:11.608514 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438773a-30a5-45e3-9e47-2e8ebedefa62 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:11.608909 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f713f5-3691-4d5c-addf-308b5de97817 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:11.631829 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438773a-30a5-45e3-9e47-2e8ebedefa62 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:11.635804 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f713f5-3691-4d5c-addf-308b5de97817 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:11.640119 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf60694-8078-433a-8843-b98954213ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:11.640973 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf60694-8078-433a-8843-b98954213ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:11.641465 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf60694-8078-433a-8843-b98954213ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:11.642465 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf60694-8078-433a-8843-b98954213ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:11.644405 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf60694-8078-433a-8843-b98954213ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:11.646434 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf60694-8078-433a-8843-b98954213ef4 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:11.657058 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e15055-ec96-4b40-ac4d-5796bd008a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:11.657665 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e15055-ec96-4b40-ac4d-5796bd008a7a admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:11.657942 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e15055-ec96-4b40-ac4d-5796bd008a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:11.658209 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e15055-ec96-4b40-ac4d-5796bd008a7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:11.658993 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e15055-ec96-4b40-ac4d-5796bd008a7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:11.660973 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e15055-ec96-4b40-ac4d-5796bd008a7a admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:11.665538 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 859/1706] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:11.666563 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf60694-8078-433a-8843-b98954213ef4 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:11.678621 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf60694-8078-433a-8843-b98954213ef4 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:11.687746 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685748c4-6dd6-48f8-8280-848e40e11a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:11.688958 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685748c4-6dd6-48f8-8280-848e40e11a25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:11.688958 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685748c4-6dd6-48f8-8280-848e40e11a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:11.689142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685748c4-6dd6-48f8-8280-848e40e11a25 admin admin] PATH_INFO: `/v3/projects/9b1eca174e324fd7adafa9e29982fef7/users/30f7eac13bf54bd09659dcba0c16a35c/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:11.711960 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685748c4-6dd6-48f8-8280-848e40e11a25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b1eca174e324fd7adafa9e29982fef7, user_id=30f7eac13bf54bd09659dcba0c16a35c, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:11.715313 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685748c4-6dd6-48f8-8280-848e40e11a25 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:11.724658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 848/1707] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:11 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:11.725528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e15055-ec96-4b40-ac4d-5796bd008a7a admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:11.739276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 860/1708] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:11 2022] PUT /identity/v3/projects/9b1eca174e324fd7adafa9e29982fef7/users/30f7eac13bf54bd09659dcba0c16a35c/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:11.740314 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685748c4-6dd6-48f8-8280-848e40e11a25 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:11.812851 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e15055-ec96-4b40-ac4d-5796bd008a7a admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:11.856016 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:11.885352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685748c4-6dd6-48f8-8280-848e40e11a25 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:11.899756 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a527c2-7db6-4080-bd2a-35a043a552a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:11.901494 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a527c2-7db6-4080-bd2a-35a043a552a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:11.901778 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a527c2-7db6-4080-bd2a-35a043a552a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:11.902079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a527c2-7db6-4080-bd2a-35a043a552a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:11.902757 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a527c2-7db6-4080-bd2a-35a043a552a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:11.908513 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a527c2-7db6-4080-bd2a-35a043a552a6 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:11.909378 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749816ba-514a-40e6-87f3-65b80eda07bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:11.910144 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749816ba-514a-40e6-87f3-65b80eda07bf admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:11.910562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749816ba-514a-40e6-87f3-65b80eda07bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:11.910933 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749816ba-514a-40e6-87f3-65b80eda07bf admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:11.911863 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749816ba-514a-40e6-87f3-65b80eda07bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:11.915460 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749816ba-514a-40e6-87f3-65b80eda07bf admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:11.941599 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 861/1709] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:11.943054 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a527c2-7db6-4080-bd2a-35a043a552a6 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:11.950606 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 849/1710] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:11 2022] POST /identity/v3/users => generated 288 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:11.952501 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749816ba-514a-40e6-87f3-65b80eda07bf admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:11.960749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a527c2-7db6-4080-bd2a-35a043a552a6 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:11.966902 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed50f0b-c08c-49a0-ae70-59d684eff94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:11.967048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749816ba-514a-40e6-87f3-65b80eda07bf admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:11.968192 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed50f0b-c08c-49a0-ae70-59d684eff94a admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:11.968472 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed50f0b-c08c-49a0-ae70-59d684eff94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:11.968875 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed50f0b-c08c-49a0-ae70-59d684eff94a admin admin] PATH_INFO: `/v3/projects/9b1eca174e324fd7adafa9e29982fef7/users/30f7eac13bf54bd09659dcba0c16a35c/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:11.971079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed50f0b-c08c-49a0-ae70-59d684eff94a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b1eca174e324fd7adafa9e29982fef7, user_id=30f7eac13bf54bd09659dcba0c16a35c, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:11.972364 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e0e39-90c3-437c-b163-c1d4ef89c4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:11.972973 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e0e39-90c3-437c-b163-c1d4ef89c4cd admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:11.973295 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e0e39-90c3-437c-b163-c1d4ef89c4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:11.973570 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e0e39-90c3-437c-b163-c1d4ef89c4cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:11.973994 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed50f0b-c08c-49a0-ae70-59d684eff94a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:11.974258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e0e39-90c3-437c-b163-c1d4ef89c4cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:11.975998 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e0e39-90c3-437c-b163-c1d4ef89c4cd admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:11.987903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 862/1711] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:11 2022] PUT /identity/v3/projects/9b1eca174e324fd7adafa9e29982fef7/users/30f7eac13bf54bd09659dcba0c16a35c/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:11.993698 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 850/1712] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:11.995138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed50f0b-c08c-49a0-ae70-59d684eff94a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:12.000464 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5cdac-2d12-4492-8a52-5d56af660c59 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:12.000750 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5cdac-2d12-4492-8a52-5d56af660c59 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:12.001025 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5cdac-2d12-4492-8a52-5d56af660c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:12.086594 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-47f5cdac-2d12-4492-8a52-5d56af660c59 None None] MFA Rules not processed for user `30f7eac13bf54bd09659dcba0c16a35c`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:12.087848 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-47f5cdac-2d12-4492-8a52-5d56af660c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:12.142358 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:12.190816 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 851/1713] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:12.191363 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed50f0b-c08c-49a0-ae70-59d684eff94a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:12.196649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc3856-0d81-4dee-9305-c1cf0e3ade93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:12.197288 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc3856-0d81-4dee-9305-c1cf0e3ade93 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:12.197579 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc3856-0d81-4dee-9305-c1cf0e3ade93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:12.197882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc3856-0d81-4dee-9305-c1cf0e3ade93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:12.198515 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc3856-0d81-4dee-9305-c1cf0e3ade93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:12.199670 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5cdac-2d12-4492-8a52-5d56af660c59 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:12.200359 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc3856-0d81-4dee-9305-c1cf0e3ade93 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:12.201368 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-47f5cdac-2d12-4492-8a52-5d56af660c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:12.214971 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 863/1714] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:14:12.216099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc3856-0d81-4dee-9305-c1cf0e3ade93 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:12.228788 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc3856-0d81-4dee-9305-c1cf0e3ade93 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:12.233568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44d5fa-0e2d-412b-9f60-3c89ead5916c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:12.234244 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44d5fa-0e2d-412b-9f60-3c89ead5916c admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:12.234571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44d5fa-0e2d-412b-9f60-3c89ead5916c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:12.234798 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44d5fa-0e2d-412b-9f60-3c89ead5916c admin admin] PATH_INFO: `/v3/projects/bddace4635d244c39cf7c3bb37cbdeab/users/a9a9692f270c4f228b3f77ecf3bb7138/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:12.252133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44d5fa-0e2d-412b-9f60-3c89ead5916c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bddace4635d244c39cf7c3bb37cbdeab, user_id=a9a9692f270c4f228b3f77ecf3bb7138, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:12.255064 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44d5fa-0e2d-412b-9f60-3c89ead5916c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:12.270444 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 864/1715] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:12 2022] PUT /identity/v3/projects/bddace4635d244c39cf7c3bb37cbdeab/users/a9a9692f270c4f228b3f77ecf3bb7138/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:12.272662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5cdac-2d12-4492-8a52-5d56af660c59 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:12.283499 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04a0da-ec30-4d71-aa0a-c7856d20c789 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:12.283799 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04a0da-ec30-4d71-aa0a-c7856d20c789 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:12.284063 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04a0da-ec30-4d71-aa0a-c7856d20c789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:12.322238 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-1d04a0da-ec30-4d71-aa0a-c7856d20c789 None None] MFA Rules not processed for user `a9a9692f270c4f228b3f77ecf3bb7138`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:12.323882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1d04a0da-ec30-4d71-aa0a-c7856d20c789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:12.371182 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be90c6c-4ba0-4712-bd7f-0607f75f3e16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:12.374103 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be90c6c-4ba0-4712-bd7f-0607f75f3e16 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:12.374399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be90c6c-4ba0-4712-bd7f-0607f75f3e16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:12.374719 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be90c6c-4ba0-4712-bd7f-0607f75f3e16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:12.433576 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 865/1716] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:12.438424 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04a0da-ec30-4d71-aa0a-c7856d20c789 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:12.476395 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:12.485289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be90c6c-4ba0-4712-bd7f-0607f75f3e16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:12.487281 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be90c6c-4ba0-4712-bd7f-0607f75f3e16 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:12.502438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 852/1717] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:12.517769 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04a0da-ec30-4d71-aa0a-c7856d20c789 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:12.523016 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905663e3-16fd-4f5e-92bf-e9b37320b2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:12.524513 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905663e3-16fd-4f5e-92bf-e9b37320b2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:12.524907 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905663e3-16fd-4f5e-92bf-e9b37320b2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:12.525382 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905663e3-16fd-4f5e-92bf-e9b37320b2f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:12.526124 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905663e3-16fd-4f5e-92bf-e9b37320b2f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:12.528149 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905663e3-16fd-4f5e-92bf-e9b37320b2f9 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:12.584081 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 866/1718] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:12 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:12.585031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be90c6c-4ba0-4712-bd7f-0607f75f3e16 service cinder] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:12.598569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be90c6c-4ba0-4712-bd7f-0607f75f3e16 service cinder] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:12.655571 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:12.681012 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157080b1-d880-4405-ab01-116984877e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:12.682361 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157080b1-d880-4405-ab01-116984877e2c admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:12.682857 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157080b1-d880-4405-ab01-116984877e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:12.683350 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157080b1-d880-4405-ab01-116984877e2c admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:12.684135 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157080b1-d880-4405-ab01-116984877e2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:12.686490 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157080b1-d880-4405-ab01-116984877e2c admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:12.741920 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 853/1719] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:12 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:12.749289 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905663e3-16fd-4f5e-92bf-e9b37320b2f9 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:12.769537 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905663e3-16fd-4f5e-92bf-e9b37320b2f9 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:12.775582 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4cdeb-fff5-4b20-a77b-1ec4180f6bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:12.776200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4cdeb-fff5-4b20-a77b-1ec4180f6bba admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:12.776831 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4cdeb-fff5-4b20-a77b-1ec4180f6bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:12.777166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4cdeb-fff5-4b20-a77b-1ec4180f6bba admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:12.778012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4cdeb-fff5-4b20-a77b-1ec4180f6bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:12.779918 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4cdeb-fff5-4b20-a77b-1ec4180f6bba admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:12.796712 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 867/1720] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:12.799916 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157080b1-d880-4405-ab01-116984877e2c admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:12.816428 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157080b1-d880-4405-ab01-116984877e2c admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:12.823464 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4668b1-6c4c-485a-b958-8d77968de9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:12.824066 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4668b1-6c4c-485a-b958-8d77968de9b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:12.824391 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4668b1-6c4c-485a-b958-8d77968de9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:12.824948 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4668b1-6c4c-485a-b958-8d77968de9b0 admin admin] PATH_INFO: `/v3/projects/110e43a82c424b09a5621b82ef4fdbac/users/9332138695c34499a544e846d0a67137/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:12.853857 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4668b1-6c4c-485a-b958-8d77968de9b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=110e43a82c424b09a5621b82ef4fdbac, user_id=9332138695c34499a544e846d0a67137, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:12.860752 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4668b1-6c4c-485a-b958-8d77968de9b0 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:12.901884 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 854/1721] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:12 2022] PUT /identity/v3/projects/110e43a82c424b09a5621b82ef4fdbac/users/9332138695c34499a544e846d0a67137/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:12.902589 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4cdeb-fff5-4b20-a77b-1ec4180f6bba admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:12.921056 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4cdeb-fff5-4b20-a77b-1ec4180f6bba admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:13.022214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64403b9-6afd-470a-90be-0a28be663a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:13.022931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64403b9-6afd-470a-90be-0a28be663a9a admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:13.023208 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64403b9-6afd-470a-90be-0a28be663a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:13.023922 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64403b9-6afd-470a-90be-0a28be663a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:13.025038 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64403b9-6afd-470a-90be-0a28be663a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:13.027136 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64403b9-6afd-470a-90be-0a28be663a9a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:13.051471 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 868/1722] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:14:13.054562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4668b1-6c4c-485a-b958-8d77968de9b0 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:13.067174 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4668b1-6c4c-485a-b958-8d77968de9b0 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:13.093282 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cce99-7943-490d-92ca-098d0adb1530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:13.093968 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cce99-7943-490d-92ca-098d0adb1530 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:13.094247 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cce99-7943-490d-92ca-098d0adb1530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:13.094525 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cce99-7943-490d-92ca-098d0adb1530 admin admin] PATH_INFO: `/v3/projects/110e43a82c424b09a5621b82ef4fdbac/users/9332138695c34499a544e846d0a67137/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:13.098564 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8cce99-7943-490d-92ca-098d0adb1530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=110e43a82c424b09a5621b82ef4fdbac, user_id=9332138695c34499a544e846d0a67137, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:13.121218 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8cce99-7943-490d-92ca-098d0adb1530 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:13.158616 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 855/1723] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:13 2022] PUT /identity/v3/projects/110e43a82c424b09a5621b82ef4fdbac/users/9332138695c34499a544e846d0a67137/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:13.171080 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bb347-80d8-47d7-a16b-db0ab70b140a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:13.171369 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bb347-80d8-47d7-a16b-db0ab70b140a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:13.171666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bb347-80d8-47d7-a16b-db0ab70b140a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:13.236902 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-980bb347-80d8-47d7-a16b-db0ab70b140a None None] MFA Rules not processed for user `9332138695c34499a544e846d0a67137`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:13.240609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-980bb347-80d8-47d7-a16b-db0ab70b140a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:13.362042 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 869/1724] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:13.375444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cce99-7943-490d-92ca-098d0adb1530 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:13.377259 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-5a8cce99-7943-490d-92ca-098d0adb1530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:13.493757 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cce99-7943-490d-92ca-098d0adb1530 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:13.497935 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d223f-6878-4196-b56f-6a2cd5b245c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:13.498659 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d223f-6878-4196-b56f-6a2cd5b245c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:13.499029 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d223f-6878-4196-b56f-6a2cd5b245c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:13.499411 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d223f-6878-4196-b56f-6a2cd5b245c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:13.574885 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d223f-6878-4196-b56f-6a2cd5b245c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:13.577230 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d223f-6878-4196-b56f-6a2cd5b245c0 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:13.589148 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 856/1725] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:14.673467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bb347-80d8-47d7-a16b-db0ab70b140a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:14.710020 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:14.751118 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bb347-80d8-47d7-a16b-db0ab70b140a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:14.756032 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ae2a4-2bc1-4893-a26e-8e87696c2435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:14.756658 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ae2a4-2bc1-4893-a26e-8e87696c2435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:14.756933 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ae2a4-2bc1-4893-a26e-8e87696c2435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:14.757192 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ae2a4-2bc1-4893-a26e-8e87696c2435 admin admin] PATH_INFO: `/v3/users/93680dc2d4634c07b2a0149341fa7c84` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:14.759034 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ae2a4-2bc1-4893-a26e-8e87696c2435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93680dc2d4634c07b2a0149341fa7c84)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:14.761056 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ae2a4-2bc1-4893-a26e-8e87696c2435 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:14.812615 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1f7ae2a4-2bc1-4893-a26e-8e87696c2435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93680dc2d4634c07b2a0149341fa7c84'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:14.821661 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1f7ae2a4-2bc1-4893-a26e-8e87696c2435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93680dc2d4634c07b2a0149341fa7c84'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:14.835461 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1f7ae2a4-2bc1-4893-a26e-8e87696c2435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93680dc2d4634c07b2a0149341fa7c84'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:14.845868 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1f7ae2a4-2bc1-4893-a26e-8e87696c2435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93680dc2d4634c07b2a0149341fa7c84'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:14.846759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1f7ae2a4-2bc1-4893-a26e-8e87696c2435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93680dc2d4634c07b2a0149341fa7c84'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:14.858140 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 870/1726] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:14 2022] DELETE /identity/v3/users/93680dc2d4634c07b2a0149341fa7c84 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:14.860223 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4624c-7616-43c8-97dd-6c667a197ce6 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:14.860754 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4624c-7616-43c8-97dd-6c667a197ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:14.860850 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4624c-7616-43c8-97dd-6c667a197ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:14.888483 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-07b4624c-7616-43c8-97dd-6c667a197ce6 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:14.889735 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-07b4624c-7616-43c8-97dd-6c667a197ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:14.937180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:14.961099 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 857/1727] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:14.968164 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ae2a4-2bc1-4893-a26e-8e87696c2435 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:14.969610 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1f7ae2a4-2bc1-4893-a26e-8e87696c2435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:15.032835 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ae2a4-2bc1-4893-a26e-8e87696c2435 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:15.036524 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823003c6-aa32-462b-9cef-5b825e10e4c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:15.037130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823003c6-aa32-462b-9cef-5b825e10e4c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:15.037416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823003c6-aa32-462b-9cef-5b825e10e4c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:15.037687 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823003c6-aa32-462b-9cef-5b825e10e4c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:15.046857 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823003c6-aa32-462b-9cef-5b825e10e4c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:15.048305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823003c6-aa32-462b-9cef-5b825e10e4c6 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:15.058756 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 871/1728] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:15.405405 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4624c-7616-43c8-97dd-6c667a197ce6 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:15.407044 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-07b4624c-7616-43c8-97dd-6c667a197ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:15.424440 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4624c-7616-43c8-97dd-6c667a197ce6 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:15.430941 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228daa1-cbb1-431a-b04d-fa05dc3d3a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:15.432485 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228daa1-cbb1-431a-b04d-fa05dc3d3a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:15.433414 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228daa1-cbb1-431a-b04d-fa05dc3d3a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:15.433414 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228daa1-cbb1-431a-b04d-fa05dc3d3a10 admin admin] PATH_INFO: `/v3/projects/8e83a33188cd438ba09c87d38ba9a2f3` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:15.434629 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228daa1-cbb1-431a-b04d-fa05dc3d3a10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e83a33188cd438ba09c87d38ba9a2f3)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:15.437231 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228daa1-cbb1-431a-b04d-fa05dc3d3a10 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:15.531840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-0228daa1-cbb1-431a-b04d-fa05dc3d3a10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e83a33188cd438ba09c87d38ba9a2f3', 'request_id': 'req-0228daa1-cbb1-431a-b04d-fa05dc3d3a10'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:15.549631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-0228daa1-cbb1-431a-b04d-fa05dc3d3a10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e83a33188cd438ba09c87d38ba9a2f3', 'request_id': 'req-0228daa1-cbb1-431a-b04d-fa05dc3d3a10'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:15.564646 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-0228daa1-cbb1-431a-b04d-fa05dc3d3a10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e83a33188cd438ba09c87d38ba9a2f3', 'request_id': 'req-0228daa1-cbb1-431a-b04d-fa05dc3d3a10'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:15.580431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-0228daa1-cbb1-431a-b04d-fa05dc3d3a10 admin admin] The token cache is being invalidate because project 8e83a33188cd438ba09c87d38ba9a2f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:15.580776 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-0228daa1-cbb1-431a-b04d-fa05dc3d3a10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:15.582073 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-0228daa1-cbb1-431a-b04d-fa05dc3d3a10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:15.584377 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 858/1729] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:15 2022] DELETE /identity/v3/projects/8e83a33188cd438ba09c87d38ba9a2f3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:15.588515 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823003c6-aa32-462b-9cef-5b825e10e4c6 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:15.600265 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823003c6-aa32-462b-9cef-5b825e10e4c6 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:15.696888 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:15.713568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffea9c6-6070-4556-bf51-08e1a33b6a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:15.714453 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffea9c6-6070-4556-bf51-08e1a33b6a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:15.714734 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffea9c6-6070-4556-bf51-08e1a33b6a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:15.715003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffea9c6-6070-4556-bf51-08e1a33b6a8e admin admin] PATH_INFO: `/v3/users/30f7eac13bf54bd09659dcba0c16a35c` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:15.718018 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffea9c6-6070-4556-bf51-08e1a33b6a8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f7eac13bf54bd09659dcba0c16a35c)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:15.720011 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffea9c6-6070-4556-bf51-08e1a33b6a8e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:15.813904 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-bffea9c6-6070-4556-bf51-08e1a33b6a8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f7eac13bf54bd09659dcba0c16a35c'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:15.825597 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-bffea9c6-6070-4556-bf51-08e1a33b6a8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f7eac13bf54bd09659dcba0c16a35c'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:15.847336 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-bffea9c6-6070-4556-bf51-08e1a33b6a8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f7eac13bf54bd09659dcba0c16a35c'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:15.858107 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-bffea9c6-6070-4556-bf51-08e1a33b6a8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f7eac13bf54bd09659dcba0c16a35c'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:15.859752 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-bffea9c6-6070-4556-bf51-08e1a33b6a8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f7eac13bf54bd09659dcba0c16a35c'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:15.868097 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 872/1730] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:15 2022] DELETE /identity/v3/users/30f7eac13bf54bd09659dcba0c16a35c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:16.233953 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228daa1-cbb1-431a-b04d-fa05dc3d3a10 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:16.235543 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-0228daa1-cbb1-431a-b04d-fa05dc3d3a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:16.256004 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228daa1-cbb1-431a-b04d-fa05dc3d3a10 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:16.363402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3baa7-3479-45e3-b2bd-2906aa387bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:16.364003 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3baa7-3479-45e3-b2bd-2906aa387bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:16.364313 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3baa7-3479-45e3-b2bd-2906aa387bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:16.364551 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3baa7-3479-45e3-b2bd-2906aa387bd6 admin admin] PATH_INFO: `/v3/projects/9b1eca174e324fd7adafa9e29982fef7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:16.365797 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3baa7-3479-45e3-b2bd-2906aa387bd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b1eca174e324fd7adafa9e29982fef7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:16.369112 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3baa7-3479-45e3-b2bd-2906aa387bd6 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:16.442040 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-d1d3baa7-3479-45e3-b2bd-2906aa387bd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b1eca174e324fd7adafa9e29982fef7', 'request_id': 'req-d1d3baa7-3479-45e3-b2bd-2906aa387bd6'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:16.456343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-d1d3baa7-3479-45e3-b2bd-2906aa387bd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b1eca174e324fd7adafa9e29982fef7', 'request_id': 'req-d1d3baa7-3479-45e3-b2bd-2906aa387bd6'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:16.467236 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-d1d3baa7-3479-45e3-b2bd-2906aa387bd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b1eca174e324fd7adafa9e29982fef7', 'request_id': 'req-d1d3baa7-3479-45e3-b2bd-2906aa387bd6'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:16.479333 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:16.484792 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-d1d3baa7-3479-45e3-b2bd-2906aa387bd6 admin admin] The token cache is being invalidate because project 9b1eca174e324fd7adafa9e29982fef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:16.487106 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-d1d3baa7-3479-45e3-b2bd-2906aa387bd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:16.488313 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-d1d3baa7-3479-45e3-b2bd-2906aa387bd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:16.490610 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 859/1731] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:16 2022] DELETE /identity/v3/projects/9b1eca174e324fd7adafa9e29982fef7 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:16.496677 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2e5e8-1b2e-4db5-b8ae-9a7775556595 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:16.496958 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2e5e8-1b2e-4db5-b8ae-9a7775556595 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:16.497233 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2e5e8-1b2e-4db5-b8ae-9a7775556595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:16.529267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3baa7-3479-45e3-b2bd-2906aa387bd6 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:16.530756 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d1d3baa7-3479-45e3-b2bd-2906aa387bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:16.533326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-11a2e5e8-1b2e-4db5-b8ae-9a7775556595 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:16.534451 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-11a2e5e8-1b2e-4db5-b8ae-9a7775556595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:16.660380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 873/1732] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:16.660380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2e5e8-1b2e-4db5-b8ae-9a7775556595 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:16.660554 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3baa7-3479-45e3-b2bd-2906aa387bd6 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:16.662992 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-11a2e5e8-1b2e-4db5-b8ae-9a7775556595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:16.665350 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5450880-a616-4f54-9c80-c4a203183581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:16.666070 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5450880-a616-4f54-9c80-c4a203183581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:16.666414 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5450880-a616-4f54-9c80-c4a203183581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:16.666749 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5450880-a616-4f54-9c80-c4a203183581 admin admin] PATH_INFO: `/v3/users/88773edcba8a4de3bcfc25d934a04995` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:16.668094 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5450880-a616-4f54-9c80-c4a203183581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88773edcba8a4de3bcfc25d934a04995)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:16.670264 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5450880-a616-4f54-9c80-c4a203183581 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:16.683155 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2e5e8-1b2e-4db5-b8ae-9a7775556595 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:16.688629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633493b1-6a42-4858-9590-a02caaa136d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:16.689284 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633493b1-6a42-4858-9590-a02caaa136d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:16.689567 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633493b1-6a42-4858-9590-a02caaa136d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:16.689846 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633493b1-6a42-4858-9590-a02caaa136d3 admin admin] PATH_INFO: `/v3/users/a9a9692f270c4f228b3f77ecf3bb7138` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:16.691555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633493b1-6a42-4858-9590-a02caaa136d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9a9692f270c4f228b3f77ecf3bb7138)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:16.693512 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633493b1-6a42-4858-9590-a02caaa136d3 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:16.735649 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-d5450880-a616-4f54-9c80-c4a203183581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88773edcba8a4de3bcfc25d934a04995'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:16.745274 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-d5450880-a616-4f54-9c80-c4a203183581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88773edcba8a4de3bcfc25d934a04995'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:16.757740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-d5450880-a616-4f54-9c80-c4a203183581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88773edcba8a4de3bcfc25d934a04995'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:16.760129 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-633493b1-6a42-4858-9590-a02caaa136d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9a9692f270c4f228b3f77ecf3bb7138'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:16.770397 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-633493b1-6a42-4858-9590-a02caaa136d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9a9692f270c4f228b3f77ecf3bb7138'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:16.781168 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:16.787234 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-d5450880-a616-4f54-9c80-c4a203183581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88773edcba8a4de3bcfc25d934a04995'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:16.788190 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-d5450880-a616-4f54-9c80-c4a203183581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88773edcba8a4de3bcfc25d934a04995'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:16.793752 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-633493b1-6a42-4858-9590-a02caaa136d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9a9692f270c4f228b3f77ecf3bb7138'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:16.800536 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 860/1733] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:16 2022] DELETE /identity/v3/users/88773edcba8a4de3bcfc25d934a04995 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:16.804091 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e08ee-3f04-42fb-b7bc-bc343ef8130e None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:16.804091 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e08ee-3f04-42fb-b7bc-bc343ef8130e None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:16.804091 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e08ee-3f04-42fb-b7bc-bc343ef8130e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:16.804948 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-633493b1-6a42-4858-9590-a02caaa136d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9a9692f270c4f228b3f77ecf3bb7138'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:16.805981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-633493b1-6a42-4858-9590-a02caaa136d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9a9692f270c4f228b3f77ecf3bb7138'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:16.814348 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 874/1734] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:16 2022] DELETE /identity/v3/users/a9a9692f270c4f228b3f77ecf3bb7138 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:16.816016 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309b458-aec3-47dd-92a0-46f18ebebf3b None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:16.816307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309b458-aec3-47dd-92a0-46f18ebebf3b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:16.816585 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309b458-aec3-47dd-92a0-46f18ebebf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:16.829993 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-e93e08ee-3f04-42fb-b7bc-bc343ef8130e None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:16.831610 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-e93e08ee-3f04-42fb-b7bc-bc343ef8130e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:16.843686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b309b458-aec3-47dd-92a0-46f18ebebf3b None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:16.845361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b309b458-aec3-47dd-92a0-46f18ebebf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:16.922289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 861/1735] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:16.923088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9b8f8-89c2-4ddc-865f-9b68a2ae82ba None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:16.923371 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9b8f8-89c2-4ddc-865f-9b68a2ae82ba None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:16.923671 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9b8f8-89c2-4ddc-865f-9b68a2ae82ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:16.943035 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 875/1736] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:16.944081 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309b458-aec3-47dd-92a0-46f18ebebf3b None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:16.953114 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-32f9b8f8-89c2-4ddc-865f-9b68a2ae82ba None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:16.954725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-32f9b8f8-89c2-4ddc-865f-9b68a2ae82ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:16.955800 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309b458-aec3-47dd-92a0-46f18ebebf3b None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:16.960665 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85876768-7252-42a4-981b-29660c85c277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:16.961812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85876768-7252-42a4-981b-29660c85c277 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:16.962087 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85876768-7252-42a4-981b-29660c85c277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:16.962353 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85876768-7252-42a4-981b-29660c85c277 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:16.963228 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85876768-7252-42a4-981b-29660c85c277 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:16.963465 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85876768-7252-42a4-981b-29660c85c277 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:16.965475 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85876768-7252-42a4-981b-29660c85c277 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:16.967556 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 862/1737] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:16.969228 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9b8f8-89c2-4ddc-865f-9b68a2ae82ba None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:16.971620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-32f9b8f8-89c2-4ddc-865f-9b68a2ae82ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:16.983255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 876/1738] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:14:16.989551 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85876768-7252-42a4-981b-29660c85c277 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:16.991324 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:17.006133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85876768-7252-42a4-981b-29660c85c277 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:17.015472 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fda983-1209-4975-966b-5a7ca702f455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:17.016184 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fda983-1209-4975-966b-5a7ca702f455 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:17.016374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fda983-1209-4975-966b-5a7ca702f455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:17.016595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fda983-1209-4975-966b-5a7ca702f455 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:17.017221 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fda983-1209-4975-966b-5a7ca702f455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:17.019113 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fda983-1209-4975-966b-5a7ca702f455 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:17.056350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 877/1739] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:16 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:17.057095 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fda983-1209-4975-966b-5a7ca702f455 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:17.066609 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9b8f8-89c2-4ddc-865f-9b68a2ae82ba None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:17.150705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e7637-72e9-4a94-ba11-6246c99f126a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:17.151053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fda983-1209-4975-966b-5a7ca702f455 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:17.151337 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e7637-72e9-4a94-ba11-6246c99f126a service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:17.151642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e7637-72e9-4a94-ba11-6246c99f126a service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:17.151970 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e7637-72e9-4a94-ba11-6246c99f126a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:17.155197 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5e051-2f9c-47fa-b88d-4cf0c34c7a03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:17.155921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5e051-2f9c-47fa-b88d-4cf0c34c7a03 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:17.156205 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5e051-2f9c-47fa-b88d-4cf0c34c7a03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:17.156477 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5e051-2f9c-47fa-b88d-4cf0c34c7a03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:17.279596 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:17.290621 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5e051-2f9c-47fa-b88d-4cf0c34c7a03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:17.294419 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e7637-72e9-4a94-ba11-6246c99f126a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:17.296753 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e7637-72e9-4a94-ba11-6246c99f126a service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:17.297218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5e051-2f9c-47fa-b88d-4cf0c34c7a03 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:17.316237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 863/1740] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:17.316954 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e7637-72e9-4a94-ba11-6246c99f126a service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:17.330241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e7637-72e9-4a94-ba11-6246c99f126a service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:17.331403 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 878/1741] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:17.337964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915cb583-434c-4070-997b-f7abbc4e681d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:17.338599 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915cb583-434c-4070-997b-f7abbc4e681d admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:17.338884 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915cb583-434c-4070-997b-f7abbc4e681d admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:17.339160 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915cb583-434c-4070-997b-f7abbc4e681d admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:17.340168 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915cb583-434c-4070-997b-f7abbc4e681d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:17.342495 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915cb583-434c-4070-997b-f7abbc4e681d admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:17.382617 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 864/1742] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:17 2022] POST /identity/v3/users => generated 289 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:17.384772 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5e051-2f9c-47fa-b88d-4cf0c34c7a03 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:17.401215 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5e051-2f9c-47fa-b88d-4cf0c34c7a03 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:17.406509 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1dfc3d-b1c7-4737-98f9-712264598f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:17.407303 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1dfc3d-b1c7-4737-98f9-712264598f5e admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:17.407729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1dfc3d-b1c7-4737-98f9-712264598f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:17.408008 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1dfc3d-b1c7-4737-98f9-712264598f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:17.409037 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1dfc3d-b1c7-4737-98f9-712264598f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:17.412776 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1dfc3d-b1c7-4737-98f9-712264598f5e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:17.435171 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915cb583-434c-4070-997b-f7abbc4e681d admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:17.443655 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 879/1743] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:14:17.457123 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915cb583-434c-4070-997b-f7abbc4e681d admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:17.463557 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9f236-fe33-41d7-b1d1-de61c902f034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:17.464230 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9f236-fe33-41d7-b1d1-de61c902f034 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:17.464445 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9f236-fe33-41d7-b1d1-de61c902f034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:17.464721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9f236-fe33-41d7-b1d1-de61c902f034 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:17.465366 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9f236-fe33-41d7-b1d1-de61c902f034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:17.467184 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9f236-fe33-41d7-b1d1-de61c902f034 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:17.484715 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 865/1744] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:14:17.485152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1dfc3d-b1c7-4737-98f9-712264598f5e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:17.503380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1dfc3d-b1c7-4737-98f9-712264598f5e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:17.512953 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b39947-f2b4-4fd1-a455-a9d0955f01d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:17.514162 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b39947-f2b4-4fd1-a455-a9d0955f01d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:17.514587 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b39947-f2b4-4fd1-a455-a9d0955f01d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:17.514870 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b39947-f2b4-4fd1-a455-a9d0955f01d3 admin admin] PATH_INFO: `/v3/projects/63bd524653c841c5a19907db8826e80f/users/5d60ac83db2249049ca276cb21f14bd9/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:17.532202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b39947-f2b4-4fd1-a455-a9d0955f01d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63bd524653c841c5a19907db8826e80f, user_id=5d60ac83db2249049ca276cb21f14bd9, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:17.535142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b39947-f2b4-4fd1-a455-a9d0955f01d3 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:17.559267 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 880/1745] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:17 2022] PUT /identity/v3/projects/63bd524653c841c5a19907db8826e80f/users/5d60ac83db2249049ca276cb21f14bd9/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:17.571304 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ba241-a860-4e09-a08f-aafb9f2c82ee None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:17.571620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ba241-a860-4e09-a08f-aafb9f2c82ee None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:17.571896 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ba241-a860-4e09-a08f-aafb9f2c82ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:17.604338 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-781ba241-a860-4e09-a08f-aafb9f2c82ee None None] MFA Rules not processed for user `5d60ac83db2249049ca276cb21f14bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:17.605860 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-781ba241-a860-4e09-a08f-aafb9f2c82ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:17.653599 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:17.683881 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 866/1746] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:14:17.688117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b39947-f2b4-4fd1-a455-a9d0955f01d3 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:17.770600 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b39947-f2b4-4fd1-a455-a9d0955f01d3 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:17.776123 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d52db-130d-475a-ad70-ff9fef1e2a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:17.776897 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d52db-130d-475a-ad70-ff9fef1e2a9f admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:17.777218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d52db-130d-475a-ad70-ff9fef1e2a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:17.777499 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d52db-130d-475a-ad70-ff9fef1e2a9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:17.778151 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d52db-130d-475a-ad70-ff9fef1e2a9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:17.780092 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d52db-130d-475a-ad70-ff9fef1e2a9f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:17.788672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ba241-a860-4e09-a08f-aafb9f2c82ee None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:17.791015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-781ba241-a860-4e09-a08f-aafb9f2c82ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:17.830361 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ba241-a860-4e09-a08f-aafb9f2c82ee None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:17.838188 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb2553-86d7-4547-87e8-84eaa0c4f33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:17.839144 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb2553-86d7-4547-87e8-84eaa0c4f33b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:17.839602 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb2553-86d7-4547-87e8-84eaa0c4f33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:17.839961 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb2553-86d7-4547-87e8-84eaa0c4f33b admin admin] PATH_INFO: `/v3/projects/0a077ef759f34b3f9bd19d1264448c59` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:17.841502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb2553-86d7-4547-87e8-84eaa0c4f33b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a077ef759f34b3f9bd19d1264448c59)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:17.843820 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb2553-86d7-4547-87e8-84eaa0c4f33b admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:17.848478 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 881/1747] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:17 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:17.852864 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d52db-130d-475a-ad70-ff9fef1e2a9f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:17.922344 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-3acb2553-86d7-4547-87e8-84eaa0c4f33b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a077ef759f34b3f9bd19d1264448c59', 'request_id': 'req-3acb2553-86d7-4547-87e8-84eaa0c4f33b'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:17.932557 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-3acb2553-86d7-4547-87e8-84eaa0c4f33b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a077ef759f34b3f9bd19d1264448c59', 'request_id': 'req-3acb2553-86d7-4547-87e8-84eaa0c4f33b'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:17.942832 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d52db-130d-475a-ad70-ff9fef1e2a9f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:17.944457 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-3acb2553-86d7-4547-87e8-84eaa0c4f33b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a077ef759f34b3f9bd19d1264448c59', 'request_id': 'req-3acb2553-86d7-4547-87e8-84eaa0c4f33b'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:17.973139 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-3acb2553-86d7-4547-87e8-84eaa0c4f33b admin admin] The token cache is being invalidate because project 0a077ef759f34b3f9bd19d1264448c59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:17.973742 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-3acb2553-86d7-4547-87e8-84eaa0c4f33b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:17.974262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-3acb2553-86d7-4547-87e8-84eaa0c4f33b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:17.980334 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 867/1748] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:17 2022] DELETE /identity/v3/projects/0a077ef759f34b3f9bd19d1264448c59 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:17.981881 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8ae84-8b86-46b8-a196-65f0f64b83c5 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:17.982147 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8ae84-8b86-46b8-a196-65f0f64b83c5 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:17.982417 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8ae84-8b86-46b8-a196-65f0f64b83c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:18.005575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:18.006863 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-a4e8ae84-8b86-46b8-a196-65f0f64b83c5 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:18.008494 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-a4e8ae84-8b86-46b8-a196-65f0f64b83c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:18.021436 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdb52c-25a9-40ad-a9b3-06e89f0b722e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:18.022355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdb52c-25a9-40ad-a9b3-06e89f0b722e admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:18.023131 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdb52c-25a9-40ad-a9b3-06e89f0b722e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:18.024827 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdb52c-25a9-40ad-a9b3-06e89f0b722e admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:18.026676 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdb52c-25a9-40ad-a9b3-06e89f0b722e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:18.029827 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdb52c-25a9-40ad-a9b3-06e89f0b722e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:18.068765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 882/1749] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:17 2022] POST /identity/v3/users => generated 295 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:18.073030 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdb52c-25a9-40ad-a9b3-06e89f0b722e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:18.077013 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d9fdb52c-25a9-40ad-a9b3-06e89f0b722e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:18.096971 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdb52c-25a9-40ad-a9b3-06e89f0b722e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:18.108923 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcf748-9b89-4022-ae68-874979ace663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:18.111780 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcf748-9b89-4022-ae68-874979ace663 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:18.112156 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcf748-9b89-4022-ae68-874979ace663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:18.113069 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcf748-9b89-4022-ae68-874979ace663 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:18.114566 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcf748-9b89-4022-ae68-874979ace663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:18.116476 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcf748-9b89-4022-ae68-874979ace663 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:18.130995 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 883/1750] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:18.132227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcf748-9b89-4022-ae68-874979ace663 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:18.134455 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-efdcf748-9b89-4022-ae68-874979ace663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:18.149927 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcf748-9b89-4022-ae68-874979ace663 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:18.155408 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e9710-80d2-499c-b2f7-dc3b31f9853a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:18.156158 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e9710-80d2-499c-b2f7-dc3b31f9853a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:18.156524 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e9710-80d2-499c-b2f7-dc3b31f9853a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:18.156859 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e9710-80d2-499c-b2f7-dc3b31f9853a admin admin] PATH_INFO: `/v3/projects/bddace4635d244c39cf7c3bb37cbdeab` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:18.158140 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e9710-80d2-499c-b2f7-dc3b31f9853a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bddace4635d244c39cf7c3bb37cbdeab)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:18.161171 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e9710-80d2-499c-b2f7-dc3b31f9853a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:18.192824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 868/1751] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:18.199206 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8ae84-8b86-46b8-a196-65f0f64b83c5 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:18.214596 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8ae84-8b86-46b8-a196-65f0f64b83c5 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:18.220891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6215d91-3f87-48a8-b2b8-5fc798b01fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:18.221574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6215d91-3f87-48a8-b2b8-5fc798b01fed admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:18.221858 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6215d91-3f87-48a8-b2b8-5fc798b01fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:18.222134 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6215d91-3f87-48a8-b2b8-5fc798b01fed admin admin] PATH_INFO: `/v3/projects/9c4b9262501c4a239c45cec859a8b815/users/c770accbff4347afb85fcfeed6ce4f75/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:18.242432 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6215d91-3f87-48a8-b2b8-5fc798b01fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4b9262501c4a239c45cec859a8b815, user_id=c770accbff4347afb85fcfeed6ce4f75, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:18.245465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6215d91-3f87-48a8-b2b8-5fc798b01fed admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:18.265935 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-129e9710-80d2-499c-b2f7-dc3b31f9853a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bddace4635d244c39cf7c3bb37cbdeab', 'request_id': 'req-129e9710-80d2-499c-b2f7-dc3b31f9853a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:18.277132 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-129e9710-80d2-499c-b2f7-dc3b31f9853a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bddace4635d244c39cf7c3bb37cbdeab', 'request_id': 'req-129e9710-80d2-499c-b2f7-dc3b31f9853a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:18.285746 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-129e9710-80d2-499c-b2f7-dc3b31f9853a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bddace4635d244c39cf7c3bb37cbdeab', 'request_id': 'req-129e9710-80d2-499c-b2f7-dc3b31f9853a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:18.286300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 869/1752] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:18 2022] PUT /identity/v3/projects/9c4b9262501c4a239c45cec859a8b815/users/c770accbff4347afb85fcfeed6ce4f75/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:18.287834 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec07a02-2321-4ae5-954f-0fd2e04cc132 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:18.288124 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec07a02-2321-4ae5-954f-0fd2e04cc132 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:18.288479 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec07a02-2321-4ae5-954f-0fd2e04cc132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:18.303270 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-129e9710-80d2-499c-b2f7-dc3b31f9853a admin admin] The token cache is being invalidate because project bddace4635d244c39cf7c3bb37cbdeab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:18.303599 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-129e9710-80d2-499c-b2f7-dc3b31f9853a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:18.304291 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-129e9710-80d2-499c-b2f7-dc3b31f9853a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:18.306595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 884/1753] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:18 2022] DELETE /identity/v3/projects/bddace4635d244c39cf7c3bb37cbdeab => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:18.307699 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e9710-80d2-499c-b2f7-dc3b31f9853a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:18.309580 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-129e9710-80d2-499c-b2f7-dc3b31f9853a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:18.312764 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-0ec07a02-2321-4ae5-954f-0fd2e04cc132 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:18.314284 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-0ec07a02-2321-4ae5-954f-0fd2e04cc132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:18.367209 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:18.395149 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e9710-80d2-499c-b2f7-dc3b31f9853a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:18.410357 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 870/1754] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:18.411399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec07a02-2321-4ae5-954f-0fd2e04cc132 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:18.412753 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-0ec07a02-2321-4ae5-954f-0fd2e04cc132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:18.425658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec07a02-2321-4ae5-954f-0fd2e04cc132 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:18.431082 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6243a-0005-4613-bbbc-66affe1c3db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:18.431776 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6243a-0005-4613-bbbc-66affe1c3db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:18.432060 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6243a-0005-4613-bbbc-66affe1c3db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:18.432331 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6243a-0005-4613-bbbc-66affe1c3db4 admin admin] PATH_INFO: `/v3/users/9332138695c34499a544e846d0a67137` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:18.433503 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da6243a-0005-4613-bbbc-66affe1c3db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9332138695c34499a544e846d0a67137)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:18.435499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da6243a-0005-4613-bbbc-66affe1c3db4 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:18.477343 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22498f1c-101d-4e60-b019-62c0fb8fea4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:18.478083 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22498f1c-101d-4e60-b019-62c0fb8fea4a admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:18.478521 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22498f1c-101d-4e60-b019-62c0fb8fea4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:18.478833 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22498f1c-101d-4e60-b019-62c0fb8fea4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:18.479638 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22498f1c-101d-4e60-b019-62c0fb8fea4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:18.483825 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22498f1c-101d-4e60-b019-62c0fb8fea4a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:18.487758 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:18.502918 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 885/1755] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:18.504172 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22498f1c-101d-4e60-b019-62c0fb8fea4a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:18.519066 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22498f1c-101d-4e60-b019-62c0fb8fea4a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:18.525833 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2da6243a-0005-4613-bbbc-66affe1c3db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9332138695c34499a544e846d0a67137'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:18.533333 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9cfd8-3bb9-4c7d-9147-f801407acd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:18.539747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9cfd8-3bb9-4c7d-9147-f801407acd4f admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:18.540468 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9cfd8-3bb9-4c7d-9147-f801407acd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:18.541640 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9cfd8-3bb9-4c7d-9147-f801407acd4f admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:18.542492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9cfd8-3bb9-4c7d-9147-f801407acd4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:18.542956 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9cfd8-3bb9-4c7d-9147-f801407acd4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:18.545601 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9cfd8-3bb9-4c7d-9147-f801407acd4f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:18.553030 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2da6243a-0005-4613-bbbc-66affe1c3db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9332138695c34499a544e846d0a67137'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:18.572868 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2da6243a-0005-4613-bbbc-66affe1c3db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9332138695c34499a544e846d0a67137'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:18.577619 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 886/1756] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:14:18.578920 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9cfd8-3bb9-4c7d-9147-f801407acd4f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:18.590978 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9cfd8-3bb9-4c7d-9147-f801407acd4f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:18.595677 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2da6243a-0005-4613-bbbc-66affe1c3db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9332138695c34499a544e846d0a67137'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:18.596444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2da6243a-0005-4613-bbbc-66affe1c3db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9332138695c34499a544e846d0a67137'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:18.600955 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807204a-3d71-4cbe-a8a6-014d00092d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:18.603759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807204a-3d71-4cbe-a8a6-014d00092d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:18.604281 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807204a-3d71-4cbe-a8a6-014d00092d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:18.604929 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807204a-3d71-4cbe-a8a6-014d00092d17 admin admin] PATH_INFO: `/v3/projects/9c4b9262501c4a239c45cec859a8b815/users/c770accbff4347afb85fcfeed6ce4f75/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:18.607278 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807204a-3d71-4cbe-a8a6-014d00092d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4b9262501c4a239c45cec859a8b815, user_id=c770accbff4347afb85fcfeed6ce4f75, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:18.614086 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807204a-3d71-4cbe-a8a6-014d00092d17 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:18.618279 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 871/1757] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:18 2022] DELETE /identity/v3/users/9332138695c34499a544e846d0a67137 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:18.619267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6243a-0005-4613-bbbc-66affe1c3db4 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:18.620735 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-2da6243a-0005-4613-bbbc-66affe1c3db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:18.641179 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 887/1758] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:18 2022] PUT /identity/v3/projects/9c4b9262501c4a239c45cec859a8b815/users/c770accbff4347afb85fcfeed6ce4f75/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:18.643086 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81909b54-ba48-4256-89ff-58290b686940 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:18.643623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81909b54-ba48-4256-89ff-58290b686940 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:18.644129 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81909b54-ba48-4256-89ff-58290b686940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:18.684564 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-81909b54-ba48-4256-89ff-58290b686940 None None] MFA Rules not processed for user `c770accbff4347afb85fcfeed6ce4f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:18.686084 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-81909b54-ba48-4256-89ff-58290b686940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:18.776734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6243a-0005-4613-bbbc-66affe1c3db4 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:18.874947 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc579b-29ae-4175-b0c0-5e9782479ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:18.875734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc579b-29ae-4175-b0c0-5e9782479ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:18.876016 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc579b-29ae-4175-b0c0-5e9782479ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:18.876289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc579b-29ae-4175-b0c0-5e9782479ab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:18.876925 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc579b-29ae-4175-b0c0-5e9782479ab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:18.879120 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc579b-29ae-4175-b0c0-5e9782479ab1 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:18.884307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:18.891255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 888/1759] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:18.914835 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81909b54-ba48-4256-89ff-58290b686940 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:18.919319 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-81909b54-ba48-4256-89ff-58290b686940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:18.937835 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 872/1760] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:18 2022] POST /identity/v3/projects => generated 397 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:18.941675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc579b-29ae-4175-b0c0-5e9782479ab1 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:19.002936 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81909b54-ba48-4256-89ff-58290b686940 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:19.037415 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc579b-29ae-4175-b0c0-5e9782479ab1 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:19.044014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f6f48-18bb-497c-9f67-bdcd74688c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:19.044694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f6f48-18bb-497c-9f67-bdcd74688c75 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:19.045013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f6f48-18bb-497c-9f67-bdcd74688c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:19.045364 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f6f48-18bb-497c-9f67-bdcd74688c75 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:19.046054 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f6f48-18bb-497c-9f67-bdcd74688c75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:19.048060 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f6f48-18bb-497c-9f67-bdcd74688c75 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:19.076649 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 873/1761] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:18 2022] POST /identity/v3/users => generated 299 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:19.077571 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f6f48-18bb-497c-9f67-bdcd74688c75 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:19.083037 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26121b-03ae-4ac1-a876-fcd7b4bf74a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:19.085027 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26121b-03ae-4ac1-a876-fcd7b4bf74a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:19.085596 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26121b-03ae-4ac1-a876-fcd7b4bf74a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:19.086567 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26121b-03ae-4ac1-a876-fcd7b4bf74a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:19.089993 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f6f48-18bb-497c-9f67-bdcd74688c75 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:19.090144 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3f26121b-03ae-4ac1-a876-fcd7b4bf74a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:19.094699 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46673937-9de5-4d25-bc8b-2db23259be62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:19.095126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46673937-9de5-4d25-bc8b-2db23259be62 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:19.095407 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46673937-9de5-4d25-bc8b-2db23259be62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:19.095721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46673937-9de5-4d25-bc8b-2db23259be62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:19.096381 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46673937-9de5-4d25-bc8b-2db23259be62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:19.098276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46673937-9de5-4d25-bc8b-2db23259be62 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:19.113356 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 874/1762] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:19.114367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46673937-9de5-4d25-bc8b-2db23259be62 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:19.131834 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46673937-9de5-4d25-bc8b-2db23259be62 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:19.137502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0e4c1-c236-41d7-a8d5-1906b3bf4f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:19.138039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0e4c1-c236-41d7-a8d5-1906b3bf4f0c admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:19.138737 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0e4c1-c236-41d7-a8d5-1906b3bf4f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:19.139014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0e4c1-c236-41d7-a8d5-1906b3bf4f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:19.139912 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:19.141025 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0e4c1-c236-41d7-a8d5-1906b3bf4f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:19.143160 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0e4c1-c236-41d7-a8d5-1906b3bf4f0c admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:19.160151 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 875/1763] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:14:19.165306 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0e4c1-c236-41d7-a8d5-1906b3bf4f0c admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:19.179477 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0e4c1-c236-41d7-a8d5-1906b3bf4f0c admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:19.187015 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26121b-03ae-4ac1-a876-fcd7b4bf74a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:19.187782 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda1004-0733-45ed-9ad1-0142748a252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:19.188673 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda1004-0733-45ed-9ad1-0142748a252e admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:19.189101 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda1004-0733-45ed-9ad1-0142748a252e admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:19.189520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda1004-0733-45ed-9ad1-0142748a252e admin admin] PATH_INFO: `/v3/projects/70c13ff684954326a4791382a2e39de4/users/2795146016c74f74b4c52b84f13c9aba/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:19.189647 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26121b-03ae-4ac1-a876-fcd7b4bf74a4 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:19.201967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 889/1764] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:19.208057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda1004-0733-45ed-9ad1-0142748a252e admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c13ff684954326a4791382a2e39de4, user_id=2795146016c74f74b4c52b84f13c9aba, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:19.212087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda1004-0733-45ed-9ad1-0142748a252e admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:19.230083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 876/1765] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:19 2022] PUT /identity/v3/projects/70c13ff684954326a4791382a2e39de4/users/2795146016c74f74b4c52b84f13c9aba/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:19.241496 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f363c1f-2250-4b6c-b559-b7372f1b94f8 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:19.241788 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f363c1f-2250-4b6c-b559-b7372f1b94f8 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:19.242231 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f363c1f-2250-4b6c-b559-b7372f1b94f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:19.319389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-7f363c1f-2250-4b6c-b559-b7372f1b94f8 None None] MFA Rules not processed for user `2795146016c74f74b4c52b84f13c9aba`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:19.321334 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7f363c1f-2250-4b6c-b559-b7372f1b94f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:19.398222 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda1004-0733-45ed-9ad1-0142748a252e admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:19.401578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-8dda1004-0733-45ed-9ad1-0142748a252e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:19.429723 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 890/1766] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:19 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:19.444568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f363c1f-2250-4b6c-b559-b7372f1b94f8 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:19.447613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7f363c1f-2250-4b6c-b559-b7372f1b94f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:19.513248 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda1004-0733-45ed-9ad1-0142748a252e admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:19.518469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029f018-157c-4f0b-a017-7ff07c8f1d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:19.519453 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029f018-157c-4f0b-a017-7ff07c8f1d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:19.519620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029f018-157c-4f0b-a017-7ff07c8f1d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:19.519885 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029f018-157c-4f0b-a017-7ff07c8f1d6e admin admin] PATH_INFO: `/v3/projects/110e43a82c424b09a5621b82ef4fdbac` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:19.521097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029f018-157c-4f0b-a017-7ff07c8f1d6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=110e43a82c424b09a5621b82ef4fdbac)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:19.523159 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029f018-157c-4f0b-a017-7ff07c8f1d6e admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:19.548936 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f363c1f-2250-4b6c-b559-b7372f1b94f8 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:19.561369 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc694e-5d10-4e78-8856-6d5902943503 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:19.562458 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc694e-5d10-4e78-8856-6d5902943503 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:19.562953 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc694e-5d10-4e78-8856-6d5902943503 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:19.563404 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc694e-5d10-4e78-8856-6d5902943503 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:19.579914 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:19.582911 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc694e-5d10-4e78-8856-6d5902943503 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:19.584557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc694e-5d10-4e78-8856-6d5902943503 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:19.608558 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c029f018-157c-4f0b-a017-7ff07c8f1d6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '110e43a82c424b09a5621b82ef4fdbac', 'request_id': 'req-c029f018-157c-4f0b-a017-7ff07c8f1d6e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:19.610767 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 891/1767] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:19 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:19.619510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c029f018-157c-4f0b-a017-7ff07c8f1d6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '110e43a82c424b09a5621b82ef4fdbac', 'request_id': 'req-c029f018-157c-4f0b-a017-7ff07c8f1d6e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:19.628215 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c029f018-157c-4f0b-a017-7ff07c8f1d6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '110e43a82c424b09a5621b82ef4fdbac', 'request_id': 'req-c029f018-157c-4f0b-a017-7ff07c8f1d6e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:19.643035 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c029f018-157c-4f0b-a017-7ff07c8f1d6e admin admin] The token cache is being invalidate because project 110e43a82c424b09a5621b82ef4fdbac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:19.643439 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c029f018-157c-4f0b-a017-7ff07c8f1d6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:19.644449 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c029f018-157c-4f0b-a017-7ff07c8f1d6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:19.646740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 877/1768] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:19 2022] DELETE /identity/v3/projects/110e43a82c424b09a5621b82ef4fdbac => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:19.652270 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe3a19-d0a7-4d7b-86fd-718768563ba3 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:19.652614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe3a19-d0a7-4d7b-86fd-718768563ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:19.652892 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe3a19-d0a7-4d7b-86fd-718768563ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:19.681648 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-6efe3a19-d0a7-4d7b-86fd-718768563ba3 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:19.683328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6efe3a19-d0a7-4d7b-86fd-718768563ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:19.810699 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:19.818836 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 892/1769] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:19.827796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd10a4-5eb5-4bee-a5e8-983902b7fcdb None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:19.828115 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd10a4-5eb5-4bee-a5e8-983902b7fcdb None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:19.828532 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd10a4-5eb5-4bee-a5e8-983902b7fcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:19.867493 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-25dd10a4-5eb5-4bee-a5e8-983902b7fcdb None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:19.868918 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-25dd10a4-5eb5-4bee-a5e8-983902b7fcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:19.885927 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 878/1770] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:14:19.895782 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe3a19-d0a7-4d7b-86fd-718768563ba3 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:19.914036 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe3a19-d0a7-4d7b-86fd-718768563ba3 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:19.920318 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abafe2-651c-4fed-a3ae-49b044a47d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:19.920935 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abafe2-651c-4fed-a3ae-49b044a47d6e admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:19.921212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abafe2-651c-4fed-a3ae-49b044a47d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:19.921481 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abafe2-651c-4fed-a3ae-49b044a47d6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:19.922172 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abafe2-651c-4fed-a3ae-49b044a47d6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:19.922599 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abafe2-651c-4fed-a3ae-49b044a47d6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:19.924385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abafe2-651c-4fed-a3ae-49b044a47d6e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:19.937482 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 893/1771] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:14:19.941829 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd10a4-5eb5-4bee-a5e8-983902b7fcdb None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:19.952896 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd10a4-5eb5-4bee-a5e8-983902b7fcdb None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:19.963101 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24e582-bc28-4980-a76d-9efdf1919cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:19.964264 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24e582-bc28-4980-a76d-9efdf1919cad admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:19.964719 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24e582-bc28-4980-a76d-9efdf1919cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:19.965288 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24e582-bc28-4980-a76d-9efdf1919cad admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:19.965941 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24e582-bc28-4980-a76d-9efdf1919cad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:19.968043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24e582-bc28-4980-a76d-9efdf1919cad admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:19.981897 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abafe2-651c-4fed-a3ae-49b044a47d6e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:19.984042 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-19abafe2-651c-4fed-a3ae-49b044a47d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:20.004835 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abafe2-651c-4fed-a3ae-49b044a47d6e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:20.014699 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372fb13-1745-40c5-8bb0-d1874d88213a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:20.017928 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372fb13-1745-40c5-8bb0-d1874d88213a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:20.018219 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372fb13-1745-40c5-8bb0-d1874d88213a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:20.018509 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372fb13-1745-40c5-8bb0-d1874d88213a admin admin] PATH_INFO: `/v3/users/ee6bc00495ae431ba92be399077b709b` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:20.019765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372fb13-1745-40c5-8bb0-d1874d88213a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee6bc00495ae431ba92be399077b709b)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:20.022011 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372fb13-1745-40c5-8bb0-d1874d88213a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:20.029460 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 879/1772] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:19 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:20.031057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24e582-bc28-4980-a76d-9efdf1919cad admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:20.097821 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3372fb13-1745-40c5-8bb0-d1874d88213a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee6bc00495ae431ba92be399077b709b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:20.108817 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3372fb13-1745-40c5-8bb0-d1874d88213a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee6bc00495ae431ba92be399077b709b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:20.125391 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24e582-bc28-4980-a76d-9efdf1919cad admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:20.131883 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3372fb13-1745-40c5-8bb0-d1874d88213a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee6bc00495ae431ba92be399077b709b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:20.134186 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea761961-8f65-4d2e-8258-a9bcf75a20e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:20.134920 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea761961-8f65-4d2e-8258-a9bcf75a20e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:20.135076 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea761961-8f65-4d2e-8258-a9bcf75a20e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:20.135471 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea761961-8f65-4d2e-8258-a9bcf75a20e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:20.136114 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea761961-8f65-4d2e-8258-a9bcf75a20e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:20.138276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea761961-8f65-4d2e-8258-a9bcf75a20e9 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:20.145573 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3372fb13-1745-40c5-8bb0-d1874d88213a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee6bc00495ae431ba92be399077b709b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:20.146987 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3372fb13-1745-40c5-8bb0-d1874d88213a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee6bc00495ae431ba92be399077b709b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:20.156817 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 894/1773] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:19 2022] DELETE /identity/v3/users/ee6bc00495ae431ba92be399077b709b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:20.173688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 880/1774] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:20 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:20.177695 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372fb13-1745-40c5-8bb0-d1874d88213a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:20.179160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3372fb13-1745-40c5-8bb0-d1874d88213a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:20.296067 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372fb13-1745-40c5-8bb0-d1874d88213a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:20.296067 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783d57e-a2ca-442e-9454-8eda1fb2b5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:20.296067 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783d57e-a2ca-442e-9454-8eda1fb2b5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:20.296067 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783d57e-a2ca-442e-9454-8eda1fb2b5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:20.296889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783d57e-a2ca-442e-9454-8eda1fb2b5b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:20.296889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783d57e-a2ca-442e-9454-8eda1fb2b5b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:20.296889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783d57e-a2ca-442e-9454-8eda1fb2b5b2 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:20.315274 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 895/1775] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:20.321198 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea761961-8f65-4d2e-8258-a9bcf75a20e9 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:20.346409 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea761961-8f65-4d2e-8258-a9bcf75a20e9 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:20.351801 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6ec72-dc13-4d7f-ac58-496501c112ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:20.353238 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6ec72-dc13-4d7f-ac58-496501c112ad admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:20.353238 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6ec72-dc13-4d7f-ac58-496501c112ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:20.353238 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6ec72-dc13-4d7f-ac58-496501c112ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:20.354027 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6ec72-dc13-4d7f-ac58-496501c112ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:20.355345 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6ec72-dc13-4d7f-ac58-496501c112ad admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:20.370024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 881/1776] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:20.371738 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783d57e-a2ca-442e-9454-8eda1fb2b5b2 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:20.384536 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783d57e-a2ca-442e-9454-8eda1fb2b5b2 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:20.389580 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6ec72-dc13-4d7f-ac58-496501c112ad admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:20.391357 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-2af6ec72-dc13-4d7f-ac58-496501c112ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:20.393310 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260016c-27a3-4828-bae7-f3458a63b8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:20.394112 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260016c-27a3-4828-bae7-f3458a63b8a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:20.394504 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260016c-27a3-4828-bae7-f3458a63b8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:20.394888 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260016c-27a3-4828-bae7-f3458a63b8a2 admin admin] PATH_INFO: `/v3/projects/caf558d03f2948c785f784d949e8bb91/users/2b648adc88a3454497c478dc6f4f5e0e/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:20.409327 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6ec72-dc13-4d7f-ac58-496501c112ad admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:20.415089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df8f21-b3d5-448a-871c-845d13a76a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:20.416122 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df8f21-b3d5-448a-871c-845d13a76a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:20.416474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df8f21-b3d5-448a-871c-845d13a76a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:20.416952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df8f21-b3d5-448a-871c-845d13a76a4a admin admin] PATH_INFO: `/v3/projects/8f061badb8f146559b21e0a4c9b780d2` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:20.418294 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df8f21-b3d5-448a-871c-845d13a76a4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f061badb8f146559b21e0a4c9b780d2)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:20.420420 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df8f21-b3d5-448a-871c-845d13a76a4a admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:20.424338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260016c-27a3-4828-bae7-f3458a63b8a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf558d03f2948c785f784d949e8bb91, user_id=2b648adc88a3454497c478dc6f4f5e0e, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:20.427344 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260016c-27a3-4828-bae7-f3458a63b8a2 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:20.448428 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 896/1777] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:20 2022] PUT /identity/v3/projects/caf558d03f2948c785f784d949e8bb91/users/2b648adc88a3454497c478dc6f4f5e0e/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:20.461072 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c6bcc-9142-4b47-a652-b030c5a1a71e None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:20.461447 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c6bcc-9142-4b47-a652-b030c5a1a71e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:20.461674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c6bcc-9142-4b47-a652-b030c5a1a71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:20.483035 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-13df8f21-b3d5-448a-871c-845d13a76a4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f061badb8f146559b21e0a4c9b780d2', 'request_id': 'req-13df8f21-b3d5-448a-871c-845d13a76a4a'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:20.495034 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-13df8f21-b3d5-448a-871c-845d13a76a4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f061badb8f146559b21e0a4c9b780d2', 'request_id': 'req-13df8f21-b3d5-448a-871c-845d13a76a4a'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:20.496995 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-ed9c6bcc-9142-4b47-a652-b030c5a1a71e None None] MFA Rules not processed for user `2b648adc88a3454497c478dc6f4f5e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:20.498783 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ed9c6bcc-9142-4b47-a652-b030c5a1a71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:20.501468 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=82,keystone:DELETE=12,keystone:INSERT=6 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:20.505219 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-13df8f21-b3d5-448a-871c-845d13a76a4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f061badb8f146559b21e0a4c9b780d2', 'request_id': 'req-13df8f21-b3d5-448a-871c-845d13a76a4a'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:20.525209 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-13df8f21-b3d5-448a-871c-845d13a76a4a admin admin] The token cache is being invalidate because project 8f061badb8f146559b21e0a4c9b780d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:20.525599 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:20.525760 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-13df8f21-b3d5-448a-871c-845d13a76a4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:20.526453 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-13df8f21-b3d5-448a-871c-845d13a76a4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:20.528528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 882/1778] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:20 2022] DELETE /identity/v3/projects/8f061badb8f146559b21e0a4c9b780d2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:20.534333 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38926c5-63d1-454c-84b1-881cdfe0f8fc None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:20.534660 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38926c5-63d1-454c-84b1-881cdfe0f8fc None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:20.534940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38926c5-63d1-454c-84b1-881cdfe0f8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:20.557473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-c38926c5-63d1-454c-84b1-881cdfe0f8fc None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:20.558687 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-c38926c5-63d1-454c-84b1-881cdfe0f8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:20.619143 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 897/1779] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:20.635042 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c6bcc-9142-4b47-a652-b030c5a1a71e None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:20.636742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ed9c6bcc-9142-4b47-a652-b030c5a1a71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:20.654721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 883/1780] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:14:20.664108 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089561c-123e-4515-bc01-01839ab67872 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:20.664809 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089561c-123e-4515-bc01-01839ab67872 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:20.665166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089561c-123e-4515-bc01-01839ab67872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:20.687117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-f089561c-123e-4515-bc01-01839ab67872 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:20.688942 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f089561c-123e-4515-bc01-01839ab67872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:20.700256 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 884/1781] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:20.704318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089561c-123e-4515-bc01-01839ab67872 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:20.715718 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089561c-123e-4515-bc01-01839ab67872 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:20.720088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c6bcc-9142-4b47-a652-b030c5a1a71e None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:20.720833 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83c427-8cc4-43e0-8185-83a73c8f5de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:20.721441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83c427-8cc4-43e0-8185-83a73c8f5de2 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:20.721883 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83c427-8cc4-43e0-8185-83a73c8f5de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:20.722252 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83c427-8cc4-43e0-8185-83a73c8f5de2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:20.722931 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83c427-8cc4-43e0-8185-83a73c8f5de2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:20.723231 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83c427-8cc4-43e0-8185-83a73c8f5de2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:20.723935 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeaaf9-cfd1-4caf-8366-2744d8f9c288 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:20.724537 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeaaf9-cfd1-4caf-8366-2744d8f9c288 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:20.724814 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeaaf9-cfd1-4caf-8366-2744d8f9c288 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:20.725050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83c427-8cc4-43e0-8185-83a73c8f5de2 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:20.725145 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeaaf9-cfd1-4caf-8366-2744d8f9c288 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:20.734716 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aeaaf9-cfd1-4caf-8366-2744d8f9c288 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:20.736180 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aeaaf9-cfd1-4caf-8366-2744d8f9c288 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:20.738140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 885/1782] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:14:20.742941 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83c427-8cc4-43e0-8185-83a73c8f5de2 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:20.746121 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 898/1783] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:20.752831 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83c427-8cc4-43e0-8185-83a73c8f5de2 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:20.758682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15be394-0da1-4e37-8fc4-ddecff7c6cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:20.759278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15be394-0da1-4e37-8fc4-ddecff7c6cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:20.759588 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15be394-0da1-4e37-8fc4-ddecff7c6cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:20.759863 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15be394-0da1-4e37-8fc4-ddecff7c6cb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:20.760489 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15be394-0da1-4e37-8fc4-ddecff7c6cb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:20.762387 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15be394-0da1-4e37-8fc4-ddecff7c6cb2 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:20.793453 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 886/1784] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:20 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:20.794610 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeaaf9-cfd1-4caf-8366-2744d8f9c288 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:20.806387 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeaaf9-cfd1-4caf-8366-2744d8f9c288 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:20.866203 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f6f0f-6ba2-4078-863f-3fe091c2b01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:20.866809 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f6f0f-6ba2-4078-863f-3fe091c2b01f admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:20.867107 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f6f0f-6ba2-4078-863f-3fe091c2b01f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:20.868022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f6f0f-6ba2-4078-863f-3fe091c2b01f admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:20.868652 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f6f0f-6ba2-4078-863f-3fe091c2b01f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:20.870565 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f6f0f-6ba2-4078-863f-3fe091c2b01f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:20.893925 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 899/1785] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:20 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:20.898920 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15be394-0da1-4e37-8fc4-ddecff7c6cb2 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:20.914789 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15be394-0da1-4e37-8fc4-ddecff7c6cb2 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:20.926055 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1eaf8-fc10-4e4e-9250-2482bf49a1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:20.928347 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1eaf8-fc10-4e4e-9250-2482bf49a1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:20.928675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1eaf8-fc10-4e4e-9250-2482bf49a1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:20.928954 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1eaf8-fc10-4e4e-9250-2482bf49a1c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:20.930625 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1eaf8-fc10-4e4e-9250-2482bf49a1c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:20.933179 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1eaf8-fc10-4e4e-9250-2482bf49a1c3 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:20.946136 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 887/1786] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:14:20.950058 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f6f0f-6ba2-4078-863f-3fe091c2b01f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:20.972088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f6f0f-6ba2-4078-863f-3fe091c2b01f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:20.978455 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63137f8-4301-47cf-b02c-cd6db0b779a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:20.979221 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63137f8-4301-47cf-b02c-cd6db0b779a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:20.979518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63137f8-4301-47cf-b02c-cd6db0b779a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:20.979829 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63137f8-4301-47cf-b02c-cd6db0b779a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:20.980572 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63137f8-4301-47cf-b02c-cd6db0b779a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:20.982328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63137f8-4301-47cf-b02c-cd6db0b779a1 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:20.997876 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 900/1787] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:21.002041 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1eaf8-fc10-4e4e-9250-2482bf49a1c3 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:21.016366 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1eaf8-fc10-4e4e-9250-2482bf49a1c3 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:21.022832 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fad58b-5c6c-4a62-858b-c4e9aeb01792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:21.023852 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fad58b-5c6c-4a62-858b-c4e9aeb01792 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:21.024155 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fad58b-5c6c-4a62-858b-c4e9aeb01792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:21.024502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fad58b-5c6c-4a62-858b-c4e9aeb01792 admin admin] PATH_INFO: `/v3/projects/b719b85531a84eea93d25d263d410b3d/users/579130e1478c4ef09a144167432801c6/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:21.072968 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fad58b-5c6c-4a62-858b-c4e9aeb01792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b719b85531a84eea93d25d263d410b3d, user_id=579130e1478c4ef09a144167432801c6, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:21.076234 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fad58b-5c6c-4a62-858b-c4e9aeb01792 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:21.099442 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 888/1788] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:21 2022] PUT /identity/v3/projects/b719b85531a84eea93d25d263d410b3d/users/579130e1478c4ef09a144167432801c6/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:21.111544 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30dd5f-9563-45b2-8e27-9d1d2f23c7c3 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:21.112055 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30dd5f-9563-45b2-8e27-9d1d2f23c7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:21.112504 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30dd5f-9563-45b2-8e27-9d1d2f23c7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:21.163889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-7b30dd5f-9563-45b2-8e27-9d1d2f23c7c3 None None] MFA Rules not processed for user `579130e1478c4ef09a144167432801c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:21.165702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7b30dd5f-9563-45b2-8e27-9d1d2f23c7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:21.199404 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:21.238276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 901/1789] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:21.249248 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fad58b-5c6c-4a62-858b-c4e9aeb01792 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:21.251061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-26fad58b-5c6c-4a62-858b-c4e9aeb01792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:21.335807 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fad58b-5c6c-4a62-858b-c4e9aeb01792 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:21.342649 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cf87e-b271-4404-bbeb-7016cf93169c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:21.343236 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cf87e-b271-4404-bbeb-7016cf93169c service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:21.343546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cf87e-b271-4404-bbeb-7016cf93169c service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:21.343844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cf87e-b271-4404-bbeb-7016cf93169c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:21.364226 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cf87e-b271-4404-bbeb-7016cf93169c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:21.366119 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cf87e-b271-4404-bbeb-7016cf93169c service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:21.371603 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:21.387789 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 889/1790] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:22.147160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30dd5f-9563-45b2-8e27-9d1d2f23c7c3 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:22.211637 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30dd5f-9563-45b2-8e27-9d1d2f23c7c3 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:22.215926 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f578ba-4e52-4847-a295-c38d6a105a72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:22.216613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f578ba-4e52-4847-a295-c38d6a105a72 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:22.216966 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f578ba-4e52-4847-a295-c38d6a105a72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:22.217606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f578ba-4e52-4847-a295-c38d6a105a72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:22.219573 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b1f578ba-4e52-4847-a295-c38d6a105a72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:22.293061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f578ba-4e52-4847-a295-c38d6a105a72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:22.294541 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f578ba-4e52-4847-a295-c38d6a105a72 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:22.305324 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 902/1791] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:23.938325 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cf87e-b271-4404-bbeb-7016cf93169c service nova] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:23.940048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b47cf87e-b271-4404-bbeb-7016cf93169c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:24.028123 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cf87e-b271-4404-bbeb-7016cf93169c service nova] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:24.032833 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc57ab-3a58-4a9f-8897-7b424fcc6f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:24.033458 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc57ab-3a58-4a9f-8897-7b424fcc6f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:24.033753 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc57ab-3a58-4a9f-8897-7b424fcc6f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:24.034056 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc57ab-3a58-4a9f-8897-7b424fcc6f61 admin admin] PATH_INFO: `/v3/users/2b648adc88a3454497c478dc6f4f5e0e` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:24.035151 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc57ab-3a58-4a9f-8897-7b424fcc6f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b648adc88a3454497c478dc6f4f5e0e)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:24.037143 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc57ab-3a58-4a9f-8897-7b424fcc6f61 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:24.084478 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-9fbc57ab-3a58-4a9f-8897-7b424fcc6f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b648adc88a3454497c478dc6f4f5e0e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:24.091444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-9fbc57ab-3a58-4a9f-8897-7b424fcc6f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b648adc88a3454497c478dc6f4f5e0e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:24.098798 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-9fbc57ab-3a58-4a9f-8897-7b424fcc6f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b648adc88a3454497c478dc6f4f5e0e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:24.111981 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-9fbc57ab-3a58-4a9f-8897-7b424fcc6f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b648adc88a3454497c478dc6f4f5e0e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:24.113003 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-9fbc57ab-3a58-4a9f-8897-7b424fcc6f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b648adc88a3454497c478dc6f4f5e0e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:24.120065 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 890/1792] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:23 2022] DELETE /identity/v3/users/2b648adc88a3454497c478dc6f4f5e0e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:24.124452 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af3e34-170d-4792-a677-b776a245d255 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:24.124920 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af3e34-170d-4792-a677-b776a245d255 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:24.125021 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af3e34-170d-4792-a677-b776a245d255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:24.144951 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d1af3e34-170d-4792-a677-b776a245d255 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:24.146261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d1af3e34-170d-4792-a677-b776a245d255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:24.213852 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 903/1793] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:24.222638 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc57ab-3a58-4a9f-8897-7b424fcc6f61 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:24.224213 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-9fbc57ab-3a58-4a9f-8897-7b424fcc6f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:24.309178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc57ab-3a58-4a9f-8897-7b424fcc6f61 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:24.319473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb798a-af06-4c2f-8a4f-122c3aa79fff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:24.320722 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb798a-af06-4c2f-8a4f-122c3aa79fff service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:24.321113 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb798a-af06-4c2f-8a4f-122c3aa79fff service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:24.321525 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb798a-af06-4c2f-8a4f-122c3aa79fff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:24.332569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb798a-af06-4c2f-8a4f-122c3aa79fff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:24.334319 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb798a-af06-4c2f-8a4f-122c3aa79fff service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:24.345029 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 891/1794] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:24.621215 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af3e34-170d-4792-a677-b776a245d255 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:24.622645 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d1af3e34-170d-4792-a677-b776a245d255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:24.638683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af3e34-170d-4792-a677-b776a245d255 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:24.645963 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b215a-4250-4a0d-ad3f-3270398654db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:24.646822 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b215a-4250-4a0d-ad3f-3270398654db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:24.647402 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b215a-4250-4a0d-ad3f-3270398654db admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:24.647866 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b215a-4250-4a0d-ad3f-3270398654db admin admin] PATH_INFO: `/v3/projects/caf558d03f2948c785f784d949e8bb91` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:24.649956 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b215a-4250-4a0d-ad3f-3270398654db admin admin] RBAC: Authorizing `identity:delete_project(project_id=caf558d03f2948c785f784d949e8bb91)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:24.652164 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b215a-4250-4a0d-ad3f-3270398654db admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:24.671070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:24.702699 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-2e5b215a-4250-4a0d-ad3f-3270398654db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caf558d03f2948c785f784d949e8bb91', 'request_id': 'req-2e5b215a-4250-4a0d-ad3f-3270398654db'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:24.710841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-2e5b215a-4250-4a0d-ad3f-3270398654db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caf558d03f2948c785f784d949e8bb91', 'request_id': 'req-2e5b215a-4250-4a0d-ad3f-3270398654db'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:24.717373 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-2e5b215a-4250-4a0d-ad3f-3270398654db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caf558d03f2948c785f784d949e8bb91', 'request_id': 'req-2e5b215a-4250-4a0d-ad3f-3270398654db'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:24.728836 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-2e5b215a-4250-4a0d-ad3f-3270398654db admin admin] The token cache is being invalidate because project caf558d03f2948c785f784d949e8bb91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:24.729121 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-2e5b215a-4250-4a0d-ad3f-3270398654db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:24.729763 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-2e5b215a-4250-4a0d-ad3f-3270398654db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:24.731262 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 904/1795] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:24 2022] DELETE /identity/v3/projects/caf558d03f2948c785f784d949e8bb91 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:24.736268 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a82201-f859-4f90-baf2-c58e15c1858a None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:24.736561 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a82201-f859-4f90-baf2-c58e15c1858a None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:24.736830 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a82201-f859-4f90-baf2-c58e15c1858a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:24.756494 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-d9a82201-f859-4f90-baf2-c58e15c1858a None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:24.758226 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d9a82201-f859-4f90-baf2-c58e15c1858a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:24.775938 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:24.819226 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 892/1796] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:24.827923 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8585ac2-e229-4947-95e6-b3040e9e5f31 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:24.828225 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8585ac2-e229-4947-95e6-b3040e9e5f31 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:24.828496 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8585ac2-e229-4947-95e6-b3040e9e5f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:24.848666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d8585ac2-e229-4947-95e6-b3040e9e5f31 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:24.849840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d8585ac2-e229-4947-95e6-b3040e9e5f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:24.857638 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 905/1797] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:24.861726 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a82201-f859-4f90-baf2-c58e15c1858a None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:24.871303 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a82201-f859-4f90-baf2-c58e15c1858a None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:24.876021 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce970a-bcc6-40d2-9a35-5b304db05cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:24.876617 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce970a-bcc6-40d2-9a35-5b304db05cea admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:24.876891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce970a-bcc6-40d2-9a35-5b304db05cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:24.877156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce970a-bcc6-40d2-9a35-5b304db05cea admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:24.877791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce970a-bcc6-40d2-9a35-5b304db05cea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:24.878088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce970a-bcc6-40d2-9a35-5b304db05cea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:24.879718 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce970a-bcc6-40d2-9a35-5b304db05cea admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:24.891699 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 893/1798] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:14:24.895904 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8585ac2-e229-4947-95e6-b3040e9e5f31 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:24.905390 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8585ac2-e229-4947-95e6-b3040e9e5f31 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:24.909970 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ca872-548b-46bc-98d2-caa2ed62dc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:24.910550 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ca872-548b-46bc-98d2-caa2ed62dc57 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:24.910838 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ca872-548b-46bc-98d2-caa2ed62dc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:24.911090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ca872-548b-46bc-98d2-caa2ed62dc57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:24.911768 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ca872-548b-46bc-98d2-caa2ed62dc57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:24.913651 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ca872-548b-46bc-98d2-caa2ed62dc57 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:24.940430 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 906/1799] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:24 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:24.944548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce970a-bcc6-40d2-9a35-5b304db05cea admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:24.956445 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce970a-bcc6-40d2-9a35-5b304db05cea admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:25.016500 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13cf75-bf3f-49c6-b690-cbda810348a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:25.017113 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13cf75-bf3f-49c6-b690-cbda810348a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:25.017393 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13cf75-bf3f-49c6-b690-cbda810348a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:25.017665 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13cf75-bf3f-49c6-b690-cbda810348a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:25.018294 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13cf75-bf3f-49c6-b690-cbda810348a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:25.020777 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13cf75-bf3f-49c6-b690-cbda810348a9 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:25.036793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ca872-548b-46bc-98d2-caa2ed62dc57 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:25.039617 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4b4ca872-548b-46bc-98d2-caa2ed62dc57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:25.042709 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 894/1800] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:24 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:25.046716 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13cf75-bf3f-49c6-b690-cbda810348a9 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:25.054210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ca872-548b-46bc-98d2-caa2ed62dc57 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:25.059744 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13cf75-bf3f-49c6-b690-cbda810348a9 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:25.059873 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608f95a-6a1a-4a6b-89b4-2952e888fac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:25.060540 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608f95a-6a1a-4a6b-89b4-2952e888fac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:25.060825 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608f95a-6a1a-4a6b-89b4-2952e888fac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:25.061096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608f95a-6a1a-4a6b-89b4-2952e888fac2 admin admin] PATH_INFO: `/v3/users/2795146016c74f74b4c52b84f13c9aba` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:25.062203 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608f95a-6a1a-4a6b-89b4-2952e888fac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2795146016c74f74b4c52b84f13c9aba)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:25.064208 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608f95a-6a1a-4a6b-89b4-2952e888fac2 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:25.065082 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a77533-663d-4f20-b281-be8001e0f518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:25.065790 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a77533-663d-4f20-b281-be8001e0f518 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:25.066137 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a77533-663d-4f20-b281-be8001e0f518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:25.066518 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a77533-663d-4f20-b281-be8001e0f518 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:25.067320 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a77533-663d-4f20-b281-be8001e0f518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:25.069171 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a77533-663d-4f20-b281-be8001e0f518 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:25.085187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 895/1801] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:14:25.086506 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a77533-663d-4f20-b281-be8001e0f518 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:25.097370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a77533-663d-4f20-b281-be8001e0f518 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:25.106158 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe8ff2-d122-4c60-a78b-da0206db0e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:25.109118 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe8ff2-d122-4c60-a78b-da0206db0e3e admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:25.109406 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe8ff2-d122-4c60-a78b-da0206db0e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:25.109669 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe8ff2-d122-4c60-a78b-da0206db0e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:25.110320 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe8ff2-d122-4c60-a78b-da0206db0e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:25.111948 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe8ff2-d122-4c60-a78b-da0206db0e3e admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:25.123242 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 896/1802] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:25.127200 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe8ff2-d122-4c60-a78b-da0206db0e3e admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:25.128831 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d608f95a-6a1a-4a6b-89b4-2952e888fac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2795146016c74f74b4c52b84f13c9aba'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:25.138528 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d608f95a-6a1a-4a6b-89b4-2952e888fac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2795146016c74f74b4c52b84f13c9aba'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:25.141104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe8ff2-d122-4c60-a78b-da0206db0e3e admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:25.146045 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067aaef-5c2a-4eb6-83df-565808843218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:25.146697 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067aaef-5c2a-4eb6-83df-565808843218 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:25.147070 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067aaef-5c2a-4eb6-83df-565808843218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:25.147239 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067aaef-5c2a-4eb6-83df-565808843218 admin admin] PATH_INFO: `/v3/projects/b19ca135ce804b4dbe2717308cc9497a/users/297eccc7c02443e8bd2b98cfaad3b1fc/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:25.154016 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d608f95a-6a1a-4a6b-89b4-2952e888fac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2795146016c74f74b4c52b84f13c9aba'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:25.166851 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067aaef-5c2a-4eb6-83df-565808843218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19ca135ce804b4dbe2717308cc9497a, user_id=297eccc7c02443e8bd2b98cfaad3b1fc, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:25.167605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d608f95a-6a1a-4a6b-89b4-2952e888fac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2795146016c74f74b4c52b84f13c9aba'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:25.168237 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d608f95a-6a1a-4a6b-89b4-2952e888fac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2795146016c74f74b4c52b84f13c9aba'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:25.169935 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067aaef-5c2a-4eb6-83df-565808843218 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:25.176408 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 907/1803] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:25 2022] DELETE /identity/v3/users/2795146016c74f74b4c52b84f13c9aba => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:25.182284 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11b6a6-1b8a-4ed8-ac21-7da06e97fd15 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:25.182552 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11b6a6-1b8a-4ed8-ac21-7da06e97fd15 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:25.182821 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11b6a6-1b8a-4ed8-ac21-7da06e97fd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:25.191812 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 897/1804] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:25 2022] PUT /identity/v3/projects/b19ca135ce804b4dbe2717308cc9497a/users/297eccc7c02443e8bd2b98cfaad3b1fc/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:25.197457 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfa3dd-1cd5-43a1-ab75-9e6ff2b854bf None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:25.197896 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfa3dd-1cd5-43a1-ab75-9e6ff2b854bf None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:25.198173 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfa3dd-1cd5-43a1-ab75-9e6ff2b854bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:25.204495 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-3c11b6a6-1b8a-4ed8-ac21-7da06e97fd15 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:25.205718 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3c11b6a6-1b8a-4ed8-ac21-7da06e97fd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:25.220633 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-3bbfa3dd-1cd5-43a1-ab75-9e6ff2b854bf None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:25.222497 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-3bbfa3dd-1cd5-43a1-ab75-9e6ff2b854bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:25.260669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:25.277635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:25.281076 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 908/1805] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:25.296415 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 898/1806] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:14:25.297580 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11b6a6-1b8a-4ed8-ac21-7da06e97fd15 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:25.302252 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3c11b6a6-1b8a-4ed8-ac21-7da06e97fd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:25.308890 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbfa3dd-1cd5-43a1-ab75-9e6ff2b854bf None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:25.310886 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-3bbfa3dd-1cd5-43a1-ab75-9e6ff2b854bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:25.377299 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11b6a6-1b8a-4ed8-ac21-7da06e97fd15 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:25.381034 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc757e-50b1-4818-9914-583a2222682d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:25.381642 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc757e-50b1-4818-9914-583a2222682d service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:25.381922 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc757e-50b1-4818-9914-583a2222682d service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:25.382213 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc757e-50b1-4818-9914-583a2222682d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:25.385329 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbfa3dd-1cd5-43a1-ab75-9e6ff2b854bf None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:25.389491 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37afd16-5a03-4392-ba38-3a2911af2803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:25.390208 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37afd16-5a03-4392-ba38-3a2911af2803 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:25.390551 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37afd16-5a03-4392-ba38-3a2911af2803 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:25.390905 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37afd16-5a03-4392-ba38-3a2911af2803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:25.392634 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc757e-50b1-4818-9914-583a2222682d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:25.394170 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc757e-50b1-4818-9914-583a2222682d service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:25.404769 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37afd16-5a03-4392-ba38-3a2911af2803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:25.405029 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 909/1807] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:25.406604 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37afd16-5a03-4392-ba38-3a2911af2803 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:25.418053 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 899/1808] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:14:26.041164 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc757e-50b1-4818-9914-583a2222682d service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:26.042617 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-43cc757e-50b1-4818-9914-583a2222682d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:26.062988 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc757e-50b1-4818-9914-583a2222682d service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:26.069652 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe73f6-e3b6-471a-ac2b-8fd7971ec6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:26.071585 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe73f6-e3b6-471a-ac2b-8fd7971ec6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:26.071865 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe73f6-e3b6-471a-ac2b-8fd7971ec6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:26.072261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe73f6-e3b6-471a-ac2b-8fd7971ec6b8 admin admin] PATH_INFO: `/v3/projects/70c13ff684954326a4791382a2e39de4` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:26.073495 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe73f6-e3b6-471a-ac2b-8fd7971ec6b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c13ff684954326a4791382a2e39de4)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:26.076486 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe73f6-e3b6-471a-ac2b-8fd7971ec6b8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:26.141304 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ebbe73f6-e3b6-471a-ac2b-8fd7971ec6b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c13ff684954326a4791382a2e39de4', 'request_id': 'req-ebbe73f6-e3b6-471a-ac2b-8fd7971ec6b8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:26.149447 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ebbe73f6-e3b6-471a-ac2b-8fd7971ec6b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c13ff684954326a4791382a2e39de4', 'request_id': 'req-ebbe73f6-e3b6-471a-ac2b-8fd7971ec6b8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:26.157062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ebbe73f6-e3b6-471a-ac2b-8fd7971ec6b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c13ff684954326a4791382a2e39de4', 'request_id': 'req-ebbe73f6-e3b6-471a-ac2b-8fd7971ec6b8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:26.169102 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ebbe73f6-e3b6-471a-ac2b-8fd7971ec6b8 admin admin] The token cache is being invalidate because project 70c13ff684954326a4791382a2e39de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:26.169387 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ebbe73f6-e3b6-471a-ac2b-8fd7971ec6b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:26.170031 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ebbe73f6-e3b6-471a-ac2b-8fd7971ec6b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:26.171545 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 910/1809] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:26 2022] DELETE /identity/v3/projects/70c13ff684954326a4791382a2e39de4 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:26.176642 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269245fa-e1aa-45af-a0b9-b11c715b118e None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:26.177100 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269245fa-e1aa-45af-a0b9-b11c715b118e None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:26.177176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269245fa-e1aa-45af-a0b9-b11c715b118e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:26.196669 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-269245fa-e1aa-45af-a0b9-b11c715b118e None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:26.197926 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-269245fa-e1aa-45af-a0b9-b11c715b118e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:26.259400 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 900/1810] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:26.267142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67020a48-246d-4128-9341-cc05a309f89b None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:26.267473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67020a48-246d-4128-9341-cc05a309f89b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:26.267753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67020a48-246d-4128-9341-cc05a309f89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:26.287796 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-67020a48-246d-4128-9341-cc05a309f89b None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:26.289443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-67020a48-246d-4128-9341-cc05a309f89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:26.297420 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 911/1811] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:26.301747 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269245fa-e1aa-45af-a0b9-b11c715b118e None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:26.312036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269245fa-e1aa-45af-a0b9-b11c715b118e None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:26.317707 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21ebd5-ee56-4e23-9a59-5902f604e048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:26.318556 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21ebd5-ee56-4e23-9a59-5902f604e048 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:26.318855 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21ebd5-ee56-4e23-9a59-5902f604e048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:26.319266 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21ebd5-ee56-4e23-9a59-5902f604e048 admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:26.319946 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21ebd5-ee56-4e23-9a59-5902f604e048 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:26.320419 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21ebd5-ee56-4e23-9a59-5902f604e048 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:26.322122 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21ebd5-ee56-4e23-9a59-5902f604e048 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:26.335364 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 901/1812] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:14:26.340279 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67020a48-246d-4128-9341-cc05a309f89b None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:26.349875 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67020a48-246d-4128-9341-cc05a309f89b None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:26.356631 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b2452-cb74-4424-9160-956447b62065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:26.357255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b2452-cb74-4424-9160-956447b62065 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:26.357606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b2452-cb74-4424-9160-956447b62065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:26.357859 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b2452-cb74-4424-9160-956447b62065 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:26.358527 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b2452-cb74-4424-9160-956447b62065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:26.360485 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b2452-cb74-4424-9160-956447b62065 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:26.417160 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d29b41-e946-4150-840d-6cb14212f51a None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:26.417497 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d29b41-e946-4150-840d-6cb14212f51a None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:26.417770 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d29b41-e946-4150-840d-6cb14212f51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:26.420311 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 912/1813] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:26 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:26.423348 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b2452-cb74-4424-9160-956447b62065 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:26.454769 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-31d29b41-e946-4150-840d-6cb14212f51a None None] MFA Rules not processed for user `297eccc7c02443e8bd2b98cfaad3b1fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:26.456085 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-31d29b41-e946-4150-840d-6cb14212f51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:26.508935 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:26.534623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b2452-cb74-4424-9160-956447b62065 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:26.545312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 902/1814] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:26.559307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d29b41-e946-4150-840d-6cb14212f51a None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:26.562014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-31d29b41-e946-4150-840d-6cb14212f51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:26.562133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980e243-1281-48c7-a2b1-2c60cf1f2571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:26.563009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980e243-1281-48c7-a2b1-2c60cf1f2571 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:26.563405 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980e243-1281-48c7-a2b1-2c60cf1f2571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:26.564837 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980e243-1281-48c7-a2b1-2c60cf1f2571 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:26.565644 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980e243-1281-48c7-a2b1-2c60cf1f2571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:26.567792 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980e243-1281-48c7-a2b1-2c60cf1f2571 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:26.580791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:26.596346 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 913/1815] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:26 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:26.600285 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980e243-1281-48c7-a2b1-2c60cf1f2571 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:26.615218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980e243-1281-48c7-a2b1-2c60cf1f2571 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:26.622183 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04310f58-03c5-4294-8aa9-8664e886726d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:26.622933 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04310f58-03c5-4294-8aa9-8664e886726d admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:26.623390 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04310f58-03c5-4294-8aa9-8664e886726d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:26.623805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04310f58-03c5-4294-8aa9-8664e886726d admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:26.624557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04310f58-03c5-4294-8aa9-8664e886726d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:26.626389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04310f58-03c5-4294-8aa9-8664e886726d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:26.637927 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d29b41-e946-4150-840d-6cb14212f51a None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:26.643275 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 914/1816] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:14:26.644644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865ad85-05a2-4a84-82d0-ad937a7a60f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:26.645399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865ad85-05a2-4a84-82d0-ad937a7a60f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:26.645684 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865ad85-05a2-4a84-82d0-ad937a7a60f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:26.646034 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865ad85-05a2-4a84-82d0-ad937a7a60f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:26.647782 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04310f58-03c5-4294-8aa9-8664e886726d admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:26.660103 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865ad85-05a2-4a84-82d0-ad937a7a60f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:26.664316 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865ad85-05a2-4a84-82d0-ad937a7a60f2 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:26.673184 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04310f58-03c5-4294-8aa9-8664e886726d admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:26.678752 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4a9a8-4a66-4e9b-a7c5-b9c02ab3701e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:26.680111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4a9a8-4a66-4e9b-a7c5-b9c02ab3701e admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:26.680567 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4a9a8-4a66-4e9b-a7c5-b9c02ab3701e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:26.681246 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4a9a8-4a66-4e9b-a7c5-b9c02ab3701e admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:26.682057 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4a9a8-4a66-4e9b-a7c5-b9c02ab3701e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:26.683862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4a9a8-4a66-4e9b-a7c5-b9c02ab3701e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:26.689595 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 903/1817] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:14:26.699623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 915/1818] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:26.703317 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865ad85-05a2-4a84-82d0-ad937a7a60f2 service cinder] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:26.718397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865ad85-05a2-4a84-82d0-ad937a7a60f2 service cinder] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:26.753820 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fef0a-3cb8-4ab2-9c86-e477f69149c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:26.754522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fef0a-3cb8-4ab2-9c86-e477f69149c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:26.754734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fef0a-3cb8-4ab2-9c86-e477f69149c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:26.755075 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fef0a-3cb8-4ab2-9c86-e477f69149c1 admin admin] PATH_INFO: `/v3/projects/b9d0c931b559407091b3d76929caf55a/users/51d25a1883184a93b9ca8a99b367c229/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:26.776410 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139fef0a-3cb8-4ab2-9c86-e477f69149c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9d0c931b559407091b3d76929caf55a, user_id=51d25a1883184a93b9ca8a99b367c229, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:26.783176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139fef0a-3cb8-4ab2-9c86-e477f69149c1 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:26.788197 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4a9a8-4a66-4e9b-a7c5-b9c02ab3701e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:26.788197 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-62a4a9a8-4a66-4e9b-a7c5-b9c02ab3701e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:26.800858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4a9a8-4a66-4e9b-a7c5-b9c02ab3701e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:26.806765 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 904/1819] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:26 2022] PUT /identity/v3/projects/b9d0c931b559407091b3d76929caf55a/users/51d25a1883184a93b9ca8a99b367c229/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:26.811676 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5188a-8027-40c6-aba0-3e8eff107b36 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:26.811961 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5188a-8027-40c6-aba0-3e8eff107b36 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:26.812236 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5188a-8027-40c6-aba0-3e8eff107b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:26.832215 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-03f5188a-8027-40c6-aba0-3e8eff107b36 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:26.833709 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-03f5188a-8027-40c6-aba0-3e8eff107b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:26.873451 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c30bac-1726-408b-a69c-43eabe2a1adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:26.874557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c30bac-1726-408b-a69c-43eabe2a1adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:26.874557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c30bac-1726-408b-a69c-43eabe2a1adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:26.874730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c30bac-1726-408b-a69c-43eabe2a1adb admin admin] PATH_INFO: `/v3/users/579130e1478c4ef09a144167432801c6` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:26.876181 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c30bac-1726-408b-a69c-43eabe2a1adb admin admin] RBAC: Authorizing `identity:delete_user(user_id=579130e1478c4ef09a144167432801c6)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:26.878585 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c30bac-1726-408b-a69c-43eabe2a1adb admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:26.902730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 905/1820] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:14:26.914654 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5188a-8027-40c6-aba0-3e8eff107b36 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:26.917725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-03f5188a-8027-40c6-aba0-3e8eff107b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:26.937367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a3c30bac-1726-408b-a69c-43eabe2a1adb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '579130e1478c4ef09a144167432801c6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:26.944813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a3c30bac-1726-408b-a69c-43eabe2a1adb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '579130e1478c4ef09a144167432801c6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:26.958238 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a3c30bac-1726-408b-a69c-43eabe2a1adb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '579130e1478c4ef09a144167432801c6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:26.966866 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a3c30bac-1726-408b-a69c-43eabe2a1adb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '579130e1478c4ef09a144167432801c6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:26.967859 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a3c30bac-1726-408b-a69c-43eabe2a1adb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '579130e1478c4ef09a144167432801c6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:26.974806 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 916/1821] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:26 2022] DELETE /identity/v3/users/579130e1478c4ef09a144167432801c6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:26.980727 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac0b78-749f-490a-a4a0-3471cb9ee3f1 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:26.980930 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac0b78-749f-490a-a4a0-3471cb9ee3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:26.981202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac0b78-749f-490a-a4a0-3471cb9ee3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:26.983761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5188a-8027-40c6-aba0-3e8eff107b36 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:27.006145 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-38ac0b78-749f-490a-a4a0-3471cb9ee3f1 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:27.007444 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-38ac0b78-749f-490a-a4a0-3471cb9ee3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:27.097004 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:27.104506 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:27.113224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31540e78-9140-4f00-9efa-02acdb29bba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:27.114549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31540e78-9140-4f00-9efa-02acdb29bba6 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:27.114898 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31540e78-9140-4f00-9efa-02acdb29bba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:27.121158 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31540e78-9140-4f00-9efa-02acdb29bba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:27.126520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-31540e78-9140-4f00-9efa-02acdb29bba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:27.171581 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 917/1822] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:14:27.181557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac0b78-749f-490a-a4a0-3471cb9ee3f1 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:27.183008 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-38ac0b78-749f-490a-a4a0-3471cb9ee3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:27.196597 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac0b78-749f-490a-a4a0-3471cb9ee3f1 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:27.203565 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db3245-3b61-42b5-a39e-755be281d550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:27.204262 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db3245-3b61-42b5-a39e-755be281d550 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:27.204610 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db3245-3b61-42b5-a39e-755be281d550 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:27.204943 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db3245-3b61-42b5-a39e-755be281d550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:27.219273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db3245-3b61-42b5-a39e-755be281d550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:27.220808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db3245-3b61-42b5-a39e-755be281d550 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:27.232270 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 918/1823] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:14:27.236266 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31540e78-9140-4f00-9efa-02acdb29bba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:27.237892 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31540e78-9140-4f00-9efa-02acdb29bba6 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:27.249641 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 906/1824] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:14:27.551721 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db3245-3b61-42b5-a39e-755be281d550 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:27.553945 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d5db3245-3b61-42b5-a39e-755be281d550 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:27.572194 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db3245-3b61-42b5-a39e-755be281d550 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:27.597375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab99fd4-633b-4a3f-bf68-a46260c3f9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:27.597375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab99fd4-633b-4a3f-bf68-a46260c3f9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:27.597375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab99fd4-633b-4a3f-bf68-a46260c3f9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:27.597375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab99fd4-633b-4a3f-bf68-a46260c3f9b8 admin admin] PATH_INFO: `/v3/projects/b719b85531a84eea93d25d263d410b3d` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:27.598367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab99fd4-633b-4a3f-bf68-a46260c3f9b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b719b85531a84eea93d25d263d410b3d)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:27.606890 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab99fd4-633b-4a3f-bf68-a46260c3f9b8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:27.608824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31540e78-9140-4f00-9efa-02acdb29bba6 service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:27.610708 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-31540e78-9140-4f00-9efa-02acdb29bba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:27.678173 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31540e78-9140-4f00-9efa-02acdb29bba6 service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:27.693142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9ab99fd4-633b-4a3f-bf68-a46260c3f9b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b719b85531a84eea93d25d263d410b3d', 'request_id': 'req-9ab99fd4-633b-4a3f-bf68-a46260c3f9b8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:27.706362 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9ab99fd4-633b-4a3f-bf68-a46260c3f9b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b719b85531a84eea93d25d263d410b3d', 'request_id': 'req-9ab99fd4-633b-4a3f-bf68-a46260c3f9b8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:27.720756 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9ab99fd4-633b-4a3f-bf68-a46260c3f9b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b719b85531a84eea93d25d263d410b3d', 'request_id': 'req-9ab99fd4-633b-4a3f-bf68-a46260c3f9b8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:27.742331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9ab99fd4-633b-4a3f-bf68-a46260c3f9b8 admin admin] The token cache is being invalidate because project b719b85531a84eea93d25d263d410b3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:27.742576 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9ab99fd4-633b-4a3f-bf68-a46260c3f9b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:27.743550 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9ab99fd4-633b-4a3f-bf68-a46260c3f9b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:27.745636 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 919/1825] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:27 2022] DELETE /identity/v3/projects/b719b85531a84eea93d25d263d410b3d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:27.753640 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709eb9f8-37c6-40c6-8670-047c22f2c4c6 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:27.754574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709eb9f8-37c6-40c6-8670-047c22f2c4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:27.754574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709eb9f8-37c6-40c6-8670-047c22f2c4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:27.760290 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f4d94-6da1-4e2e-b01a-2fec5e8d6b77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:27.761171 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f4d94-6da1-4e2e-b01a-2fec5e8d6b77 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:27.761451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f4d94-6da1-4e2e-b01a-2fec5e8d6b77 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:27.761750 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f4d94-6da1-4e2e-b01a-2fec5e8d6b77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:27.764150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-663f4d94-6da1-4e2e-b01a-2fec5e8d6b77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:27.791627 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-709eb9f8-37c6-40c6-8670-047c22f2c4c6 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:27.795728 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-709eb9f8-37c6-40c6-8670-047c22f2c4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:27.852943 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f4d94-6da1-4e2e-b01a-2fec5e8d6b77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:27.855332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f4d94-6da1-4e2e-b01a-2fec5e8d6b77 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:27.873918 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 907/1826] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:14:27.897524 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 920/1827] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:27.907101 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccdec5-5402-4127-ad71-dab6743a5d8b None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:27.907712 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccdec5-5402-4127-ad71-dab6743a5d8b None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:27.908114 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccdec5-5402-4127-ad71-dab6743a5d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:27.920070 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:27.938003 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-15ccdec5-5402-4127-ad71-dab6743a5d8b None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:27.939202 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-15ccdec5-5402-4127-ad71-dab6743a5d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:27.949546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 908/1828] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:27.954678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709eb9f8-37c6-40c6-8670-047c22f2c4c6 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:27.968274 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709eb9f8-37c6-40c6-8670-047c22f2c4c6 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:27.977693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71eec9c-0951-4775-95b8-4254fc72dbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:27.978640 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71eec9c-0951-4775-95b8-4254fc72dbc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:27.979006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71eec9c-0951-4775-95b8-4254fc72dbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:27.979643 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71eec9c-0951-4775-95b8-4254fc72dbc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:27.980423 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71eec9c-0951-4775-95b8-4254fc72dbc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:27.980719 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71eec9c-0951-4775-95b8-4254fc72dbc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:27.982655 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71eec9c-0951-4775-95b8-4254fc72dbc2 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:27.997518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 921/1829] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:14:28.001924 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccdec5-5402-4127-ad71-dab6743a5d8b None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:28.012279 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccdec5-5402-4127-ad71-dab6743a5d8b None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:28.018114 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e3748-57cd-42dd-a0da-262738bdc50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:28.018729 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e3748-57cd-42dd-a0da-262738bdc50f admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:28.019018 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e3748-57cd-42dd-a0da-262738bdc50f admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:28.019316 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e3748-57cd-42dd-a0da-262738bdc50f admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:28.020003 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e3748-57cd-42dd-a0da-262738bdc50f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:28.022336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e3748-57cd-42dd-a0da-262738bdc50f admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:28.074444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 909/1830] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:28 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:28.079225 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71eec9c-0951-4775-95b8-4254fc72dbc2 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:28.092999 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71eec9c-0951-4775-95b8-4254fc72dbc2 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:28.131586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:28.184428 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805102ff-f89d-4361-a155-a00cde49e609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:28.186275 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805102ff-f89d-4361-a155-a00cde49e609 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:28.186790 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805102ff-f89d-4361-a155-a00cde49e609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:28.187620 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805102ff-f89d-4361-a155-a00cde49e609 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:28.188648 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805102ff-f89d-4361-a155-a00cde49e609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:28.191019 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805102ff-f89d-4361-a155-a00cde49e609 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:28.222759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 922/1831] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:28 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:28.227853 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e3748-57cd-42dd-a0da-262738bdc50f admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:28.238733 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e3748-57cd-42dd-a0da-262738bdc50f admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:28.245352 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76489111-1882-41fd-b584-74e6a9573ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:28.245979 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76489111-1882-41fd-b584-74e6a9573ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:28.246396 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76489111-1882-41fd-b584-74e6a9573ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:28.246675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76489111-1882-41fd-b584-74e6a9573ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:28.247316 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76489111-1882-41fd-b584-74e6a9573ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:28.249041 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76489111-1882-41fd-b584-74e6a9573ad5 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:28.252995 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061e124-7b4c-4a14-a828-99ff69187577 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:28.253283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061e124-7b4c-4a14-a828-99ff69187577 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:28.253554 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061e124-7b4c-4a14-a828-99ff69187577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:28.270180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 910/1832] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:28.271144 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76489111-1882-41fd-b584-74e6a9573ad5 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:28.280458 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-0061e124-7b4c-4a14-a828-99ff69187577 None None] MFA Rules not processed for user `297eccc7c02443e8bd2b98cfaad3b1fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:28.284906 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0061e124-7b4c-4a14-a828-99ff69187577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:28.293432 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76489111-1882-41fd-b584-74e6a9573ad5 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:28.308904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613eb595-80e2-4de0-bb5f-114c0282d4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:28.309466 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613eb595-80e2-4de0-bb5f-114c0282d4eb admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:28.309748 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613eb595-80e2-4de0-bb5f-114c0282d4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:28.310023 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613eb595-80e2-4de0-bb5f-114c0282d4eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:28.310674 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613eb595-80e2-4de0-bb5f-114c0282d4eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:28.312351 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613eb595-80e2-4de0-bb5f-114c0282d4eb admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:28.343191 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 911/1833] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:28.347891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613eb595-80e2-4de0-bb5f-114c0282d4eb admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:28.365431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613eb595-80e2-4de0-bb5f-114c0282d4eb admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:28.373151 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326921ca-df5d-4566-ad21-c446165c3df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:28.373580 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326921ca-df5d-4566-ad21-c446165c3df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:28.374080 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326921ca-df5d-4566-ad21-c446165c3df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:28.374613 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326921ca-df5d-4566-ad21-c446165c3df0 admin admin] PATH_INFO: `/v3/projects/e896388c7aca4781b42d02726bf020ea/users/2472fb66b5d1468d95f590994be5a391/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:28.391183 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 923/1834] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:14:28.403651 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326921ca-df5d-4566-ad21-c446165c3df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e896388c7aca4781b42d02726bf020ea, user_id=2472fb66b5d1468d95f590994be5a391, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:28.406782 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326921ca-df5d-4566-ad21-c446165c3df0 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:28.434670 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 912/1835] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:28 2022] PUT /identity/v3/projects/e896388c7aca4781b42d02726bf020ea/users/2472fb66b5d1468d95f590994be5a391/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:28.449365 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deaf5b3-24cb-4d26-9ded-3eb1ae253d68 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:28.450031 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deaf5b3-24cb-4d26-9ded-3eb1ae253d68 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:28.450531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deaf5b3-24cb-4d26-9ded-3eb1ae253d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:28.517705 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-1deaf5b3-24cb-4d26-9ded-3eb1ae253d68 None None] MFA Rules not processed for user `2472fb66b5d1468d95f590994be5a391`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:28.519958 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1deaf5b3-24cb-4d26-9ded-3eb1ae253d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:28.628273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 924/1836] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:28.799111 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326921ca-df5d-4566-ad21-c446165c3df0 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:28.800993 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-326921ca-df5d-4566-ad21-c446165c3df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:28.928636 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326921ca-df5d-4566-ad21-c446165c3df0 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:28.942320 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8d009-553d-48e9-b9d1-2897f7ccd227 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:28.943251 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8d009-553d-48e9-b9d1-2897f7ccd227 service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:28.943677 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8d009-553d-48e9-b9d1-2897f7ccd227 service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:28.944050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8d009-553d-48e9-b9d1-2897f7ccd227 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:28.959170 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8d009-553d-48e9-b9d1-2897f7ccd227 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:28.963207 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8d009-553d-48e9-b9d1-2897f7ccd227 service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:28.981576 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 913/1837] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:29.788072 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deaf5b3-24cb-4d26-9ded-3eb1ae253d68 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:29.921278 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:29.941106 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deaf5b3-24cb-4d26-9ded-3eb1ae253d68 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:29.952070 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa5909-8f23-4c49-9968-f0346ec5d6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:29.953626 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa5909-8f23-4c49-9968-f0346ec5d6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:29.956771 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa5909-8f23-4c49-9968-f0346ec5d6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:29.957678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa5909-8f23-4c49-9968-f0346ec5d6ca admin admin] PATH_INFO: `/v3/users/2472fb66b5d1468d95f590994be5a391` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:29.963195 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa5909-8f23-4c49-9968-f0346ec5d6ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=2472fb66b5d1468d95f590994be5a391)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:29.969402 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa5909-8f23-4c49-9968-f0346ec5d6ca admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:30.039888 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-6bfa5909-8f23-4c49-9968-f0346ec5d6ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2472fb66b5d1468d95f590994be5a391'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:30.048159 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-6bfa5909-8f23-4c49-9968-f0346ec5d6ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2472fb66b5d1468d95f590994be5a391'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:30.079346 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-6bfa5909-8f23-4c49-9968-f0346ec5d6ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2472fb66b5d1468d95f590994be5a391'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:30.084109 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-6bfa5909-8f23-4c49-9968-f0346ec5d6ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2472fb66b5d1468d95f590994be5a391'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:30.084109 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-6bfa5909-8f23-4c49-9968-f0346ec5d6ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2472fb66b5d1468d95f590994be5a391'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:30.090529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 925/1838] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:29 2022] DELETE /identity/v3/users/2472fb66b5d1468d95f590994be5a391 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:30.095187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f27c1-8940-499d-8960-9ec3d6c452ef None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:30.095700 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f27c1-8940-499d-8960-9ec3d6c452ef None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:30.095789 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f27c1-8940-499d-8960-9ec3d6c452ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:30.118037 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-403f27c1-8940-499d-8960-9ec3d6c452ef None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:30.120095 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-403f27c1-8940-499d-8960-9ec3d6c452ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:30.190140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 914/1839] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:30.200030 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa5909-8f23-4c49-9968-f0346ec5d6ca admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:30.201456 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6bfa5909-8f23-4c49-9968-f0346ec5d6ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:30.270642 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa5909-8f23-4c49-9968-f0346ec5d6ca admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:30.275125 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50baf92-5ba3-4dcf-b1ff-5f12910c53fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:30.275865 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50baf92-5ba3-4dcf-b1ff-5f12910c53fb service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:30.276220 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50baf92-5ba3-4dcf-b1ff-5f12910c53fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:30.277433 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50baf92-5ba3-4dcf-b1ff-5f12910c53fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:30.287156 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50baf92-5ba3-4dcf-b1ff-5f12910c53fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:30.288634 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50baf92-5ba3-4dcf-b1ff-5f12910c53fb service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:30.300192 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 926/1840] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:14:30.912709 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f27c1-8940-499d-8960-9ec3d6c452ef None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:30.914638 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-403f27c1-8940-499d-8960-9ec3d6c452ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:30.937374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f27c1-8940-499d-8960-9ec3d6c452ef None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:30.944569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fc515-5e04-47af-aa55-c36f37075ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:30.945793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fc515-5e04-47af-aa55-c36f37075ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:30.946667 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fc515-5e04-47af-aa55-c36f37075ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:30.947054 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fc515-5e04-47af-aa55-c36f37075ced admin admin] PATH_INFO: `/v3/projects/e896388c7aca4781b42d02726bf020ea` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:30.948252 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fc515-5e04-47af-aa55-c36f37075ced admin admin] RBAC: Authorizing `identity:delete_project(project_id=e896388c7aca4781b42d02726bf020ea)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:30.950605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fc515-5e04-47af-aa55-c36f37075ced admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:30.968884 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:31.033374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-fd6fc515-5e04-47af-aa55-c36f37075ced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e896388c7aca4781b42d02726bf020ea', 'request_id': 'req-fd6fc515-5e04-47af-aa55-c36f37075ced'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:31.047105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-fd6fc515-5e04-47af-aa55-c36f37075ced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e896388c7aca4781b42d02726bf020ea', 'request_id': 'req-fd6fc515-5e04-47af-aa55-c36f37075ced'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:31.061170 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-fd6fc515-5e04-47af-aa55-c36f37075ced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e896388c7aca4781b42d02726bf020ea', 'request_id': 'req-fd6fc515-5e04-47af-aa55-c36f37075ced'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:31.078787 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-fd6fc515-5e04-47af-aa55-c36f37075ced admin admin] The token cache is being invalidate because project e896388c7aca4781b42d02726bf020ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:31.079162 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-fd6fc515-5e04-47af-aa55-c36f37075ced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:31.080093 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-fd6fc515-5e04-47af-aa55-c36f37075ced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:31.082167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 915/1841] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:30 2022] DELETE /identity/v3/projects/e896388c7aca4781b42d02726bf020ea => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:31.087403 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99990b2-bee5-4004-9c3b-e314c83050d5 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:31.087876 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99990b2-bee5-4004-9c3b-e314c83050d5 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:31.088078 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99990b2-bee5-4004-9c3b-e314c83050d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:31.135266 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b99990b2-bee5-4004-9c3b-e314c83050d5 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:31.136873 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b99990b2-bee5-4004-9c3b-e314c83050d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:31.244952 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 927/1842] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:31.252783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178030c7-deb7-42be-8c3b-aa62021ef089 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:31.253235 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178030c7-deb7-42be-8c3b-aa62021ef089 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:31.253309 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178030c7-deb7-42be-8c3b-aa62021ef089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:31.330424 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-178030c7-deb7-42be-8c3b-aa62021ef089 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:31.334103 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-178030c7-deb7-42be-8c3b-aa62021ef089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:31.374272 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 916/1843] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:31.374395 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99990b2-bee5-4004-9c3b-e314c83050d5 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:31.385597 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99990b2-bee5-4004-9c3b-e314c83050d5 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:31.391941 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa3bfa-b636-44af-9bc7-d1357c260c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:31.392705 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa3bfa-b636-44af-9bc7-d1357c260c8d admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:31.393083 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa3bfa-b636-44af-9bc7-d1357c260c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:31.393458 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa3bfa-b636-44af-9bc7-d1357c260c8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:31.394211 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa3bfa-b636-44af-9bc7-d1357c260c8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:31.394635 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa3bfa-b636-44af-9bc7-d1357c260c8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:31.397714 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa3bfa-b636-44af-9bc7-d1357c260c8d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:31.416000 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 928/1844] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:14:31.421655 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178030c7-deb7-42be-8c3b-aa62021ef089 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:31.442143 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178030c7-deb7-42be-8c3b-aa62021ef089 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:31.450175 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93c20f-bcfb-4888-bcff-93450a0f5cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:31.451108 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93c20f-bcfb-4888-bcff-93450a0f5cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:31.451539 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93c20f-bcfb-4888-bcff-93450a0f5cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:31.451945 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93c20f-bcfb-4888-bcff-93450a0f5cc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:31.452864 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93c20f-bcfb-4888-bcff-93450a0f5cc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:31.455518 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93c20f-bcfb-4888-bcff-93450a0f5cc5 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:31.488291 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 917/1845] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:31 2022] POST /identity/v3/projects => generated 359 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:31.492840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa3bfa-b636-44af-9bc7-d1357c260c8d admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:31.501564 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:31.505743 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa3bfa-b636-44af-9bc7-d1357c260c8d admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:31.575905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7a701-de3b-4883-9304-e1f9ffbee3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:31.577023 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7a701-de3b-4883-9304-e1f9ffbee3ac admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:31.577303 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7a701-de3b-4883-9304-e1f9ffbee3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:31.577573 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7a701-de3b-4883-9304-e1f9ffbee3ac admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:31.578207 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7a701-de3b-4883-9304-e1f9ffbee3ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:31.580351 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7a701-de3b-4883-9304-e1f9ffbee3ac admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:31.607206 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 929/1846] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:31 2022] POST /identity/v3/users => generated 280 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:31.610854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93c20f-bcfb-4888-bcff-93450a0f5cc5 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:31.623261 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93c20f-bcfb-4888-bcff-93450a0f5cc5 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:31.630197 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc01b51-a48e-41c7-8cac-3e8f4417e015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:31.630812 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc01b51-a48e-41c7-8cac-3e8f4417e015 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:31.631091 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc01b51-a48e-41c7-8cac-3e8f4417e015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:31.631586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc01b51-a48e-41c7-8cac-3e8f4417e015 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:31.632053 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc01b51-a48e-41c7-8cac-3e8f4417e015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:31.634499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc01b51-a48e-41c7-8cac-3e8f4417e015 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:31.645513 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 918/1847] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:31.650222 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7a701-de3b-4883-9304-e1f9ffbee3ac admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:31.660609 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7a701-de3b-4883-9304-e1f9ffbee3ac admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:31.665858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a292c82-1fe7-4237-856e-2eb709c7fbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:31.666473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a292c82-1fe7-4237-856e-2eb709c7fbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:31.666753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a292c82-1fe7-4237-856e-2eb709c7fbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:31.667028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a292c82-1fe7-4237-856e-2eb709c7fbf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:31.667767 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a292c82-1fe7-4237-856e-2eb709c7fbf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:31.670256 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a292c82-1fe7-4237-856e-2eb709c7fbf2 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:31.683993 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 930/1848] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:31.685713 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc01b51-a48e-41c7-8cac-3e8f4417e015 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:31.696220 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc01b51-a48e-41c7-8cac-3e8f4417e015 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:31.701391 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b2a5c-58c2-4216-a78d-d371f068f5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:31.702278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b2a5c-58c2-4216-a78d-d371f068f5e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:31.702693 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b2a5c-58c2-4216-a78d-d371f068f5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:31.702962 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b2a5c-58c2-4216-a78d-d371f068f5e7 admin admin] PATH_INFO: `/v3/projects/05d0fbaa149d4771b204cee78114fcdf/users/2ac98829dbea420a83292cc9e1091ed5/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:31.722366 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b2a5c-58c2-4216-a78d-d371f068f5e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d0fbaa149d4771b204cee78114fcdf, user_id=2ac98829dbea420a83292cc9e1091ed5, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:31.725805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b2a5c-58c2-4216-a78d-d371f068f5e7 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:31.753681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 919/1849] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:31 2022] PUT /identity/v3/projects/05d0fbaa149d4771b204cee78114fcdf/users/2ac98829dbea420a83292cc9e1091ed5/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:31.756446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38601b7-d286-4cc7-befc-6ec4400a7c9e None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:31.756739 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38601b7-d286-4cc7-befc-6ec4400a7c9e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:31.757013 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38601b7-d286-4cc7-befc-6ec4400a7c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:31.830176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d38601b7-d286-4cc7-befc-6ec4400a7c9e None None] MFA Rules not processed for user `2ac98829dbea420a83292cc9e1091ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:31.831319 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d38601b7-d286-4cc7-befc-6ec4400a7c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:31.939492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 931/1850] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:31.981042 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b2a5c-58c2-4216-a78d-d371f068f5e7 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:31.983034 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-159b2a5c-58c2-4216-a78d-d371f068f5e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:32.059465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b2a5c-58c2-4216-a78d-d371f068f5e7 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:32.063645 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14ae30-01ec-46fd-9bcc-bbcd172fbfce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:32.064593 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14ae30-01ec-46fd-9bcc-bbcd172fbfce service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:32.064963 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14ae30-01ec-46fd-9bcc-bbcd172fbfce service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:32.065407 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14ae30-01ec-46fd-9bcc-bbcd172fbfce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:32.075866 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14ae30-01ec-46fd-9bcc-bbcd172fbfce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:32.077244 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14ae30-01ec-46fd-9bcc-bbcd172fbfce service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:32.090530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 920/1851] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:32.108913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38601b7-d286-4cc7-befc-6ec4400a7c9e None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:32.231507 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38601b7-d286-4cc7-befc-6ec4400a7c9e None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:32.240538 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed318cf-884d-480e-ab87-1e913748042a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:32.241569 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed318cf-884d-480e-ab87-1e913748042a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:32.241850 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed318cf-884d-480e-ab87-1e913748042a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:32.245999 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed318cf-884d-480e-ab87-1e913748042a admin admin] PATH_INFO: `/v3/users/2ac98829dbea420a83292cc9e1091ed5` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:32.248058 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed318cf-884d-480e-ab87-1e913748042a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ac98829dbea420a83292cc9e1091ed5)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:32.250901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed318cf-884d-480e-ab87-1e913748042a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:32.284971 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:32.346488 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3ed318cf-884d-480e-ab87-1e913748042a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ac98829dbea420a83292cc9e1091ed5'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:32.365543 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3ed318cf-884d-480e-ab87-1e913748042a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ac98829dbea420a83292cc9e1091ed5'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:32.400617 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3ed318cf-884d-480e-ab87-1e913748042a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ac98829dbea420a83292cc9e1091ed5'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:32.417081 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3ed318cf-884d-480e-ab87-1e913748042a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ac98829dbea420a83292cc9e1091ed5'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:32.419373 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3ed318cf-884d-480e-ab87-1e913748042a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ac98829dbea420a83292cc9e1091ed5'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:32.442226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 932/1852] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:32 2022] DELETE /identity/v3/users/2ac98829dbea420a83292cc9e1091ed5 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:32.443157 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45719c22-449d-4ef5-a962-ac695f1f72d9 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:32.443964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45719c22-449d-4ef5-a962-ac695f1f72d9 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:32.443964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45719c22-449d-4ef5-a962-ac695f1f72d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:32.507041 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-45719c22-449d-4ef5-a962-ac695f1f72d9 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:32.508828 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-45719c22-449d-4ef5-a962-ac695f1f72d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:32.569325 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:32.624380 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 921/1853] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:14:32.638415 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed318cf-884d-480e-ab87-1e913748042a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:32.641877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3ed318cf-884d-480e-ab87-1e913748042a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:32.738148 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed318cf-884d-480e-ab87-1e913748042a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:32.746598 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058cba5-1eaa-4f4b-9856-5fc48db1e392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:32.747271 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058cba5-1eaa-4f4b-9856-5fc48db1e392 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:32.747592 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058cba5-1eaa-4f4b-9856-5fc48db1e392 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:32.747910 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058cba5-1eaa-4f4b-9856-5fc48db1e392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:32.764947 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058cba5-1eaa-4f4b-9856-5fc48db1e392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:32.766742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058cba5-1eaa-4f4b-9856-5fc48db1e392 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:32.786548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 933/1854] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:33.808088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45719c22-449d-4ef5-a962-ac695f1f72d9 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:33.809533 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-45719c22-449d-4ef5-a962-ac695f1f72d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:33.828350 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45719c22-449d-4ef5-a962-ac695f1f72d9 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:33.843339 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236038d-047f-44f8-b3db-666f0fe85b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:33.844390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236038d-047f-44f8-b3db-666f0fe85b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:33.844671 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236038d-047f-44f8-b3db-666f0fe85b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:33.844941 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236038d-047f-44f8-b3db-666f0fe85b05 admin admin] PATH_INFO: `/v3/projects/05d0fbaa149d4771b204cee78114fcdf` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:33.848208 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236038d-047f-44f8-b3db-666f0fe85b05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05d0fbaa149d4771b204cee78114fcdf)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:33.850619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236038d-047f-44f8-b3db-666f0fe85b05 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:33.992667 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-5236038d-047f-44f8-b3db-666f0fe85b05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d0fbaa149d4771b204cee78114fcdf', 'request_id': 'req-5236038d-047f-44f8-b3db-666f0fe85b05'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:34.009269 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-5236038d-047f-44f8-b3db-666f0fe85b05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d0fbaa149d4771b204cee78114fcdf', 'request_id': 'req-5236038d-047f-44f8-b3db-666f0fe85b05'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:34.024977 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-5236038d-047f-44f8-b3db-666f0fe85b05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d0fbaa149d4771b204cee78114fcdf', 'request_id': 'req-5236038d-047f-44f8-b3db-666f0fe85b05'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:34.052113 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-5236038d-047f-44f8-b3db-666f0fe85b05 admin admin] The token cache is being invalidate because project 05d0fbaa149d4771b204cee78114fcdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:34.052395 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-5236038d-047f-44f8-b3db-666f0fe85b05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:34.057567 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-5236038d-047f-44f8-b3db-666f0fe85b05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:34.065210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a155820-abb7-4334-8b73-02ef289cf51d None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:34.066166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a155820-abb7-4334-8b73-02ef289cf51d None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:34.066612 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a155820-abb7-4334-8b73-02ef289cf51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:34.069634 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 922/1855] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:33 2022] DELETE /identity/v3/projects/05d0fbaa149d4771b204cee78114fcdf => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:34.098013 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-8a155820-abb7-4334-8b73-02ef289cf51d None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:34.099240 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8a155820-abb7-4334-8b73-02ef289cf51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:34.204820 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 934/1856] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:34.214144 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee8bf6-f107-4f33-a76f-2bcd73eeefec None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:34.214447 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee8bf6-f107-4f33-a76f-2bcd73eeefec None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:34.214738 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee8bf6-f107-4f33-a76f-2bcd73eeefec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:34.263223 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-5cee8bf6-f107-4f33-a76f-2bcd73eeefec None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:34.264630 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-5cee8bf6-f107-4f33-a76f-2bcd73eeefec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:34.279886 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 923/1857] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:34.282713 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a155820-abb7-4334-8b73-02ef289cf51d None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:34.299696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a155820-abb7-4334-8b73-02ef289cf51d None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:34.302319 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666efaf-c169-482f-b006-91e720714f46 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:34.302597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666efaf-c169-482f-b006-91e720714f46 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:34.303019 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666efaf-c169-482f-b006-91e720714f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:34.315534 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43eaed-d8f1-46f9-81c7-950eb36f8d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:34.317051 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43eaed-d8f1-46f9-81c7-950eb36f8d81 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:34.317051 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43eaed-d8f1-46f9-81c7-950eb36f8d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:34.317051 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43eaed-d8f1-46f9-81c7-950eb36f8d81 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:34.317399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43eaed-d8f1-46f9-81c7-950eb36f8d81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:34.317597 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43eaed-d8f1-46f9-81c7-950eb36f8d81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:34.321776 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43eaed-d8f1-46f9-81c7-950eb36f8d81 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:34.349428 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 935/1858] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:14:34.350474 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43eaed-d8f1-46f9-81c7-950eb36f8d81 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:34.366059 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-9666efaf-c169-482f-b006-91e720714f46 None None] MFA Rules not processed for user `51d25a1883184a93b9ca8a99b367c229`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:34.367822 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-9666efaf-c169-482f-b006-91e720714f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:34.373374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43eaed-d8f1-46f9-81c7-950eb36f8d81 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:34.387708 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8cfa7-af77-4e3c-85e7-2b2f31409924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:34.389296 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8cfa7-af77-4e3c-85e7-2b2f31409924 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:34.390199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8cfa7-af77-4e3c-85e7-2b2f31409924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:34.390540 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8cfa7-af77-4e3c-85e7-2b2f31409924 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:34.391474 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8cfa7-af77-4e3c-85e7-2b2f31409924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:34.394046 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8cfa7-af77-4e3c-85e7-2b2f31409924 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:34.431521 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:34.446116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 936/1859] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:34 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:34.448271 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8cfa7-af77-4e3c-85e7-2b2f31409924 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:34.473636 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 924/1860] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:14:34.479184 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666efaf-c169-482f-b006-91e720714f46 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:34.481056 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-9666efaf-c169-482f-b006-91e720714f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:34.497172 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666efaf-c169-482f-b006-91e720714f46 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:34.535251 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8cfa7-af77-4e3c-85e7-2b2f31409924 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:34.541359 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f59ee0-5d75-42bd-8b9e-6b505f5b9fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:34.542384 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f59ee0-5d75-42bd-8b9e-6b505f5b9fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:34.542663 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f59ee0-5d75-42bd-8b9e-6b505f5b9fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:34.543062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f59ee0-5d75-42bd-8b9e-6b505f5b9fe7 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:34.543768 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f59ee0-5d75-42bd-8b9e-6b505f5b9fe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:34.546558 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f59ee0-5d75-42bd-8b9e-6b505f5b9fe7 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:34.563749 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:34.588728 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 937/1861] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:34 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:34.590790 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f59ee0-5d75-42bd-8b9e-6b505f5b9fe7 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:34.594630 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c573d-9646-48ed-b9ae-263bcd26b1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:34.594630 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c573d-9646-48ed-b9ae-263bcd26b1fd admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:34.595080 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c573d-9646-48ed-b9ae-263bcd26b1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:34.595467 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c573d-9646-48ed-b9ae-263bcd26b1fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:34.596291 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c573d-9646-48ed-b9ae-263bcd26b1fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:34.598620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c573d-9646-48ed-b9ae-263bcd26b1fd admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:34.609104 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f59ee0-5d75-42bd-8b9e-6b505f5b9fe7 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:34.620576 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b459f-6747-4d45-afe8-4655739e8849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:34.621601 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b459f-6747-4d45-afe8-4655739e8849 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:34.622088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b459f-6747-4d45-afe8-4655739e8849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:34.622626 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b459f-6747-4d45-afe8-4655739e8849 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:34.629834 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b459f-6747-4d45-afe8-4655739e8849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:34.629834 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b459f-6747-4d45-afe8-4655739e8849 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:34.640706 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 938/1862] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:14:34.641739 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b459f-6747-4d45-afe8-4655739e8849 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:34.656480 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b459f-6747-4d45-afe8-4655739e8849 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:34.659827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 925/1863] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:34 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:34.664502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c573d-9646-48ed-b9ae-263bcd26b1fd admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:34.748051 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1763d-2c65-4571-b961-30210322649a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:34.748349 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1763d-2c65-4571-b961-30210322649a admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:34.748566 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1763d-2c65-4571-b961-30210322649a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:34.748844 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1763d-2c65-4571-b961-30210322649a admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:34.749645 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1763d-2c65-4571-b961-30210322649a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:34.751263 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1763d-2c65-4571-b961-30210322649a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:34.764622 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 939/1864] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:34.768479 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1763d-2c65-4571-b961-30210322649a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:34.783479 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c573d-9646-48ed-b9ae-263bcd26b1fd admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:34.792614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1763d-2c65-4571-b961-30210322649a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:34.801244 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e199a2-9da4-4923-93a3-ac5e3864a27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:34.801727 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e199a2-9da4-4923-93a3-ac5e3864a27e admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:34.802003 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e199a2-9da4-4923-93a3-ac5e3864a27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:34.802643 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e199a2-9da4-4923-93a3-ac5e3864a27e admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:34.803798 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e199a2-9da4-4923-93a3-ac5e3864a27e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:34.806208 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd3869-b14f-4a68-a3f7-b289ac44a2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:34.806358 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e199a2-9da4-4923-93a3-ac5e3864a27e admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:34.809637 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd3869-b14f-4a68-a3f7-b289ac44a2e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:34.810095 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd3869-b14f-4a68-a3f7-b289ac44a2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:34.810526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd3869-b14f-4a68-a3f7-b289ac44a2e3 admin admin] PATH_INFO: `/v3/projects/68236213645841589578b5fc25b03970/users/98dc11a54c8c45b89e696086b86ceadc/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:34.830594 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd3869-b14f-4a68-a3f7-b289ac44a2e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68236213645841589578b5fc25b03970, user_id=98dc11a54c8c45b89e696086b86ceadc, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:34.833843 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd3869-b14f-4a68-a3f7-b289ac44a2e3 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:34.844089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 926/1865] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:34 2022] POST /identity/v3/users => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:34.845968 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e199a2-9da4-4923-93a3-ac5e3864a27e admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:34.859460 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 940/1866] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:34 2022] PUT /identity/v3/projects/68236213645841589578b5fc25b03970/users/98dc11a54c8c45b89e696086b86ceadc/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:34.870436 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c7cde-f664-4464-bec0-433626670c9e None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:34.870749 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c7cde-f664-4464-bec0-433626670c9e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:34.871092 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c7cde-f664-4464-bec0-433626670c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:34.877821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e199a2-9da4-4923-93a3-ac5e3864a27e admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:34.938892 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-bc0c7cde-f664-4464-bec0-433626670c9e None None] MFA Rules not processed for user `98dc11a54c8c45b89e696086b86ceadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:34.943685 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-bc0c7cde-f664-4464-bec0-433626670c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:34.989537 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86493a7e-3742-4a83-94be-2a4ded0821df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:34.990400 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86493a7e-3742-4a83-94be-2a4ded0821df admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:34.991355 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86493a7e-3742-4a83-94be-2a4ded0821df admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:34.991898 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86493a7e-3742-4a83-94be-2a4ded0821df admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:34.993521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86493a7e-3742-4a83-94be-2a4ded0821df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:34.995547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86493a7e-3742-4a83-94be-2a4ded0821df admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:35.009494 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 927/1867] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:35.014041 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86493a7e-3742-4a83-94be-2a4ded0821df admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:35.036542 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86493a7e-3742-4a83-94be-2a4ded0821df admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:35.037375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:35.046938 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c0f99-9aac-485f-8be5-2c6b4a0ada01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:35.047874 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c0f99-9aac-485f-8be5-2c6b4a0ada01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:35.048200 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c0f99-9aac-485f-8be5-2c6b4a0ada01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:35.048520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c0f99-9aac-485f-8be5-2c6b4a0ada01 admin admin] PATH_INFO: `/v3/projects/45d981f6df3d4fef91a11ecdeaeb89d9/users/6c07ba7394f94a11afff691b4723bb60/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:35.072451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c0f99-9aac-485f-8be5-2c6b4a0ada01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d981f6df3d4fef91a11ecdeaeb89d9, user_id=6c07ba7394f94a11afff691b4723bb60, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:35.075166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c0f99-9aac-485f-8be5-2c6b4a0ada01 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:35.088472 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 941/1868] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:14:35.092513 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c7cde-f664-4464-bec0-433626670c9e None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:35.098656 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 928/1869] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:35 2022] PUT /identity/v3/projects/45d981f6df3d4fef91a11ecdeaeb89d9/users/6c07ba7394f94a11afff691b4723bb60/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:35.103544 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c0f99-9aac-485f-8be5-2c6b4a0ada01 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:35.108315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c7cde-f664-4464-bec0-433626670c9e None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:35.213555 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:35.291672 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8e591-acad-4b10-b8b9-f6b44ae1f75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:35.292383 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8e591-acad-4b10-b8b9-f6b44ae1f75d admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:35.292663 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8e591-acad-4b10-b8b9-f6b44ae1f75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:35.292962 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8e591-acad-4b10-b8b9-f6b44ae1f75d admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:35.294216 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8e591-acad-4b10-b8b9-f6b44ae1f75d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:35.299023 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8e591-acad-4b10-b8b9-f6b44ae1f75d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:35.308829 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c0f99-9aac-485f-8be5-2c6b4a0ada01 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:35.325284 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce5c4c-8100-4a3a-b4fa-268dc3d8148e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:35.326187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce5c4c-8100-4a3a-b4fa-268dc3d8148e admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:35.326673 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce5c4c-8100-4a3a-b4fa-268dc3d8148e admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:35.327197 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce5c4c-8100-4a3a-b4fa-268dc3d8148e admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:35.327926 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce5c4c-8100-4a3a-b4fa-268dc3d8148e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:35.329970 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce5c4c-8100-4a3a-b4fa-268dc3d8148e admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:35.347979 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 929/1870] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:35.351660 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce5c4c-8100-4a3a-b4fa-268dc3d8148e admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:35.357507 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 942/1871] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:35 2022] POST /identity/v3/projects => generated 385 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:35.361175 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8e591-acad-4b10-b8b9-f6b44ae1f75d admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:35.364360 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce5c4c-8100-4a3a-b4fa-268dc3d8148e admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:35.469010 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8e591-acad-4b10-b8b9-f6b44ae1f75d admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:35.483036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445dc49f-dc77-47a1-8890-1a2d99203567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:35.483844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dc49f-dc77-47a1-8890-1a2d99203567 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:35.484234 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dc49f-dc77-47a1-8890-1a2d99203567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:35.484564 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dc49f-dc77-47a1-8890-1a2d99203567 admin admin] PATH_INFO: `/v3/projects/45d981f6df3d4fef91a11ecdeaeb89d9/users/6c07ba7394f94a11afff691b4723bb60/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:35.485165 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b824e4-d156-418b-a935-8932fe59ddf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:35.486810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b824e4-d156-418b-a935-8932fe59ddf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:35.487763 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445dc49f-dc77-47a1-8890-1a2d99203567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d981f6df3d4fef91a11ecdeaeb89d9, user_id=6c07ba7394f94a11afff691b4723bb60, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:35.490647 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445dc49f-dc77-47a1-8890-1a2d99203567 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:35.491201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b824e4-d156-418b-a935-8932fe59ddf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:35.492626 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b824e4-d156-418b-a935-8932fe59ddf7 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:35.493619 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b824e4-d156-418b-a935-8932fe59ddf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:35.495870 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b824e4-d156-418b-a935-8932fe59ddf7 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:35.504686 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 930/1872] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:35 2022] PUT /identity/v3/projects/45d981f6df3d4fef91a11ecdeaeb89d9/users/6c07ba7394f94a11afff691b4723bb60/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:35.550824 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 943/1873] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:35 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:35.555946 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445dc49f-dc77-47a1-8890-1a2d99203567 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:35.677497 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445dc49f-dc77-47a1-8890-1a2d99203567 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:35.716104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d42486-0750-4c85-9eea-300f9302790e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:35.716838 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d42486-0750-4c85-9eea-300f9302790e admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:35.717331 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d42486-0750-4c85-9eea-300f9302790e admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:35.717612 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d42486-0750-4c85-9eea-300f9302790e admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:35.718395 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d42486-0750-4c85-9eea-300f9302790e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:35.720188 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d42486-0750-4c85-9eea-300f9302790e admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:35.737081 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 931/1874] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:35.741013 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b824e4-d156-418b-a935-8932fe59ddf7 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:35.759490 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b824e4-d156-418b-a935-8932fe59ddf7 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:35.775507 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fe5b6-9e91-4975-9938-a6b4230dda35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:35.776134 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fe5b6-9e91-4975-9938-a6b4230dda35 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:35.776555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fe5b6-9e91-4975-9938-a6b4230dda35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:35.776839 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fe5b6-9e91-4975-9938-a6b4230dda35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:35.777489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fe5b6-9e91-4975-9938-a6b4230dda35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:35.779193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fe5b6-9e91-4975-9938-a6b4230dda35 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:35.793458 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 944/1875] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:35.797397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d42486-0750-4c85-9eea-300f9302790e admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:35.813064 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d42486-0750-4c85-9eea-300f9302790e admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:35.818463 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119f37e-01d5-46bc-9d96-1fdf7fd6e095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:35.820509 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119f37e-01d5-46bc-9d96-1fdf7fd6e095 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:35.820981 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119f37e-01d5-46bc-9d96-1fdf7fd6e095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:35.821573 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119f37e-01d5-46bc-9d96-1fdf7fd6e095 admin admin] PATH_INFO: `/v3/projects/c9810145de13427a9d655dc153a4e5ee/users/c0b964a926774a8c88df428b8cb62f44/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:35.845668 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119f37e-01d5-46bc-9d96-1fdf7fd6e095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9810145de13427a9d655dc153a4e5ee, user_id=c0b964a926774a8c88df428b8cb62f44, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:35.849669 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119f37e-01d5-46bc-9d96-1fdf7fd6e095 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:35.889546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 932/1876] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:35 2022] PUT /identity/v3/projects/c9810145de13427a9d655dc153a4e5ee/users/c0b964a926774a8c88df428b8cb62f44/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:35.901120 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef288044-d6ed-41a3-9328-c2dd8ac103ba None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:35.901404 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef288044-d6ed-41a3-9328-c2dd8ac103ba None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:35.901681 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef288044-d6ed-41a3-9328-c2dd8ac103ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:35.938111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-ef288044-d6ed-41a3-9328-c2dd8ac103ba None None] MFA Rules not processed for user `c0b964a926774a8c88df428b8cb62f44`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:35.940191 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ef288044-d6ed-41a3-9328-c2dd8ac103ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:35.991214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:36.045384 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 945/1877] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:14:36.045681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119f37e-01d5-46bc-9d96-1fdf7fd6e095 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:36.090248 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:36.138953 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119f37e-01d5-46bc-9d96-1fdf7fd6e095 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:36.144527 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fce50f-d61b-4a7a-b851-ac5dee233ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:36.145167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fce50f-d61b-4a7a-b851-ac5dee233ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:36.145449 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fce50f-d61b-4a7a-b851-ac5dee233ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:36.145728 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fce50f-d61b-4a7a-b851-ac5dee233ef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:36.146383 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fce50f-d61b-4a7a-b851-ac5dee233ef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:36.150141 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fce50f-d61b-4a7a-b851-ac5dee233ef0 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:36.198617 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 933/1878] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:36 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:36.201313 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef288044-d6ed-41a3-9328-c2dd8ac103ba None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:36.214108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef288044-d6ed-41a3-9328-c2dd8ac103ba None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:36.301677 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32e208-dd9e-4968-a339-9a0c45328396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:36.303225 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32e208-dd9e-4968-a339-9a0c45328396 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:36.303779 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32e208-dd9e-4968-a339-9a0c45328396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:36.318286 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32e208-dd9e-4968-a339-9a0c45328396 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:36.321785 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32e208-dd9e-4968-a339-9a0c45328396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:36.322914 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32e208-dd9e-4968-a339-9a0c45328396 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:36.374002 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 946/1879] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:36 2022] POST /identity/v3/users => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:36.377895 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fce50f-d61b-4a7a-b851-ac5dee233ef0 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:36.393473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fce50f-d61b-4a7a-b851-ac5dee233ef0 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:36.409871 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4280b1a-db5c-4b5c-800a-610182d0e289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:36.411040 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4280b1a-db5c-4b5c-800a-610182d0e289 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:36.411576 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4280b1a-db5c-4b5c-800a-610182d0e289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:36.412336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4280b1a-db5c-4b5c-800a-610182d0e289 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:36.413303 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4280b1a-db5c-4b5c-800a-610182d0e289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:36.416564 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4280b1a-db5c-4b5c-800a-610182d0e289 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:36.435964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 934/1880] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:14:36.440058 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32e208-dd9e-4968-a339-9a0c45328396 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:36.450378 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4280b1a-db5c-4b5c-800a-610182d0e289 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:36.454266 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f4280b1a-db5c-4b5c-800a-610182d0e289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:36.460091 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32e208-dd9e-4968-a339-9a0c45328396 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:36.472896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32bbee-1005-4128-8804-14e136bf4f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:36.473512 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32bbee-1005-4128-8804-14e136bf4f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:36.473797 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32bbee-1005-4128-8804-14e136bf4f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:36.477175 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32bbee-1005-4128-8804-14e136bf4f6b admin admin] PATH_INFO: `/v3/projects/5f9deea0a5864c389bfdd418a6e3c78f/users/1535a56a966e4b49bfe39ee78f1f2a1a/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:36.477336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4280b1a-db5c-4b5c-800a-610182d0e289 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:36.485252 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931b0fa-a144-4d00-983c-0318a3675228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:36.487560 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931b0fa-a144-4d00-983c-0318a3675228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:36.487995 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931b0fa-a144-4d00-983c-0318a3675228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:36.488362 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931b0fa-a144-4d00-983c-0318a3675228 admin admin] PATH_INFO: `/v3/users/5d60ac83db2249049ca276cb21f14bd9` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:36.490035 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931b0fa-a144-4d00-983c-0318a3675228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d60ac83db2249049ca276cb21f14bd9)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:36.493989 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931b0fa-a144-4d00-983c-0318a3675228 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:36.509886 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32bbee-1005-4128-8804-14e136bf4f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f9deea0a5864c389bfdd418a6e3c78f, user_id=1535a56a966e4b49bfe39ee78f1f2a1a, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:36.512811 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32bbee-1005-4128-8804-14e136bf4f6b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:36.545095 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 947/1881] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:36 2022] PUT /identity/v3/projects/5f9deea0a5864c389bfdd418a6e3c78f/users/1535a56a966e4b49bfe39ee78f1f2a1a/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:36.548708 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32bbee-1005-4128-8804-14e136bf4f6b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:36.620214 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1931b0fa-a144-4d00-983c-0318a3675228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d60ac83db2249049ca276cb21f14bd9'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:36.634527 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1931b0fa-a144-4d00-983c-0318a3675228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d60ac83db2249049ca276cb21f14bd9'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:36.655510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1931b0fa-a144-4d00-983c-0318a3675228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d60ac83db2249049ca276cb21f14bd9'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:36.704620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1931b0fa-a144-4d00-983c-0318a3675228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d60ac83db2249049ca276cb21f14bd9'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:36.705750 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1931b0fa-a144-4d00-983c-0318a3675228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d60ac83db2249049ca276cb21f14bd9'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:36.715032 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 935/1882] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:36 2022] DELETE /identity/v3/users/5d60ac83db2249049ca276cb21f14bd9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:36.719582 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4f8b4-0b92-4b47-a89a-e8e25749e24d None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:36.720005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4f8b4-0b92-4b47-a89a-e8e25749e24d None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:36.720377 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4f8b4-0b92-4b47-a89a-e8e25749e24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:36.744565 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-12a4f8b4-0b92-4b47-a89a-e8e25749e24d None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:36.746457 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32bbee-1005-4128-8804-14e136bf4f6b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:36.746622 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-12a4f8b4-0b92-4b47-a89a-e8e25749e24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:36.879353 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:36.920281 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e9759-3066-47bf-aafc-ead4ed8db5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:36.921041 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e9759-3066-47bf-aafc-ead4ed8db5cf admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:36.921422 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e9759-3066-47bf-aafc-ead4ed8db5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:36.922914 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e9759-3066-47bf-aafc-ead4ed8db5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:36.923722 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e9759-3066-47bf-aafc-ead4ed8db5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:36.928541 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e9759-3066-47bf-aafc-ead4ed8db5cf admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:36.937531 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 936/1883] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:14:36.953672 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 948/1884] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:36.955339 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4f8b4-0b92-4b47-a89a-e8e25749e24d None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:36.957156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-12a4f8b4-0b92-4b47-a89a-e8e25749e24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:36.967869 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e9759-3066-47bf-aafc-ead4ed8db5cf admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:36.974582 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9d1e9759-3066-47bf-aafc-ead4ed8db5cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:36.989005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4f8b4-0b92-4b47-a89a-e8e25749e24d None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:37.004079 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0b23a-5b34-49e0-b53d-3a3baccf9307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:37.005298 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0b23a-5b34-49e0-b53d-3a3baccf9307 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:37.006025 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0b23a-5b34-49e0-b53d-3a3baccf9307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:37.007395 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0b23a-5b34-49e0-b53d-3a3baccf9307 admin admin] PATH_INFO: `/v3/projects/5f9deea0a5864c389bfdd418a6e3c78f/users/1535a56a966e4b49bfe39ee78f1f2a1a/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:37.011801 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0b23a-5b34-49e0-b53d-3a3baccf9307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f9deea0a5864c389bfdd418a6e3c78f, user_id=1535a56a966e4b49bfe39ee78f1f2a1a, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:37.018349 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0b23a-5b34-49e0-b53d-3a3baccf9307 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:37.055482 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 937/1885] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:36 2022] PUT /identity/v3/projects/5f9deea0a5864c389bfdd418a6e3c78f/users/1535a56a966e4b49bfe39ee78f1f2a1a/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:37.062758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322dfed-a9c2-4e67-aec7-fdac451f1555 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:37.064054 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322dfed-a9c2-4e67-aec7-fdac451f1555 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:37.065183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322dfed-a9c2-4e67-aec7-fdac451f1555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:37.103496 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e9759-3066-47bf-aafc-ead4ed8db5cf admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:37.111621 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:37.150094 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-f322dfed-a9c2-4e67-aec7-fdac451f1555 None None] MFA Rules not processed for user `1535a56a966e4b49bfe39ee78f1f2a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:37.151945 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f322dfed-a9c2-4e67-aec7-fdac451f1555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:37.182478 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f8c65-913d-4614-a714-d9ef55f0efe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:37.183119 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f8c65-913d-4614-a714-d9ef55f0efe9 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:37.183402 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f8c65-913d-4614-a714-d9ef55f0efe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:37.183702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f8c65-913d-4614-a714-d9ef55f0efe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:37.308326 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 938/1886] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:37.321515 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322dfed-a9c2-4e67-aec7-fdac451f1555 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:37.323785 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f322dfed-a9c2-4e67-aec7-fdac451f1555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:37.328756 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f8c65-913d-4614-a714-d9ef55f0efe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:37.332122 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f8c65-913d-4614-a714-d9ef55f0efe9 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:37.349154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 949/1887] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:37.412853 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322dfed-a9c2-4e67-aec7-fdac451f1555 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:37.419482 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00929c14-1f19-4915-8bac-dc4dd216d529 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:37.420596 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00929c14-1f19-4915-8bac-dc4dd216d529 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:37.421030 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00929c14-1f19-4915-8bac-dc4dd216d529 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:37.421420 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00929c14-1f19-4915-8bac-dc4dd216d529 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:37.424052 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-00929c14-1f19-4915-8bac-dc4dd216d529 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:37.519514 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00929c14-1f19-4915-8bac-dc4dd216d529 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:37.522119 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00929c14-1f19-4915-8bac-dc4dd216d529 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:37.545983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 939/1888] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:38.638520 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f8c65-913d-4614-a714-d9ef55f0efe9 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:38.640309 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a21f8c65-913d-4614-a714-d9ef55f0efe9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:38.699931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f8c65-913d-4614-a714-d9ef55f0efe9 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:38.706055 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fd294-d08e-4410-80e6-ba944f4bd3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:38.706697 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fd294-d08e-4410-80e6-ba944f4bd3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:38.706980 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fd294-d08e-4410-80e6-ba944f4bd3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:38.707255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fd294-d08e-4410-80e6-ba944f4bd3c5 admin admin] PATH_INFO: `/v3/projects/63bd524653c841c5a19907db8826e80f` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:38.708669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fd294-d08e-4410-80e6-ba944f4bd3c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63bd524653c841c5a19907db8826e80f)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:38.710871 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fd294-d08e-4410-80e6-ba944f4bd3c5 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:38.844660 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:38.853535 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-868fd294-d08e-4410-80e6-ba944f4bd3c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63bd524653c841c5a19907db8826e80f', 'request_id': 'req-868fd294-d08e-4410-80e6-ba944f4bd3c5'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:38.877241 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-868fd294-d08e-4410-80e6-ba944f4bd3c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63bd524653c841c5a19907db8826e80f', 'request_id': 'req-868fd294-d08e-4410-80e6-ba944f4bd3c5'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:38.885298 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-868fd294-d08e-4410-80e6-ba944f4bd3c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63bd524653c841c5a19907db8826e80f', 'request_id': 'req-868fd294-d08e-4410-80e6-ba944f4bd3c5'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:38.898557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-868fd294-d08e-4410-80e6-ba944f4bd3c5 admin admin] The token cache is being invalidate because project 63bd524653c841c5a19907db8826e80f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:38.899025 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-868fd294-d08e-4410-80e6-ba944f4bd3c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:38.900355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-868fd294-d08e-4410-80e6-ba944f4bd3c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:38.905315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 950/1889] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:38 2022] DELETE /identity/v3/projects/63bd524653c841c5a19907db8826e80f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:38.909599 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00929c14-1f19-4915-8bac-dc4dd216d529 service cinder] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:38.924973 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00929c14-1f19-4915-8bac-dc4dd216d529 service cinder] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:39.008075 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:39.024532 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40480d4b-ced8-4ba3-89cd-c4418e91384c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:39.025428 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40480d4b-ced8-4ba3-89cd-c4418e91384c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:39.025861 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40480d4b-ced8-4ba3-89cd-c4418e91384c admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:39.026283 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40480d4b-ced8-4ba3-89cd-c4418e91384c admin admin] PATH_INFO: `/v3/users/c770accbff4347afb85fcfeed6ce4f75` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:39.027993 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40480d4b-ced8-4ba3-89cd-c4418e91384c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c770accbff4347afb85fcfeed6ce4f75)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:39.030188 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40480d4b-ced8-4ba3-89cd-c4418e91384c admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:39.134899 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-40480d4b-ced8-4ba3-89cd-c4418e91384c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c770accbff4347afb85fcfeed6ce4f75'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:39.144769 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-40480d4b-ced8-4ba3-89cd-c4418e91384c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c770accbff4347afb85fcfeed6ce4f75'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:39.158798 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-40480d4b-ced8-4ba3-89cd-c4418e91384c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c770accbff4347afb85fcfeed6ce4f75'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:39.174173 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-40480d4b-ced8-4ba3-89cd-c4418e91384c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c770accbff4347afb85fcfeed6ce4f75'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:39.175321 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-40480d4b-ced8-4ba3-89cd-c4418e91384c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c770accbff4347afb85fcfeed6ce4f75'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:39.191737 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 940/1890] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:38 2022] DELETE /identity/v3/users/c770accbff4347afb85fcfeed6ce4f75 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:39.454952 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fd294-d08e-4410-80e6-ba944f4bd3c5 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:39.456753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-868fd294-d08e-4410-80e6-ba944f4bd3c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:39.610687 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fd294-d08e-4410-80e6-ba944f4bd3c5 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:39.725596 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6364700-fc78-44e0-8731-9d038955a44e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:39.727943 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6364700-fc78-44e0-8731-9d038955a44e service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:39.729358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6364700-fc78-44e0-8731-9d038955a44e service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:39.729804 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6364700-fc78-44e0-8731-9d038955a44e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:39.732503 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b6364700-fc78-44e0-8731-9d038955a44e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:39.922099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6364700-fc78-44e0-8731-9d038955a44e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:39.934922 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6364700-fc78-44e0-8731-9d038955a44e service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:39.973571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 951/1891] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:40.046318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40480d4b-ced8-4ba3-89cd-c4418e91384c admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:40.048053 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-40480d4b-ced8-4ba3-89cd-c4418e91384c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:40.184244 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40480d4b-ced8-4ba3-89cd-c4418e91384c admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:40.190052 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0998b-45f0-4eef-8b2c-cfd9c985f696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:40.190846 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0998b-45f0-4eef-8b2c-cfd9c985f696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:40.191200 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0998b-45f0-4eef-8b2c-cfd9c985f696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:40.191565 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0998b-45f0-4eef-8b2c-cfd9c985f696 admin admin] PATH_INFO: `/v3/projects/9c4b9262501c4a239c45cec859a8b815` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:40.192825 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0998b-45f0-4eef-8b2c-cfd9c985f696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c4b9262501c4a239c45cec859a8b815)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:40.195638 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0998b-45f0-4eef-8b2c-cfd9c985f696 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:40.269643 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-ccd0998b-45f0-4eef-8b2c-cfd9c985f696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c4b9262501c4a239c45cec859a8b815', 'request_id': 'req-ccd0998b-45f0-4eef-8b2c-cfd9c985f696'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:40.294059 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-ccd0998b-45f0-4eef-8b2c-cfd9c985f696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c4b9262501c4a239c45cec859a8b815', 'request_id': 'req-ccd0998b-45f0-4eef-8b2c-cfd9c985f696'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:40.309126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-ccd0998b-45f0-4eef-8b2c-cfd9c985f696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c4b9262501c4a239c45cec859a8b815', 'request_id': 'req-ccd0998b-45f0-4eef-8b2c-cfd9c985f696'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:40.317574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:40.362657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-ccd0998b-45f0-4eef-8b2c-cfd9c985f696 admin admin] The token cache is being invalidate because project 9c4b9262501c4a239c45cec859a8b815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:40.363139 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-ccd0998b-45f0-4eef-8b2c-cfd9c985f696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:40.364864 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-ccd0998b-45f0-4eef-8b2c-cfd9c985f696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:40.372255 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 941/1892] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:40 2022] DELETE /identity/v3/projects/9c4b9262501c4a239c45cec859a8b815 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:40.373996 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789651f-810e-442e-9b3f-c709f362f41e None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:40.375367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789651f-810e-442e-9b3f-c709f362f41e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:40.375726 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789651f-810e-442e-9b3f-c709f362f41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:40.407383 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-7789651f-810e-442e-9b3f-c709f362f41e None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:40.408865 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7789651f-810e-442e-9b3f-c709f362f41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:40.474523 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:40.535504 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 952/1893] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:40.544679 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3bb24-3a87-46cc-b824-e361f045897a None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:40.545117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3bb24-3a87-46cc-b824-e361f045897a None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:40.545543 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3bb24-3a87-46cc-b824-e361f045897a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:40.584776 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-74e3bb24-3a87-46cc-b824-e361f045897a None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:40.586808 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-74e3bb24-3a87-46cc-b824-e361f045897a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:40.633347 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 942/1894] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:40.634833 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789651f-810e-442e-9b3f-c709f362f41e None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:40.666780 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789651f-810e-442e-9b3f-c709f362f41e None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:40.709549 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76a3cb-6ab9-4a47-9cac-f648746eb100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:40.710188 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76a3cb-6ab9-4a47-9cac-f648746eb100 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:40.710487 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76a3cb-6ab9-4a47-9cac-f648746eb100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:40.711303 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76a3cb-6ab9-4a47-9cac-f648746eb100 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:40.717717 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76a3cb-6ab9-4a47-9cac-f648746eb100 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:40.718042 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76a3cb-6ab9-4a47-9cac-f648746eb100 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:40.722446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76a3cb-6ab9-4a47-9cac-f648746eb100 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:40.759621 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 953/1895] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:14:40.763731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3bb24-3a87-46cc-b824-e361f045897a None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:40.780774 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3bb24-3a87-46cc-b824-e361f045897a None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:40.799346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52263ae-3937-4477-a313-ab560d21cf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:40.800068 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52263ae-3937-4477-a313-ab560d21cf06 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:40.800397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52263ae-3937-4477-a313-ab560d21cf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:40.800672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52263ae-3937-4477-a313-ab560d21cf06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:40.801962 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52263ae-3937-4477-a313-ab560d21cf06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:40.808073 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52263ae-3937-4477-a313-ab560d21cf06 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:40.877382 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 943/1896] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:40 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:40.883308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76a3cb-6ab9-4a47-9cac-f648746eb100 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:40.901406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76a3cb-6ab9-4a47-9cac-f648746eb100 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:40.994958 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28c533-7dd0-417d-9b2c-b9a73e67926e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:40.996422 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28c533-7dd0-417d-9b2c-b9a73e67926e admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:40.996844 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28c533-7dd0-417d-9b2c-b9a73e67926e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:40.997261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28c533-7dd0-417d-9b2c-b9a73e67926e admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:40.998108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28c533-7dd0-417d-9b2c-b9a73e67926e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:41.001477 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28c533-7dd0-417d-9b2c-b9a73e67926e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:41.044938 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52263ae-3937-4477-a313-ab560d21cf06 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:41.051549 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 954/1897] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:40 2022] POST /identity/v3/users => generated 294 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:41.063453 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52263ae-3937-4477-a313-ab560d21cf06 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:41.075319 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da8504-9d8b-4023-85c9-f5e5b10d1762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:41.077094 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da8504-9d8b-4023-85c9-f5e5b10d1762 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:41.079038 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da8504-9d8b-4023-85c9-f5e5b10d1762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:41.079413 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da8504-9d8b-4023-85c9-f5e5b10d1762 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:41.081218 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da8504-9d8b-4023-85c9-f5e5b10d1762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:41.086165 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da8504-9d8b-4023-85c9-f5e5b10d1762 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:41.113270 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 944/1898] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:14:41.117534 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28c533-7dd0-417d-9b2c-b9a73e67926e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:41.144374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28c533-7dd0-417d-9b2c-b9a73e67926e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:41.173416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83f48a-b793-4e9e-912d-280055228e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:41.174226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83f48a-b793-4e9e-912d-280055228e25 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:41.174588 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83f48a-b793-4e9e-912d-280055228e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:41.174779 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83f48a-b793-4e9e-912d-280055228e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:41.175545 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83f48a-b793-4e9e-912d-280055228e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:41.178989 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da8504-9d8b-4023-85c9-f5e5b10d1762 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:41.180552 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83f48a-b793-4e9e-912d-280055228e25 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:41.183368 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-01da8504-9d8b-4023-85c9-f5e5b10d1762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:41.211248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 955/1899] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:14:41.212329 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83f48a-b793-4e9e-912d-280055228e25 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:41.237120 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83f48a-b793-4e9e-912d-280055228e25 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:41.252118 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a974d4-95c1-41b0-b3f2-15c7729f9ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:41.253037 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a974d4-95c1-41b0-b3f2-15c7729f9ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:41.253318 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a974d4-95c1-41b0-b3f2-15c7729f9ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:41.253594 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a974d4-95c1-41b0-b3f2-15c7729f9ac3 admin admin] PATH_INFO: `/v3/projects/407eff16c59743acb5b96c787281fd31/users/404d37164c204318996e55097866d2cc/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:41.289626 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a974d4-95c1-41b0-b3f2-15c7729f9ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=407eff16c59743acb5b96c787281fd31, user_id=404d37164c204318996e55097866d2cc, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:41.298167 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a974d4-95c1-41b0-b3f2-15c7729f9ac3 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:41.346080 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 956/1900] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:41 2022] PUT /identity/v3/projects/407eff16c59743acb5b96c787281fd31/users/404d37164c204318996e55097866d2cc/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:41.359330 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67007c4a-3a88-4eb8-9d82-20cec2e21545 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:41.359918 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67007c4a-3a88-4eb8-9d82-20cec2e21545 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:41.362373 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67007c4a-3a88-4eb8-9d82-20cec2e21545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:41.401955 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da8504-9d8b-4023-85c9-f5e5b10d1762 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:41.426232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-67007c4a-3a88-4eb8-9d82-20cec2e21545 None None] MFA Rules not processed for user `404d37164c204318996e55097866d2cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:41.428098 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-67007c4a-3a88-4eb8-9d82-20cec2e21545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:41.517869 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15cb19-83a5-4601-80eb-51f5420d3bb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:41.519711 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15cb19-83a5-4601-80eb-51f5420d3bb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:41.520311 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15cb19-83a5-4601-80eb-51f5420d3bb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:41.522393 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15cb19-83a5-4601-80eb-51f5420d3bb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:41.527616 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-8e15cb19-83a5-4601-80eb-51f5420d3bb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:41.617619 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 957/1901] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:14:41.622000 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67007c4a-3a88-4eb8-9d82-20cec2e21545 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:41.644590 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:41.681557 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15cb19-83a5-4601-80eb-51f5420d3bb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:41.683581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15cb19-83a5-4601-80eb-51f5420d3bb6 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:41.698224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 945/1902] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:41.762805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67007c4a-3a88-4eb8-9d82-20cec2e21545 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:41.772969 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20985557-d64b-4ee9-b3d8-8bd2082644e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:41.779583 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20985557-d64b-4ee9-b3d8-8bd2082644e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:41.781522 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20985557-d64b-4ee9-b3d8-8bd2082644e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:41.782126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20985557-d64b-4ee9-b3d8-8bd2082644e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:41.790482 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20985557-d64b-4ee9-b3d8-8bd2082644e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:41.794858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20985557-d64b-4ee9-b3d8-8bd2082644e0 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:41.899508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 958/1903] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:41 2022] POST /identity/v3/projects => generated 387 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:41.904075 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15cb19-83a5-4601-80eb-51f5420d3bb6 service cinder] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:41.926242 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15cb19-83a5-4601-80eb-51f5420d3bb6 service cinder] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:41.968194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:42.022738 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6449d-0f77-48d7-af9d-43432e7533c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:42.024155 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6449d-0f77-48d7-af9d-43432e7533c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:42.024623 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6449d-0f77-48d7-af9d-43432e7533c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:42.024982 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6449d-0f77-48d7-af9d-43432e7533c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:42.026004 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6449d-0f77-48d7-af9d-43432e7533c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:42.029068 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6449d-0f77-48d7-af9d-43432e7533c3 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:42.114438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20985557-d64b-4ee9-b3d8-8bd2082644e0 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:42.137092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 946/1904] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:41 2022] POST /identity/v3/users => generated 300 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:42.148961 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20985557-d64b-4ee9-b3d8-8bd2082644e0 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:42.167598 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490cb23e-ea11-4b78-968d-bc460e0db4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:42.168500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cb23e-ea11-4b78-968d-bc460e0db4cb admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:42.169233 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cb23e-ea11-4b78-968d-bc460e0db4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:42.169681 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cb23e-ea11-4b78-968d-bc460e0db4cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:42.170406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490cb23e-ea11-4b78-968d-bc460e0db4cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:42.172999 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490cb23e-ea11-4b78-968d-bc460e0db4cb admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:42.203267 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 959/1905] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:42.204973 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6449d-0f77-48d7-af9d-43432e7533c3 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:42.227091 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6449d-0f77-48d7-af9d-43432e7533c3 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:42.235185 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80238a-d6c8-4a58-a602-e29e02e61737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:42.236525 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80238a-d6c8-4a58-a602-e29e02e61737 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:42.237225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80238a-d6c8-4a58-a602-e29e02e61737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:42.237701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80238a-d6c8-4a58-a602-e29e02e61737 admin admin] PATH_INFO: `/v3/projects/31540aa5dcaa4010bcc8aa1e85c9966b/users/978c5a92cfcd4ab794dea77ce70ee5e2/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:42.265993 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80238a-d6c8-4a58-a602-e29e02e61737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31540aa5dcaa4010bcc8aa1e85c9966b, user_id=978c5a92cfcd4ab794dea77ce70ee5e2, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:42.269078 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80238a-d6c8-4a58-a602-e29e02e61737 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:42.302070 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 947/1906] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:42 2022] PUT /identity/v3/projects/31540aa5dcaa4010bcc8aa1e85c9966b/users/978c5a92cfcd4ab794dea77ce70ee5e2/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:42.302559 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490cb23e-ea11-4b78-968d-bc460e0db4cb admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:42.323914 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490cb23e-ea11-4b78-968d-bc460e0db4cb admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:42.431483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e9577-9d8d-4f36-a539-25d547948906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:42.432126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e9577-9d8d-4f36-a539-25d547948906 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:42.432406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e9577-9d8d-4f36-a539-25d547948906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:42.432683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e9577-9d8d-4f36-a539-25d547948906 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:42.433335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e9577-9d8d-4f36-a539-25d547948906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:42.435053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e9577-9d8d-4f36-a539-25d547948906 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:42.450611 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 960/1907] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:14:42.452241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80238a-d6c8-4a58-a602-e29e02e61737 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:42.464472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80238a-d6c8-4a58-a602-e29e02e61737 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:42.493385 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccc686-467b-433d-aaa2-379250102dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:42.495794 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccc686-467b-433d-aaa2-379250102dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:42.498275 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccc686-467b-433d-aaa2-379250102dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:42.498583 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccc686-467b-433d-aaa2-379250102dfc admin admin] PATH_INFO: `/v3/projects/31540aa5dcaa4010bcc8aa1e85c9966b/users/978c5a92cfcd4ab794dea77ce70ee5e2/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:42.503562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccc686-467b-433d-aaa2-379250102dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=31540aa5dcaa4010bcc8aa1e85c9966b, user_id=978c5a92cfcd4ab794dea77ce70ee5e2, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:42.506512 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccc686-467b-433d-aaa2-379250102dfc admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:42.569354 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 948/1908] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:42 2022] PUT /identity/v3/projects/31540aa5dcaa4010bcc8aa1e85c9966b/users/978c5a92cfcd4ab794dea77ce70ee5e2/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:42.573118 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e72d7b-2a35-4963-9d6f-43e4803892e3 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:42.573543 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e72d7b-2a35-4963-9d6f-43e4803892e3 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:42.573995 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e72d7b-2a35-4963-9d6f-43e4803892e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:42.637104 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-01e72d7b-2a35-4963-9d6f-43e4803892e3 None None] MFA Rules not processed for user `978c5a92cfcd4ab794dea77ce70ee5e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:42.638994 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-01e72d7b-2a35-4963-9d6f-43e4803892e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:42.744303 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 961/1909] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:42 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:42.752504 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccc686-467b-433d-aaa2-379250102dfc admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:42.754654 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-12ccc686-467b-433d-aaa2-379250102dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:42.835225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccc686-467b-433d-aaa2-379250102dfc admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:42.839706 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a7214-077a-40fe-823f-941a45bd33f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:42.840485 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a7214-077a-40fe-823f-941a45bd33f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:42.840860 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a7214-077a-40fe-823f-941a45bd33f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:42.841332 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a7214-077a-40fe-823f-941a45bd33f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:42.857962 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a7214-077a-40fe-823f-941a45bd33f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:42.860181 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a7214-077a-40fe-823f-941a45bd33f5 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:42.878753 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 949/1910] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:42.920990 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e72d7b-2a35-4963-9d6f-43e4803892e3 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:42.932141 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:43.004228 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e72d7b-2a35-4963-9d6f-43e4803892e3 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:43.012190 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc511cc2-52af-4b36-89e1-ba37ecb67a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:43.013054 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc511cc2-52af-4b36-89e1-ba37ecb67a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:43.013566 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc511cc2-52af-4b36-89e1-ba37ecb67a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:43.013937 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc511cc2-52af-4b36-89e1-ba37ecb67a02 admin admin] PATH_INFO: `/v3/users/404d37164c204318996e55097866d2cc` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:43.015251 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc511cc2-52af-4b36-89e1-ba37ecb67a02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=404d37164c204318996e55097866d2cc)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:43.018806 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc511cc2-52af-4b36-89e1-ba37ecb67a02 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:43.137777 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cc511cc2-52af-4b36-89e1-ba37ecb67a02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '404d37164c204318996e55097866d2cc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:43.148530 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cc511cc2-52af-4b36-89e1-ba37ecb67a02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '404d37164c204318996e55097866d2cc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:43.176493 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cc511cc2-52af-4b36-89e1-ba37ecb67a02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '404d37164c204318996e55097866d2cc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:43.192318 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cc511cc2-52af-4b36-89e1-ba37ecb67a02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '404d37164c204318996e55097866d2cc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:43.193197 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cc511cc2-52af-4b36-89e1-ba37ecb67a02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '404d37164c204318996e55097866d2cc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:43.211408 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 962/1911] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:42 2022] DELETE /identity/v3/users/404d37164c204318996e55097866d2cc => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:43.213981 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa7d3a-64f3-419e-b3bc-e272f0f1d757 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:43.214432 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa7d3a-64f3-419e-b3bc-e272f0f1d757 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:43.214640 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa7d3a-64f3-419e-b3bc-e272f0f1d757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:43.256974 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-d3aa7d3a-64f3-419e-b3bc-e272f0f1d757 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:43.264288 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d3aa7d3a-64f3-419e-b3bc-e272f0f1d757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:43.364977 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 950/1912] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:43.415672 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc511cc2-52af-4b36-89e1-ba37ecb67a02 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:43.417249 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-cc511cc2-52af-4b36-89e1-ba37ecb67a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:43.572767 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc511cc2-52af-4b36-89e1-ba37ecb67a02 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:43.611960 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0a970-0c0f-4fa6-84ec-cdb6c98783a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:43.611960 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0a970-0c0f-4fa6-84ec-cdb6c98783a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:43.611960 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0a970-0c0f-4fa6-84ec-cdb6c98783a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:43.611960 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0a970-0c0f-4fa6-84ec-cdb6c98783a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:43.668851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0a970-0c0f-4fa6-84ec-cdb6c98783a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:43.670495 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0a970-0c0f-4fa6-84ec-cdb6c98783a6 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:43.705236 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 963/1913] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:43.997493 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f471e-103d-4640-a927-9f7685e9b07c None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:43.997856 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f471e-103d-4640-a927-9f7685e9b07c None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:43.998258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f471e-103d-4640-a927-9f7685e9b07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:44.067082 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-5c3f471e-103d-4640-a927-9f7685e9b07c None None] MFA Rules not processed for user `6c07ba7394f94a11afff691b4723bb60`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:44.071712 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-5c3f471e-103d-4640-a927-9f7685e9b07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:44.081013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:44.175374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 951/1914] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:44.197231 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0a970-0c0f-4fa6-84ec-cdb6c98783a6 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:44.198722 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-69d0a970-0c0f-4fa6-84ec-cdb6c98783a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:44.285856 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f471e-103d-4640-a927-9f7685e9b07c None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:44.287886 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-5c3f471e-103d-4640-a927-9f7685e9b07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:44.293377 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:44.319016 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f471e-103d-4640-a927-9f7685e9b07c None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:44.326183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e388950-2489-4ae7-864c-de318bbb707d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:44.326834 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e388950-2489-4ae7-864c-de318bbb707d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:44.327114 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e388950-2489-4ae7-864c-de318bbb707d admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:44.327465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e388950-2489-4ae7-864c-de318bbb707d admin admin] PATH_INFO: `/v3/projects/407eff16c59743acb5b96c787281fd31` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:44.329078 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e388950-2489-4ae7-864c-de318bbb707d admin admin] RBAC: Authorizing `identity:delete_project(project_id=407eff16c59743acb5b96c787281fd31)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:44.332232 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e388950-2489-4ae7-864c-de318bbb707d admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:44.373045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0a970-0c0f-4fa6-84ec-cdb6c98783a6 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:44.377361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c173b-b2b5-42f3-8c69-ac49426398ac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0866de4d4e46d5b26719faf385d7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:44.377979 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c173b-b2b5-42f3-8c69-ac49426398ac service glance] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:44.378289 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c173b-b2b5-42f3-8c69-ac49426398ac service glance] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:44.378519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c173b-b2b5-42f3-8c69-ac49426398ac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:44.380842 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-129c173b-b2b5-42f3-8c69-ac49426398ac service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:44.424385 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-5e388950-2489-4ae7-864c-de318bbb707d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '407eff16c59743acb5b96c787281fd31', 'request_id': 'req-5e388950-2489-4ae7-864c-de318bbb707d'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:44.434117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-5e388950-2489-4ae7-864c-de318bbb707d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '407eff16c59743acb5b96c787281fd31', 'request_id': 'req-5e388950-2489-4ae7-864c-de318bbb707d'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:44.442426 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-5e388950-2489-4ae7-864c-de318bbb707d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '407eff16c59743acb5b96c787281fd31', 'request_id': 'req-5e388950-2489-4ae7-864c-de318bbb707d'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:44.454669 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-5e388950-2489-4ae7-864c-de318bbb707d admin admin] The token cache is being invalidate because project 407eff16c59743acb5b96c787281fd31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:44.455080 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-5e388950-2489-4ae7-864c-de318bbb707d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:44.455826 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-5e388950-2489-4ae7-864c-de318bbb707d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:44.457408 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 952/1915] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:44 2022] DELETE /identity/v3/projects/407eff16c59743acb5b96c787281fd31 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:44.462787 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e388950-2489-4ae7-864c-de318bbb707d admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:44.464517 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-5e388950-2489-4ae7-864c-de318bbb707d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:44.472760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c173b-b2b5-42f3-8c69-ac49426398ac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:44.474769 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c173b-b2b5-42f3-8c69-ac49426398ac service glance] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:44.496137 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 964/1916] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:44.550938 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e388950-2489-4ae7-864c-de318bbb707d admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:44.556119 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68687fa6-09f4-4021-8b14-208a31e0df48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:44.556812 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68687fa6-09f4-4021-8b14-208a31e0df48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:44.557478 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68687fa6-09f4-4021-8b14-208a31e0df48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:44.557753 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68687fa6-09f4-4021-8b14-208a31e0df48 admin admin] PATH_INFO: `/v3/users/978c5a92cfcd4ab794dea77ce70ee5e2` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:44.558995 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68687fa6-09f4-4021-8b14-208a31e0df48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=978c5a92cfcd4ab794dea77ce70ee5e2)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:44.561613 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68687fa6-09f4-4021-8b14-208a31e0df48 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:44.606884 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:44.662170 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-68687fa6-09f4-4021-8b14-208a31e0df48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '978c5a92cfcd4ab794dea77ce70ee5e2'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:44.678145 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-68687fa6-09f4-4021-8b14-208a31e0df48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '978c5a92cfcd4ab794dea77ce70ee5e2'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:44.709305 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-68687fa6-09f4-4021-8b14-208a31e0df48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '978c5a92cfcd4ab794dea77ce70ee5e2'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:44.725806 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-68687fa6-09f4-4021-8b14-208a31e0df48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '978c5a92cfcd4ab794dea77ce70ee5e2'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:44.727194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-68687fa6-09f4-4021-8b14-208a31e0df48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '978c5a92cfcd4ab794dea77ce70ee5e2'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:44.735343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 953/1917] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:44 2022] DELETE /identity/v3/users/978c5a92cfcd4ab794dea77ce70ee5e2 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:44.803253 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dfb70-a2c5-4e9c-8114-b64ad94c8e0f None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:44.804044 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dfb70-a2c5-4e9c-8114-b64ad94c8e0f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:44.804642 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dfb70-a2c5-4e9c-8114-b64ad94c8e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:44.840942 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-cc8dfb70-a2c5-4e9c-8114-b64ad94c8e0f None None] MFA Rules not processed for user `f3254b4fddaa4f099c6c44f4c139ee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:44.842817 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-cc8dfb70-a2c5-4e9c-8114-b64ad94c8e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:44.935171 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 965/1918] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 24 13:14:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:45.035776 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68687fa6-09f4-4021-8b14-208a31e0df48 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:45.037397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-68687fa6-09f4-4021-8b14-208a31e0df48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:45.174542 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68687fa6-09f4-4021-8b14-208a31e0df48 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:45.182777 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05507be5-9005-431b-b01c-2d0d61022736 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '768c71ab4ab241e4bfed9f7561ae3d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:45.183463 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05507be5-9005-431b-b01c-2d0d61022736 service swift] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:45.183753 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05507be5-9005-431b-b01c-2d0d61022736 service swift] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:45.184053 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05507be5-9005-431b-b01c-2d0d61022736 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:45.205991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05507be5-9005-431b-b01c-2d0d61022736 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:45.214021 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05507be5-9005-431b-b01c-2d0d61022736 service swift] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:45.229191 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 954/1919] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 24 13:14:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:14:45.243090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dfb70-a2c5-4e9c-8114-b64ad94c8e0f None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:45.245605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-cc8dfb70-a2c5-4e9c-8114-b64ad94c8e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:45.360818 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dfb70-a2c5-4e9c-8114-b64ad94c8e0f None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:45.369794 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2231b23-1f0e-4bf0-a930-3332fe846c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:45.370640 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2231b23-1f0e-4bf0-a930-3332fe846c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:45.371140 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2231b23-1f0e-4bf0-a930-3332fe846c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:45.371451 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2231b23-1f0e-4bf0-a930-3332fe846c26 admin admin] PATH_INFO: `/v3/projects/31540aa5dcaa4010bcc8aa1e85c9966b` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:45.372789 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2231b23-1f0e-4bf0-a930-3332fe846c26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31540aa5dcaa4010bcc8aa1e85c9966b)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:45.375051 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2231b23-1f0e-4bf0-a930-3332fe846c26 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:45.390371 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:45.442108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b2231b23-1f0e-4bf0-a930-3332fe846c26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31540aa5dcaa4010bcc8aa1e85c9966b', 'request_id': 'req-b2231b23-1f0e-4bf0-a930-3332fe846c26'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:45.469644 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b2231b23-1f0e-4bf0-a930-3332fe846c26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31540aa5dcaa4010bcc8aa1e85c9966b', 'request_id': 'req-b2231b23-1f0e-4bf0-a930-3332fe846c26'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:45.487202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b2231b23-1f0e-4bf0-a930-3332fe846c26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31540aa5dcaa4010bcc8aa1e85c9966b', 'request_id': 'req-b2231b23-1f0e-4bf0-a930-3332fe846c26'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:45.506256 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b2231b23-1f0e-4bf0-a930-3332fe846c26 admin admin] The token cache is being invalidate because project 31540aa5dcaa4010bcc8aa1e85c9966b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:45.506588 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b2231b23-1f0e-4bf0-a930-3332fe846c26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:45.507220 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b2231b23-1f0e-4bf0-a930-3332fe846c26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:45.511877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 966/1920] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:45 2022] DELETE /identity/v3/projects/31540aa5dcaa4010bcc8aa1e85c9966b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:45.516053 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cf8c6-8cf3-49e4-a430-cba8a2293d52 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:45.516946 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cf8c6-8cf3-49e4-a430-cba8a2293d52 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:45.517431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cf8c6-8cf3-49e4-a430-cba8a2293d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:45.547967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-d55cf8c6-8cf3-49e4-a430-cba8a2293d52 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:45.550146 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d55cf8c6-8cf3-49e4-a430-cba8a2293d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:45.643216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 955/1921] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:45.651842 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff456a-c2aa-418d-be57-7c3f13c82ff6 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:45.652566 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff456a-c2aa-418d-be57-7c3f13c82ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:45.653020 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff456a-c2aa-418d-be57-7c3f13c82ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:45.678836 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-f6ff456a-c2aa-418d-be57-7c3f13c82ff6 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:45.681215 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f6ff456a-c2aa-418d-be57-7c3f13c82ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:45.709643 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 967/1922] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:45.714010 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cf8c6-8cf3-49e4-a430-cba8a2293d52 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:45.724746 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cf8c6-8cf3-49e4-a430-cba8a2293d52 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:45.731212 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6143ab2-8d39-4948-9d72-2b30cd76a666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:45.731889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6143ab2-8d39-4948-9d72-2b30cd76a666 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:45.732484 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6143ab2-8d39-4948-9d72-2b30cd76a666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:45.737450 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6143ab2-8d39-4948-9d72-2b30cd76a666 admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:45.738224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6143ab2-8d39-4948-9d72-2b30cd76a666 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:45.738611 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6143ab2-8d39-4948-9d72-2b30cd76a666 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:45.740459 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6143ab2-8d39-4948-9d72-2b30cd76a666 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:45.768652 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 956/1923] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:14:45.769523 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff456a-c2aa-418d-be57-7c3f13c82ff6 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:45.782527 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff456a-c2aa-418d-be57-7c3f13c82ff6 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:45.787881 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c8d64-bda8-4a2a-8b1a-1019e112b472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:45.788496 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c8d64-bda8-4a2a-8b1a-1019e112b472 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:45.789319 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c8d64-bda8-4a2a-8b1a-1019e112b472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:45.789588 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c8d64-bda8-4a2a-8b1a-1019e112b472 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:45.790257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c8d64-bda8-4a2a-8b1a-1019e112b472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:45.792350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c8d64-bda8-4a2a-8b1a-1019e112b472 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:45.848364 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 968/1924] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:45 2022] POST /identity/v3/projects => generated 379 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:45.852878 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6143ab2-8d39-4948-9d72-2b30cd76a666 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:45.864299 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6143ab2-8d39-4948-9d72-2b30cd76a666 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:45.914544 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:45.996071 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605f137-95c6-4f48-8dc1-a6efc12f1ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:45.996689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605f137-95c6-4f48-8dc1-a6efc12f1ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:45.997006 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605f137-95c6-4f48-8dc1-a6efc12f1ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:45.997711 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605f137-95c6-4f48-8dc1-a6efc12f1ec8 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:45.998359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605f137-95c6-4f48-8dc1-a6efc12f1ec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:46.001047 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605f137-95c6-4f48-8dc1-a6efc12f1ec8 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:46.047408 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 957/1925] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:45 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:46.048362 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c8d64-bda8-4a2a-8b1a-1019e112b472 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:46.059332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c8d64-bda8-4a2a-8b1a-1019e112b472 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:46.081808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038c228-c370-4a68-957f-05ed9a87a616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:46.082757 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038c228-c370-4a68-957f-05ed9a87a616 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:46.083541 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038c228-c370-4a68-957f-05ed9a87a616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:46.084040 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038c228-c370-4a68-957f-05ed9a87a616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:46.084988 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038c228-c370-4a68-957f-05ed9a87a616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:46.088146 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038c228-c370-4a68-957f-05ed9a87a616 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:46.104498 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605f137-95c6-4f48-8dc1-a6efc12f1ec8 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:46.106155 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 969/1926] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:46.128007 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605f137-95c6-4f48-8dc1-a6efc12f1ec8 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:46.135773 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9e807-eaa1-4d50-a2ca-4ab78867a627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:46.136756 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9e807-eaa1-4d50-a2ca-4ab78867a627 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:46.137218 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9e807-eaa1-4d50-a2ca-4ab78867a627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:46.137668 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9e807-eaa1-4d50-a2ca-4ab78867a627 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:46.138807 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9e807-eaa1-4d50-a2ca-4ab78867a627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:46.140882 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9e807-eaa1-4d50-a2ca-4ab78867a627 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:46.166842 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038c228-c370-4a68-957f-05ed9a87a616 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:46.172230 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 958/1927] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:46.177549 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038c228-c370-4a68-957f-05ed9a87a616 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:46.190429 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb591eb3-be95-4f8b-b36f-22f6f99daece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:46.191168 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb591eb3-be95-4f8b-b36f-22f6f99daece admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:46.191378 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb591eb3-be95-4f8b-b36f-22f6f99daece admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:46.191695 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb591eb3-be95-4f8b-b36f-22f6f99daece admin admin] PATH_INFO: `/v3/projects/4117f208692d4940bf3198060309b8e6/users/50509af6d150462a833b606e846b7fc5/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:46.224419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb591eb3-be95-4f8b-b36f-22f6f99daece admin admin] RBAC: Authorizing `identity:create_grant(project_id=4117f208692d4940bf3198060309b8e6, user_id=50509af6d150462a833b606e846b7fc5, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:46.234337 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb591eb3-be95-4f8b-b36f-22f6f99daece admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:46.263527 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 970/1928] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:46 2022] PUT /identity/v3/projects/4117f208692d4940bf3198060309b8e6/users/50509af6d150462a833b606e846b7fc5/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:46.275721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d0451-ed26-49a0-9bfd-eb1b6776267a None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:46.276233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d0451-ed26-49a0-9bfd-eb1b6776267a None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:46.276470 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d0451-ed26-49a0-9bfd-eb1b6776267a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:46.338845 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-960d0451-ed26-49a0-9bfd-eb1b6776267a None None] MFA Rules not processed for user `50509af6d150462a833b606e846b7fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:46.340189 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-960d0451-ed26-49a0-9bfd-eb1b6776267a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:46.491771 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 959/1929] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:46.496374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb591eb3-be95-4f8b-b36f-22f6f99daece admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:46.739126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb591eb3-be95-4f8b-b36f-22f6f99daece admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:46.752268 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b272129-1462-4afa-8e46-311a27f6bd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:46.752948 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b272129-1462-4afa-8e46-311a27f6bd81 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:46.753336 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b272129-1462-4afa-8e46-311a27f6bd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:46.753721 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b272129-1462-4afa-8e46-311a27f6bd81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:46.755069 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b272129-1462-4afa-8e46-311a27f6bd81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:46.768974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b272129-1462-4afa-8e46-311a27f6bd81 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:46.860284 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 971/1930] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:46 2022] POST /identity/v3/projects => generated 381 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:46.864194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d0451-ed26-49a0-9bfd-eb1b6776267a None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:46.896030 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d0451-ed26-49a0-9bfd-eb1b6776267a None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:47.134771 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebaeac-d650-46f7-bf6a-f5ae6eefeff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:47.135565 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebaeac-d650-46f7-bf6a-f5ae6eefeff0 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:47.135896 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebaeac-d650-46f7-bf6a-f5ae6eefeff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:47.136174 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebaeac-d650-46f7-bf6a-f5ae6eefeff0 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:47.136845 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ebaeac-d650-46f7-bf6a-f5ae6eefeff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:47.140114 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ebaeac-d650-46f7-bf6a-f5ae6eefeff0 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:47.188622 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 960/1931] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:46 2022] POST /identity/v3/users => generated 297 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:47.195285 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b272129-1462-4afa-8e46-311a27f6bd81 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:47.209031 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b272129-1462-4afa-8e46-311a27f6bd81 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:47.221928 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ddc89-ebc9-45ce-81f9-825535249f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:47.225728 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ddc89-ebc9-45ce-81f9-825535249f85 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:47.227117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ddc89-ebc9-45ce-81f9-825535249f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:47.228504 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ddc89-ebc9-45ce-81f9-825535249f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:47.229757 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ddc89-ebc9-45ce-81f9-825535249f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:47.232085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ddc89-ebc9-45ce-81f9-825535249f85 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:47.253596 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 972/1932] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:47.256082 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebaeac-d650-46f7-bf6a-f5ae6eefeff0 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:47.280837 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebaeac-d650-46f7-bf6a-f5ae6eefeff0 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:47.292562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773673d-8097-4715-9b28-96aedf2f7154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:47.295383 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773673d-8097-4715-9b28-96aedf2f7154 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:47.296052 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773673d-8097-4715-9b28-96aedf2f7154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:47.296401 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773673d-8097-4715-9b28-96aedf2f7154 admin admin] PATH_INFO: `/v3/projects/c4857159b2864d22a02507d15f985ee6/users/1bbbee07a71a4cffbc7a933ff085b31b/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:47.348057 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ddc89-ebc9-45ce-81f9-825535249f85 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:47.371370 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-424ddc89-ebc9-45ce-81f9-825535249f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:47.385284 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773673d-8097-4715-9b28-96aedf2f7154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4857159b2864d22a02507d15f985ee6, user_id=1bbbee07a71a4cffbc7a933ff085b31b, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:47.389131 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773673d-8097-4715-9b28-96aedf2f7154 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:47.395028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ddc89-ebc9-45ce-81f9-825535249f85 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:47.396685 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:47.406499 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4a3f6-6e2f-4097-b735-eb368ada5039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:47.407406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4a3f6-6e2f-4097-b735-eb368ada5039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:47.407688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4a3f6-6e2f-4097-b735-eb368ada5039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:47.408108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4a3f6-6e2f-4097-b735-eb368ada5039 admin admin] PATH_INFO: `/v3/users/98dc11a54c8c45b89e696086b86ceadc` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:47.409430 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4a3f6-6e2f-4097-b735-eb368ada5039 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98dc11a54c8c45b89e696086b86ceadc)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:47.412048 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4a3f6-6e2f-4097-b735-eb368ada5039 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:47.419808 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 961/1933] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:47 2022] PUT /identity/v3/projects/c4857159b2864d22a02507d15f985ee6/users/1bbbee07a71a4cffbc7a933ff085b31b/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:47.424001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773673d-8097-4715-9b28-96aedf2f7154 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:47.429940 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:47.575279 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-33a4a3f6-6e2f-4097-b735-eb368ada5039 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98dc11a54c8c45b89e696086b86ceadc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:47.588852 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773673d-8097-4715-9b28-96aedf2f7154 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:47.594573 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7dde0-c43c-40f7-8cc5-48e8737befee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:47.595468 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7dde0-c43c-40f7-8cc5-48e8737befee admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:47.595849 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7dde0-c43c-40f7-8cc5-48e8737befee admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:47.596449 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7dde0-c43c-40f7-8cc5-48e8737befee admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:47.597206 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7dde0-c43c-40f7-8cc5-48e8737befee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:47.599010 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7dde0-c43c-40f7-8cc5-48e8737befee admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:47.614402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 962/1934] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:47.620419 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7dde0-c43c-40f7-8cc5-48e8737befee admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:47.628294 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-33a4a3f6-6e2f-4097-b735-eb368ada5039 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98dc11a54c8c45b89e696086b86ceadc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:47.646620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7dde0-c43c-40f7-8cc5-48e8737befee admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:47.660704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-33a4a3f6-6e2f-4097-b735-eb368ada5039 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98dc11a54c8c45b89e696086b86ceadc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:47.663383 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e861e79-e8d0-4578-8181-789bb90102fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:47.665140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e861e79-e8d0-4578-8181-789bb90102fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:47.665140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e861e79-e8d0-4578-8181-789bb90102fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:47.665472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e861e79-e8d0-4578-8181-789bb90102fe admin admin] PATH_INFO: `/v3/projects/c4857159b2864d22a02507d15f985ee6/users/1bbbee07a71a4cffbc7a933ff085b31b/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:47.667395 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e861e79-e8d0-4578-8181-789bb90102fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4857159b2864d22a02507d15f985ee6, user_id=1bbbee07a71a4cffbc7a933ff085b31b, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:47.670493 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e861e79-e8d0-4578-8181-789bb90102fe admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:47.684426 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-33a4a3f6-6e2f-4097-b735-eb368ada5039 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98dc11a54c8c45b89e696086b86ceadc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:47.685344 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-33a4a3f6-6e2f-4097-b735-eb368ada5039 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98dc11a54c8c45b89e696086b86ceadc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:47.687454 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 963/1935] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:47 2022] PUT /identity/v3/projects/c4857159b2864d22a02507d15f985ee6/users/1bbbee07a71a4cffbc7a933ff085b31b/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:47.710328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 973/1936] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:47 2022] DELETE /identity/v3/users/98dc11a54c8c45b89e696086b86ceadc => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:47.714474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cd8d3-f628-4cd7-9e36-fd2f048c6028 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:47.715081 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cd8d3-f628-4cd7-9e36-fd2f048c6028 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:47.715635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cd8d3-f628-4cd7-9e36-fd2f048c6028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:47.717459 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8a231-106c-449e-83f9-c0a7a7253101 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:47.717921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8a231-106c-449e-83f9-c0a7a7253101 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:47.718380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8a231-106c-449e-83f9-c0a7a7253101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:47.749154 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-dc6cd8d3-f628-4cd7-9e36-fd2f048c6028 None None] MFA Rules not processed for user `1bbbee07a71a4cffbc7a933ff085b31b`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:47.750815 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-dc6cd8d3-f628-4cd7-9e36-fd2f048c6028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:47.773721 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-0be8a231-106c-449e-83f9-c0a7a7253101 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:47.776524 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0be8a231-106c-449e-83f9-c0a7a7253101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:47.896761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 964/1937] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:47.912676 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cd8d3-f628-4cd7-9e36-fd2f048c6028 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:47.917077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-dc6cd8d3-f628-4cd7-9e36-fd2f048c6028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:48.014976 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 974/1938] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:48.026393 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8a231-106c-449e-83f9-c0a7a7253101 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:48.031552 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0be8a231-106c-449e-83f9-c0a7a7253101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:48.052443 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cd8d3-f628-4cd7-9e36-fd2f048c6028 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:48.082211 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d7de5-ec2b-403b-bef2-df6b60d4c2a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:48.084883 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d7de5-ec2b-403b-bef2-df6b60d4c2a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:48.085249 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d7de5-ec2b-403b-bef2-df6b60d4c2a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:48.086270 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d7de5-ec2b-403b-bef2-df6b60d4c2a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:48.100131 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d7de5-ec2b-403b-bef2-df6b60d4c2a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:48.105729 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d7de5-ec2b-403b-bef2-df6b60d4c2a0 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:48.159808 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 965/1939] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:47 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:48.190557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8a231-106c-449e-83f9-c0a7a7253101 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:48.200059 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5e331-153a-4a99-af16-7498b4de4733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:48.200686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5e331-153a-4a99-af16-7498b4de4733 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:48.200960 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5e331-153a-4a99-af16-7498b4de4733 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:48.201227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5e331-153a-4a99-af16-7498b4de4733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:48.214274 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5e331-153a-4a99-af16-7498b4de4733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:48.217083 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5e331-153a-4a99-af16-7498b4de4733 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:48.229279 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 975/1940] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:14:48.901050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d7de5-ec2b-403b-bef2-df6b60d4c2a0 service cinder] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:48.912656 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d7de5-ec2b-403b-bef2-df6b60d4c2a0 service cinder] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:48.922149 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f6718-f84b-460b-9341-41be9dd263a9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bbbee07a71a4cffbc7a933ff085b31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4857159b2864d22a02507d15f985ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:48.923521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f6718-f84b-460b-9341-41be9dd263a9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:48.924034 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f6718-f84b-460b-9341-41be9dd263a9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:48.924398 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f6718-f84b-460b-9341-41be9dd263a9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:48.927363 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f6718-f84b-460b-9341-41be9dd263a9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:48.927836 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f6718-f84b-460b-9341-41be9dd263a9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:48.929836 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f6718-f84b-460b-9341-41be9dd263a9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:48.935251 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:48.961672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 966/1941] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:14:48.966089 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5e331-153a-4a99-af16-7498b4de4733 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:48.979530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f6718-f84b-460b-9341-41be9dd263a9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:48.981450 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d77f6718-f84b-460b-9341-41be9dd263a9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:48.984308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5e331-153a-4a99-af16-7498b4de4733 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:49.002454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04afd87-724d-4173-b75a-97fc374d8644 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bbbee07a71a4cffbc7a933ff085b31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4857159b2864d22a02507d15f985ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:49.012960 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04afd87-724d-4173-b75a-97fc374d8644 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:49.014797 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04afd87-724d-4173-b75a-97fc374d8644 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:49.015311 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04afd87-724d-4173-b75a-97fc374d8644 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:49.016407 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04afd87-724d-4173-b75a-97fc374d8644 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:49.020044 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04afd87-724d-4173-b75a-97fc374d8644 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:49.067169 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f6718-f84b-460b-9341-41be9dd263a9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:49.090541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a25d3-1c59-4521-b68f-a99797d88028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:49.091287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a25d3-1c59-4521-b68f-a99797d88028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:49.091672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a25d3-1c59-4521-b68f-a99797d88028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:49.091965 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a25d3-1c59-4521-b68f-a99797d88028 admin admin] PATH_INFO: `/v3/projects/68236213645841589578b5fc25b03970` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:49.093339 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a25d3-1c59-4521-b68f-a99797d88028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68236213645841589578b5fc25b03970)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:49.095355 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a25d3-1c59-4521-b68f-a99797d88028 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:49.121432 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 976/1942] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:48 2022] POST /identity/v3/projects => generated 355 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:49.123159 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04afd87-724d-4173-b75a-97fc374d8644 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:49.148776 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:49.267212 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-507a25d3-1c59-4521-b68f-a99797d88028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68236213645841589578b5fc25b03970', 'request_id': 'req-507a25d3-1c59-4521-b68f-a99797d88028'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:49.303163 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-507a25d3-1c59-4521-b68f-a99797d88028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68236213645841589578b5fc25b03970', 'request_id': 'req-507a25d3-1c59-4521-b68f-a99797d88028'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:49.310742 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-507a25d3-1c59-4521-b68f-a99797d88028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68236213645841589578b5fc25b03970', 'request_id': 'req-507a25d3-1c59-4521-b68f-a99797d88028'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:49.333635 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04afd87-724d-4173-b75a-97fc374d8644 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:49.339504 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-507a25d3-1c59-4521-b68f-a99797d88028 admin admin] The token cache is being invalidate because project 68236213645841589578b5fc25b03970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:49.339808 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-507a25d3-1c59-4521-b68f-a99797d88028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:49.341090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-507a25d3-1c59-4521-b68f-a99797d88028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:49.344100 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 967/1943] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:48 2022] DELETE /identity/v3/projects/68236213645841589578b5fc25b03970 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:49.347745 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a25d3-1c59-4521-b68f-a99797d88028 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:49.349212 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-507a25d3-1c59-4521-b68f-a99797d88028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:49.434955 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf97658-eafa-48b5-a520-6d31c011639c tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bbbee07a71a4cffbc7a933ff085b31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4857159b2864d22a02507d15f985ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:49.435730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf97658-eafa-48b5-a520-6d31c011639c tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:49.436671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf97658-eafa-48b5-a520-6d31c011639c tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:49.436671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf97658-eafa-48b5-a520-6d31c011639c tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:49.436883 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf97658-eafa-48b5-a520-6d31c011639c tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:49.437362 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf97658-eafa-48b5-a520-6d31c011639c tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:49.439506 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf97658-eafa-48b5-a520-6d31c011639c tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:49.482569 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 977/1944] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:14:49.525814 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a25d3-1c59-4521-b68f-a99797d88028 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:49.542395 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c1743-b6eb-4eaf-8912-d63af061cd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:49.543052 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c1743-b6eb-4eaf-8912-d63af061cd9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:49.543328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c1743-b6eb-4eaf-8912-d63af061cd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:49.543683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c1743-b6eb-4eaf-8912-d63af061cd9d admin admin] PATH_INFO: `/v3/users/c0b964a926774a8c88df428b8cb62f44` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:49.546288 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c1743-b6eb-4eaf-8912-d63af061cd9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0b964a926774a8c88df428b8cb62f44)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:49.548992 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c1743-b6eb-4eaf-8912-d63af061cd9d admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:49.568073 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf97658-eafa-48b5-a520-6d31c011639c tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:49.573834 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-edf97658-eafa-48b5-a520-6d31c011639c tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:49.595655 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf97658-eafa-48b5-a520-6d31c011639c tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:49.607398 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81fb8b-af7f-4d87-8959-64b399ba71f9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bbbee07a71a4cffbc7a933ff085b31b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4857159b2864d22a02507d15f985ee6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:49.608970 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81fb8b-af7f-4d87-8959-64b399ba71f9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:49.609410 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81fb8b-af7f-4d87-8959-64b399ba71f9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:49.609845 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81fb8b-af7f-4d87-8959-64b399ba71f9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] PATH_INFO: `/v3/projects/c07db43eba5840979e93bd0c32e1c5e1` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:49.611173 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81fb8b-af7f-4d87-8959-64b399ba71f9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c07db43eba5840979e93bd0c32e1c5e1)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:49.613374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81fb8b-af7f-4d87-8959-64b399ba71f9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:49.690736 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-280c1743-b6eb-4eaf-8912-d63af061cd9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0b964a926774a8c88df428b8cb62f44'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:49.703886 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-280c1743-b6eb-4eaf-8912-d63af061cd9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0b964a926774a8c88df428b8cb62f44'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:49.726666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-280c1743-b6eb-4eaf-8912-d63af061cd9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0b964a926774a8c88df428b8cb62f44'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:49.741476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:49.744155 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-280c1743-b6eb-4eaf-8912-d63af061cd9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0b964a926774a8c88df428b8cb62f44'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:49.744934 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-280c1743-b6eb-4eaf-8912-d63af061cd9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0b964a926774a8c88df428b8cb62f44'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:49.751648 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9e81fb8b-af7f-4d87-8959-64b399ba71f9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c07db43eba5840979e93bd0c32e1c5e1', 'request_id': 'req-9e81fb8b-af7f-4d87-8959-64b399ba71f9'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:49.758328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 968/1945] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:49 2022] DELETE /identity/v3/users/c0b964a926774a8c88df428b8cb62f44 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:49.765100 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9e81fb8b-af7f-4d87-8959-64b399ba71f9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c07db43eba5840979e93bd0c32e1c5e1', 'request_id': 'req-9e81fb8b-af7f-4d87-8959-64b399ba71f9'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:49.773802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9e81fb8b-af7f-4d87-8959-64b399ba71f9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c07db43eba5840979e93bd0c32e1c5e1', 'request_id': 'req-9e81fb8b-af7f-4d87-8959-64b399ba71f9'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:49.791218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9e81fb8b-af7f-4d87-8959-64b399ba71f9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] The token cache is being invalidate because project c07db43eba5840979e93bd0c32e1c5e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:49.791867 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9e81fb8b-af7f-4d87-8959-64b399ba71f9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:49.792774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9e81fb8b-af7f-4d87-8959-64b399ba71f9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:49.795001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 978/1946] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:49 2022] DELETE /identity/v3/projects/c07db43eba5840979e93bd0c32e1c5e1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:50.109991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c1743-b6eb-4eaf-8912-d63af061cd9d admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:50.111644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-280c1743-b6eb-4eaf-8912-d63af061cd9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:50.219274 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81fb8b-af7f-4d87-8959-64b399ba71f9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:50.220993 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9e81fb8b-af7f-4d87-8959-64b399ba71f9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:50.260929 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c1743-b6eb-4eaf-8912-d63af061cd9d admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:50.270051 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d2969-af70-4a79-9fa3-74dced7671a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:50.270755 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d2969-af70-4a79-9fa3-74dced7671a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:50.271046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d2969-af70-4a79-9fa3-74dced7671a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:50.271318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d2969-af70-4a79-9fa3-74dced7671a0 admin admin] PATH_INFO: `/v3/users/50509af6d150462a833b606e846b7fc5` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:50.272594 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d2969-af70-4a79-9fa3-74dced7671a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50509af6d150462a833b606e846b7fc5)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:50.276483 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d2969-af70-4a79-9fa3-74dced7671a0 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:50.286167 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:50.367480 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81fb8b-af7f-4d87-8959-64b399ba71f9 tempest-VolumeQuotaClassesTest-1292039529 tempest-VolumeQuotaClassesTest-1292039529-project-admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:50.403086 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c38df-23e2-4ab8-92f7-75fe0700b2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:50.405614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c38df-23e2-4ab8-92f7-75fe0700b2fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:50.406228 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c38df-23e2-4ab8-92f7-75fe0700b2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:50.407387 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c38df-23e2-4ab8-92f7-75fe0700b2fe admin admin] PATH_INFO: `/v3/projects/c9810145de13427a9d655dc153a4e5ee` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:50.422402 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c38df-23e2-4ab8-92f7-75fe0700b2fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9810145de13427a9d655dc153a4e5ee)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:50.441286 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c38df-23e2-4ab8-92f7-75fe0700b2fe admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:50.449450 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1e4d2969-af70-4a79-9fa3-74dced7671a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50509af6d150462a833b606e846b7fc5'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:50.466630 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1e4d2969-af70-4a79-9fa3-74dced7671a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50509af6d150462a833b606e846b7fc5'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:50.481858 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1e4d2969-af70-4a79-9fa3-74dced7671a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50509af6d150462a833b606e846b7fc5'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:50.502674 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1e4d2969-af70-4a79-9fa3-74dced7671a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50509af6d150462a833b606e846b7fc5'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:50.504176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1e4d2969-af70-4a79-9fa3-74dced7671a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50509af6d150462a833b606e846b7fc5'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:50.513231 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 969/1947] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:50 2022] DELETE /identity/v3/users/50509af6d150462a833b606e846b7fc5 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:50.519725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec67d9-7fa7-4fc5-b6d4-83d37e710fa7 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:50.520222 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec67d9-7fa7-4fc5-b6d4-83d37e710fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:50.520627 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec67d9-7fa7-4fc5-b6d4-83d37e710fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:50.557010 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-802c38df-23e2-4ab8-92f7-75fe0700b2fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9810145de13427a9d655dc153a4e5ee', 'request_id': 'req-802c38df-23e2-4ab8-92f7-75fe0700b2fe'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:50.562591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-25ec67d9-7fa7-4fc5-b6d4-83d37e710fa7 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:50.564731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-25ec67d9-7fa7-4fc5-b6d4-83d37e710fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:50.576457 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-802c38df-23e2-4ab8-92f7-75fe0700b2fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9810145de13427a9d655dc153a4e5ee', 'request_id': 'req-802c38df-23e2-4ab8-92f7-75fe0700b2fe'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:50.591386 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-802c38df-23e2-4ab8-92f7-75fe0700b2fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9810145de13427a9d655dc153a4e5ee', 'request_id': 'req-802c38df-23e2-4ab8-92f7-75fe0700b2fe'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:50.629547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-802c38df-23e2-4ab8-92f7-75fe0700b2fe admin admin] The token cache is being invalidate because project c9810145de13427a9d655dc153a4e5ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:50.629842 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-802c38df-23e2-4ab8-92f7-75fe0700b2fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:50.630656 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-802c38df-23e2-4ab8-92f7-75fe0700b2fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:50.636127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 979/1948] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:50 2022] DELETE /identity/v3/projects/c9810145de13427a9d655dc153a4e5ee => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:50.637007 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c38df-23e2-4ab8-92f7-75fe0700b2fe admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:50.638676 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-802c38df-23e2-4ab8-92f7-75fe0700b2fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:50.669659 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 970/1949] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:50.684745 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec67d9-7fa7-4fc5-b6d4-83d37e710fa7 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:50.686644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-25ec67d9-7fa7-4fc5-b6d4-83d37e710fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:50.789255 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:50.805416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c38df-23e2-4ab8-92f7-75fe0700b2fe admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:50.816202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c981b6-8f0d-4de3-860b-a3db7151ae98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:50.817005 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c981b6-8f0d-4de3-860b-a3db7151ae98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:50.817388 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c981b6-8f0d-4de3-860b-a3db7151ae98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:50.817764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c981b6-8f0d-4de3-860b-a3db7151ae98 admin admin] PATH_INFO: `/v3/users/1535a56a966e4b49bfe39ee78f1f2a1a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:50.821883 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c981b6-8f0d-4de3-860b-a3db7151ae98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1535a56a966e4b49bfe39ee78f1f2a1a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:50.825942 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c981b6-8f0d-4de3-860b-a3db7151ae98 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:50.906714 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec67d9-7fa7-4fc5-b6d4-83d37e710fa7 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:50.924178 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335bbad-7e7e-41cb-9437-81750890f657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:50.924852 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335bbad-7e7e-41cb-9437-81750890f657 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:50.925137 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335bbad-7e7e-41cb-9437-81750890f657 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:50.925405 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335bbad-7e7e-41cb-9437-81750890f657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:50.937458 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335bbad-7e7e-41cb-9437-81750890f657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:50.938989 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335bbad-7e7e-41cb-9437-81750890f657 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:50.953046 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d7c981b6-8f0d-4de3-860b-a3db7151ae98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1535a56a966e4b49bfe39ee78f1f2a1a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:50.955286 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 971/1950] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:14:50.965159 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d7c981b6-8f0d-4de3-860b-a3db7151ae98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1535a56a966e4b49bfe39ee78f1f2a1a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:50.977534 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:51.016198 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d7c981b6-8f0d-4de3-860b-a3db7151ae98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1535a56a966e4b49bfe39ee78f1f2a1a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:51.047326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d7c981b6-8f0d-4de3-860b-a3db7151ae98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1535a56a966e4b49bfe39ee78f1f2a1a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:51.048446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d7c981b6-8f0d-4de3-860b-a3db7151ae98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1535a56a966e4b49bfe39ee78f1f2a1a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:51.063773 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 980/1951] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:50 2022] DELETE /identity/v3/users/1535a56a966e4b49bfe39ee78f1f2a1a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:51.513535 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335bbad-7e7e-41cb-9437-81750890f657 service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:51.514250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c981b6-8f0d-4de3-860b-a3db7151ae98 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:51.515088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-5335bbad-7e7e-41cb-9437-81750890f657 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:51.515778 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d7c981b6-8f0d-4de3-860b-a3db7151ae98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:51.563511 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335bbad-7e7e-41cb-9437-81750890f657 service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:51.655030 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c981b6-8f0d-4de3-860b-a3db7151ae98 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:51.664280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082d1c4-86bd-4f22-bafa-bbf323e31307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:51.665085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082d1c4-86bd-4f22-bafa-bbf323e31307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:51.665450 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082d1c4-86bd-4f22-bafa-bbf323e31307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:51.665729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082d1c4-86bd-4f22-bafa-bbf323e31307 admin admin] PATH_INFO: `/v3/projects/5f9deea0a5864c389bfdd418a6e3c78f` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:51.667000 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082d1c4-86bd-4f22-bafa-bbf323e31307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f9deea0a5864c389bfdd418a6e3c78f)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:51.669384 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082d1c4-86bd-4f22-bafa-bbf323e31307 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:51.722826 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c415994-62df-482d-b14f-ae216f83e15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:51.723648 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c415994-62df-482d-b14f-ae216f83e15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:51.724227 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c415994-62df-482d-b14f-ae216f83e15f admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:51.724524 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c415994-62df-482d-b14f-ae216f83e15f admin admin] PATH_INFO: `/v3/projects/4117f208692d4940bf3198060309b8e6` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:51.726296 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c415994-62df-482d-b14f-ae216f83e15f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4117f208692d4940bf3198060309b8e6)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:51.728451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c415994-62df-482d-b14f-ae216f83e15f admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:51.760852 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0082d1c4-86bd-4f22-bafa-bbf323e31307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f9deea0a5864c389bfdd418a6e3c78f', 'request_id': 'req-0082d1c4-86bd-4f22-bafa-bbf323e31307'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:51.775559 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0082d1c4-86bd-4f22-bafa-bbf323e31307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f9deea0a5864c389bfdd418a6e3c78f', 'request_id': 'req-0082d1c4-86bd-4f22-bafa-bbf323e31307'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:51.782680 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0082d1c4-86bd-4f22-bafa-bbf323e31307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f9deea0a5864c389bfdd418a6e3c78f', 'request_id': 'req-0082d1c4-86bd-4f22-bafa-bbf323e31307'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:51.788543 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1c415994-62df-482d-b14f-ae216f83e15f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4117f208692d4940bf3198060309b8e6', 'request_id': 'req-1c415994-62df-482d-b14f-ae216f83e15f'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:51.797448 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0082d1c4-86bd-4f22-bafa-bbf323e31307 admin admin] The token cache is being invalidate because project 5f9deea0a5864c389bfdd418a6e3c78f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:51.797448 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0082d1c4-86bd-4f22-bafa-bbf323e31307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:51.798057 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0082d1c4-86bd-4f22-bafa-bbf323e31307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:51.799620 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 981/1952] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:51 2022] DELETE /identity/v3/projects/5f9deea0a5864c389bfdd418a6e3c78f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:51.802508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1c415994-62df-482d-b14f-ae216f83e15f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4117f208692d4940bf3198060309b8e6', 'request_id': 'req-1c415994-62df-482d-b14f-ae216f83e15f'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:51.804828 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922477c4-e283-49f9-81df-f8201ec4341e None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:51.805242 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922477c4-e283-49f9-81df-f8201ec4341e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:51.805675 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922477c4-e283-49f9-81df-f8201ec4341e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:51.813689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1c415994-62df-482d-b14f-ae216f83e15f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4117f208692d4940bf3198060309b8e6', 'request_id': 'req-1c415994-62df-482d-b14f-ae216f83e15f'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:51.838987 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-922477c4-e283-49f9-81df-f8201ec4341e None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:51.840848 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-922477c4-e283-49f9-81df-f8201ec4341e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:51.853150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1c415994-62df-482d-b14f-ae216f83e15f admin admin] The token cache is being invalidate because project 4117f208692d4940bf3198060309b8e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:51.855452 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1c415994-62df-482d-b14f-ae216f83e15f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:51.856903 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1c415994-62df-482d-b14f-ae216f83e15f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:51.860900 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 972/1953] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:51 2022] DELETE /identity/v3/projects/4117f208692d4940bf3198060309b8e6 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:51.868304 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c415994-62df-482d-b14f-ae216f83e15f admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:51.868304 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-1c415994-62df-482d-b14f-ae216f83e15f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:51.939620 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 982/1954] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:51.952629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4adb24-2073-4177-bda3-fcb000a67fec None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:51.952975 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4adb24-2073-4177-bda3-fcb000a67fec None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:51.953224 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4adb24-2073-4177-bda3-fcb000a67fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:51.954020 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:51.972697 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c415994-62df-482d-b14f-ae216f83e15f admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:51.979473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d55c30-a571-4b1d-adc9-e29c3dec411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:51.980121 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-0d4adb24-2073-4177-bda3-fcb000a67fec None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:51.980239 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d55c30-a571-4b1d-adc9-e29c3dec411b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:51.980410 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d55c30-a571-4b1d-adc9-e29c3dec411b admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:51.980666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d55c30-a571-4b1d-adc9-e29c3dec411b admin admin] PATH_INFO: `/v3/users/1bbbee07a71a4cffbc7a933ff085b31b` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:51.981453 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0d4adb24-2073-4177-bda3-fcb000a67fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:51.981960 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d55c30-a571-4b1d-adc9-e29c3dec411b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bbbee07a71a4cffbc7a933ff085b31b)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:51.983970 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d55c30-a571-4b1d-adc9-e29c3dec411b admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:51.990461 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 983/1955] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:14:51.995366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4adb24-2073-4177-bda3-fcb000a67fec None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:51.999874 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:52.010586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4adb24-2073-4177-bda3-fcb000a67fec None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:52.022699 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19255fe8-e408-453e-bd70-a04717fc8f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:52.026139 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19255fe8-e408-453e-bd70-a04717fc8f40 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:52.026493 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19255fe8-e408-453e-bd70-a04717fc8f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:52.027293 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19255fe8-e408-453e-bd70-a04717fc8f40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:52.027507 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19255fe8-e408-453e-bd70-a04717fc8f40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:52.027802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19255fe8-e408-453e-bd70-a04717fc8f40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:52.031639 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19255fe8-e408-453e-bd70-a04717fc8f40 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:52.046711 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 984/1956] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:14:52.047648 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19255fe8-e408-453e-bd70-a04717fc8f40 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:52.051237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f6d55c30-a571-4b1d-adc9-e29c3dec411b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bbbee07a71a4cffbc7a933ff085b31b'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:52.058223 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19255fe8-e408-453e-bd70-a04717fc8f40 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:52.060294 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f6d55c30-a571-4b1d-adc9-e29c3dec411b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bbbee07a71a4cffbc7a933ff085b31b'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:52.065851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7353b-28b8-432b-9f53-9b91474d5804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:52.066329 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7353b-28b8-432b-9f53-9b91474d5804 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:52.066595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7353b-28b8-432b-9f53-9b91474d5804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:52.066871 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7353b-28b8-432b-9f53-9b91474d5804 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:52.067711 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7353b-28b8-432b-9f53-9b91474d5804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:52.069614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7353b-28b8-432b-9f53-9b91474d5804 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:52.074884 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f6d55c30-a571-4b1d-adc9-e29c3dec411b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bbbee07a71a4cffbc7a933ff085b31b'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:52.112073 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f6d55c30-a571-4b1d-adc9-e29c3dec411b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bbbee07a71a4cffbc7a933ff085b31b'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:52.113198 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f6d55c30-a571-4b1d-adc9-e29c3dec411b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bbbee07a71a4cffbc7a933ff085b31b'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:52.121212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 985/1957] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:52 2022] POST /identity/v3/projects => generated 369 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:52.122683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7353b-28b8-432b-9f53-9b91474d5804 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:52.124370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 973/1958] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:51 2022] DELETE /identity/v3/users/1bbbee07a71a4cffbc7a933ff085b31b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:52.133718 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e6b7353b-28b8-432b-9f53-9b91474d5804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:52.265866 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7353b-28b8-432b-9f53-9b91474d5804 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:52.363208 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02d6de-463c-4374-b6ff-3bc5728f1b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:52.367731 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02d6de-463c-4374-b6ff-3bc5728f1b00 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:52.368047 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02d6de-463c-4374-b6ff-3bc5728f1b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:52.368281 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02d6de-463c-4374-b6ff-3bc5728f1b00 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:52.368939 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02d6de-463c-4374-b6ff-3bc5728f1b00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:52.370924 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02d6de-463c-4374-b6ff-3bc5728f1b00 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:52.430906 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 986/1959] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:52 2022] POST /identity/v3/users => generated 285 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:52.437830 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d55c30-a571-4b1d-adc9-e29c3dec411b admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:52.458544 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d55c30-a571-4b1d-adc9-e29c3dec411b admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:52.466369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cedb7-50de-4719-923f-aea89c318f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:52.467249 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cedb7-50de-4719-923f-aea89c318f9c admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:52.467805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cedb7-50de-4719-923f-aea89c318f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:52.468827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cedb7-50de-4719-923f-aea89c318f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:52.469819 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569cedb7-50de-4719-923f-aea89c318f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:52.471463 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569cedb7-50de-4719-923f-aea89c318f9c admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:52.485333 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 974/1960] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:52.488515 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02d6de-463c-4374-b6ff-3bc5728f1b00 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:52.500424 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02d6de-463c-4374-b6ff-3bc5728f1b00 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:52.506242 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9b41d-7f7b-452e-902a-2609aa05b4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:52.506997 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9b41d-7f7b-452e-902a-2609aa05b4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:52.507393 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9b41d-7f7b-452e-902a-2609aa05b4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:52.507635 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9b41d-7f7b-452e-902a-2609aa05b4c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:52.508292 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9b41d-7f7b-452e-902a-2609aa05b4c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:52.511955 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9b41d-7f7b-452e-902a-2609aa05b4c5 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:52.525953 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 987/1961] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:52.529945 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cedb7-50de-4719-923f-aea89c318f9c admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:52.545992 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cedb7-50de-4719-923f-aea89c318f9c admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:52.551967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defafb1-f6fd-4655-bcbd-93740700be0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:52.552654 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defafb1-f6fd-4655-bcbd-93740700be0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:52.552933 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defafb1-f6fd-4655-bcbd-93740700be0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:52.557487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defafb1-f6fd-4655-bcbd-93740700be0a admin admin] PATH_INFO: `/v3/projects/899edf10e9444df7b01fb790ffffec98/users/aca9fe48ad454cc9a7b4a023c54abd0b/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:52.582728 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defafb1-f6fd-4655-bcbd-93740700be0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=899edf10e9444df7b01fb790ffffec98, user_id=aca9fe48ad454cc9a7b4a023c54abd0b, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:52.586329 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defafb1-f6fd-4655-bcbd-93740700be0a admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:52.627758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 975/1962] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:52 2022] PUT /identity/v3/projects/899edf10e9444df7b01fb790ffffec98/users/aca9fe48ad454cc9a7b4a023c54abd0b/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:52.634824 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf540d-b26b-4f1a-9c90-46acb045dd7a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:52.635175 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf540d-b26b-4f1a-9c90-46acb045dd7a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:52.639773 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf540d-b26b-4f1a-9c90-46acb045dd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:52.676906 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-abaf540d-b26b-4f1a-9c90-46acb045dd7a None None] MFA Rules not processed for user `aca9fe48ad454cc9a7b4a023c54abd0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:52.678115 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-abaf540d-b26b-4f1a-9c90-46acb045dd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:52.755948 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:52.760630 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defafb1-f6fd-4655-bcbd-93740700be0a admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:52.762921 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-5defafb1-f6fd-4655-bcbd-93740700be0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:52.796370 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 988/1963] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:52.888557 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defafb1-f6fd-4655-bcbd-93740700be0a admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:52.893356 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939dc9e-1195-4334-b295-f4a0f10b57d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:52.894030 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939dc9e-1195-4334-b295-f4a0f10b57d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:52.894263 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939dc9e-1195-4334-b295-f4a0f10b57d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:52.894530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939dc9e-1195-4334-b295-f4a0f10b57d8 admin admin] PATH_INFO: `/v3/projects/c4857159b2864d22a02507d15f985ee6` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:52.895798 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939dc9e-1195-4334-b295-f4a0f10b57d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4857159b2864d22a02507d15f985ee6)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:52.899141 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939dc9e-1195-4334-b295-f4a0f10b57d8 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:52.955254 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:52.974084 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1939dc9e-1195-4334-b295-f4a0f10b57d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4857159b2864d22a02507d15f985ee6', 'request_id': 'req-1939dc9e-1195-4334-b295-f4a0f10b57d8'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:52.998337 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1939dc9e-1195-4334-b295-f4a0f10b57d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4857159b2864d22a02507d15f985ee6', 'request_id': 'req-1939dc9e-1195-4334-b295-f4a0f10b57d8'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:53.008832 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1939dc9e-1195-4334-b295-f4a0f10b57d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4857159b2864d22a02507d15f985ee6', 'request_id': 'req-1939dc9e-1195-4334-b295-f4a0f10b57d8'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:53.021485 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1939dc9e-1195-4334-b295-f4a0f10b57d8 admin admin] The token cache is being invalidate because project c4857159b2864d22a02507d15f985ee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:53.021899 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1939dc9e-1195-4334-b295-f4a0f10b57d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:53.022995 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1939dc9e-1195-4334-b295-f4a0f10b57d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:53.025176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 976/1964] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:52 2022] DELETE /identity/v3/projects/c4857159b2864d22a02507d15f985ee6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:53.030201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38660272-27ef-44da-8021-0fff5a9a7d61 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:53.030482 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38660272-27ef-44da-8021-0fff5a9a7d61 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:53.030762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38660272-27ef-44da-8021-0fff5a9a7d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:53.055910 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-38660272-27ef-44da-8021-0fff5a9a7d61 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:53.057145 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-38660272-27ef-44da-8021-0fff5a9a7d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:53.138021 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 989/1965] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:53.139218 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca43bcd-5e50-43a5-aea6-8107c442f526 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:53.139537 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca43bcd-5e50-43a5-aea6-8107c442f526 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:53.139913 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca43bcd-5e50-43a5-aea6-8107c442f526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:53.167875 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-dca43bcd-5e50-43a5-aea6-8107c442f526 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:53.167875 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-dca43bcd-5e50-43a5-aea6-8107c442f526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:53.175669 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 977/1966] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:53.180134 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38660272-27ef-44da-8021-0fff5a9a7d61 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:53.190764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38660272-27ef-44da-8021-0fff5a9a7d61 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:53.198796 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822bf46-bf25-4452-8cf1-67d93f2d7465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:53.199399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822bf46-bf25-4452-8cf1-67d93f2d7465 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:53.199714 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822bf46-bf25-4452-8cf1-67d93f2d7465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:53.200213 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822bf46-bf25-4452-8cf1-67d93f2d7465 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:53.200955 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822bf46-bf25-4452-8cf1-67d93f2d7465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:53.201248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822bf46-bf25-4452-8cf1-67d93f2d7465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:53.203134 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822bf46-bf25-4452-8cf1-67d93f2d7465 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:53.218110 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 990/1967] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:14:53.222250 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca43bcd-5e50-43a5-aea6-8107c442f526 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:53.233650 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca43bcd-5e50-43a5-aea6-8107c442f526 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:53.247767 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d4561-7c17-479e-828b-3a9d88b89509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:53.248462 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d4561-7c17-479e-828b-3a9d88b89509 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:53.248768 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d4561-7c17-479e-828b-3a9d88b89509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:53.249367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d4561-7c17-479e-828b-3a9d88b89509 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:53.256496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d4561-7c17-479e-828b-3a9d88b89509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:53.262635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d4561-7c17-479e-828b-3a9d88b89509 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:53.316298 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 978/1968] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:53 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:53.321375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822bf46-bf25-4452-8cf1-67d93f2d7465 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:53.356761 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822bf46-bf25-4452-8cf1-67d93f2d7465 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:53.448862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42838299-1787-40df-af27-3df3442e72c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:53.449332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42838299-1787-40df-af27-3df3442e72c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:53.449618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42838299-1787-40df-af27-3df3442e72c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:53.449887 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42838299-1787-40df-af27-3df3442e72c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:53.450792 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42838299-1787-40df-af27-3df3442e72c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:53.452921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42838299-1787-40df-af27-3df3442e72c8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:53.500005 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 991/1969] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:53 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:53.504673 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d4561-7c17-479e-828b-3a9d88b89509 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:53.519192 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d4561-7c17-479e-828b-3a9d88b89509 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:53.531619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec855d0b-7cea-4eb8-999d-e186755c9f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:53.533012 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec855d0b-7cea-4eb8-999d-e186755c9f7d admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:53.533342 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec855d0b-7cea-4eb8-999d-e186755c9f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:53.533678 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec855d0b-7cea-4eb8-999d-e186755c9f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:53.534484 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec855d0b-7cea-4eb8-999d-e186755c9f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:53.541882 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec855d0b-7cea-4eb8-999d-e186755c9f7d admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:53.582038 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 979/1970] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:53.583642 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42838299-1787-40df-af27-3df3442e72c8 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:53.594946 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42838299-1787-40df-af27-3df3442e72c8 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:53.601743 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5552d9b-f460-401e-a32c-1a2cc694daa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:53.604345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5552d9b-f460-401e-a32c-1a2cc694daa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:53.605480 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5552d9b-f460-401e-a32c-1a2cc694daa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:53.605901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5552d9b-f460-401e-a32c-1a2cc694daa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:53.611538 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5552d9b-f460-401e-a32c-1a2cc694daa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:53.613213 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5552d9b-f460-401e-a32c-1a2cc694daa6 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:53.638124 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 992/1971] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:14:53.642195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec855d0b-7cea-4eb8-999d-e186755c9f7d admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:53.655837 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec855d0b-7cea-4eb8-999d-e186755c9f7d admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:53.662335 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5145d4-7720-497e-9bdf-e1c948189999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:53.663369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5145d4-7720-497e-9bdf-e1c948189999 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:53.663969 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5145d4-7720-497e-9bdf-e1c948189999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:53.664574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5145d4-7720-497e-9bdf-e1c948189999 admin admin] PATH_INFO: `/v3/projects/571ab1da8ab14db3ab05678036c469a1/users/fde84ef17f3b4f188ce77778f8bca63f/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:53.687646 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5145d4-7720-497e-9bdf-e1c948189999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=571ab1da8ab14db3ab05678036c469a1, user_id=fde84ef17f3b4f188ce77778f8bca63f, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:53.690256 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5145d4-7720-497e-9bdf-e1c948189999 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:53.718375 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 980/1972] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:53 2022] PUT /identity/v3/projects/571ab1da8ab14db3ab05678036c469a1/users/fde84ef17f3b4f188ce77778f8bca63f/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:53.728896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816a028-f2ac-46ae-9b65-319d1e34ce9b None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:53.729496 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816a028-f2ac-46ae-9b65-319d1e34ce9b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:53.729883 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816a028-f2ac-46ae-9b65-319d1e34ce9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:53.795689 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-1816a028-f2ac-46ae-9b65-319d1e34ce9b None None] MFA Rules not processed for user `fde84ef17f3b4f188ce77778f8bca63f`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:53.797420 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1816a028-f2ac-46ae-9b65-319d1e34ce9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:53.870104 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:53.911024 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 993/1973] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:53.916243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5145d4-7720-497e-9bdf-e1c948189999 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:53.989698 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5145d4-7720-497e-9bdf-e1c948189999 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:53.995674 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0520fd-4970-466a-a2fa-ce876a8f0540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:53.996399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0520fd-4970-466a-a2fa-ce876a8f0540 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:53.996796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0520fd-4970-466a-a2fa-ce876a8f0540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:53.997169 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0520fd-4970-466a-a2fa-ce876a8f0540 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:53.998021 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0520fd-4970-466a-a2fa-ce876a8f0540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:54.000051 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0520fd-4970-466a-a2fa-ce876a8f0540 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:54.048866 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816a028-f2ac-46ae-9b65-319d1e34ce9b None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:54.050959 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 981/1974] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:53 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:54.062938 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816a028-f2ac-46ae-9b65-319d1e34ce9b None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:54.133681 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cce95-2872-4473-a77c-f44bd85fd034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:54.135335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cce95-2872-4473-a77c-f44bd85fd034 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:54.135815 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cce95-2872-4473-a77c-f44bd85fd034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:54.136404 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cce95-2872-4473-a77c-f44bd85fd034 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:54.137662 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27cce95-2872-4473-a77c-f44bd85fd034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:54.140505 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27cce95-2872-4473-a77c-f44bd85fd034 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:54.171080 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 994/1975] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:54 2022] POST /identity/v3/users => generated 300 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:54.174985 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0520fd-4970-466a-a2fa-ce876a8f0540 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:54.185445 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0520fd-4970-466a-a2fa-ce876a8f0540 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:54.190789 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10fd5d-850e-4c82-81b1-b7b655a8e538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:54.191390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10fd5d-850e-4c82-81b1-b7b655a8e538 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:54.191705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10fd5d-850e-4c82-81b1-b7b655a8e538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:54.191970 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10fd5d-850e-4c82-81b1-b7b655a8e538 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:54.192596 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10fd5d-850e-4c82-81b1-b7b655a8e538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:54.194202 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10fd5d-850e-4c82-81b1-b7b655a8e538 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:54.213630 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 982/1976] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:54.214941 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cce95-2872-4473-a77c-f44bd85fd034 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:54.229558 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cce95-2872-4473-a77c-f44bd85fd034 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:54.240184 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87186718-9344-4783-aeb3-c38621848b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:54.241033 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87186718-9344-4783-aeb3-c38621848b0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:54.241376 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87186718-9344-4783-aeb3-c38621848b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:54.242371 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87186718-9344-4783-aeb3-c38621848b0b admin admin] PATH_INFO: `/v3/projects/7d30aba9592b469ca409361666855f2a/users/05860b04bf394bacbd6ec1623d70c89a/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:54.268350 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87186718-9344-4783-aeb3-c38621848b0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d30aba9592b469ca409361666855f2a, user_id=05860b04bf394bacbd6ec1623d70c89a, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:54.274935 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87186718-9344-4783-aeb3-c38621848b0b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:54.298879 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 995/1977] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:54 2022] PUT /identity/v3/projects/7d30aba9592b469ca409361666855f2a/users/05860b04bf394bacbd6ec1623d70c89a/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:54.299080 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10fd5d-850e-4c82-81b1-b7b655a8e538 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:54.313559 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10fd5d-850e-4c82-81b1-b7b655a8e538 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:54.367060 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:54.403977 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974dc8b-96e0-433d-bc16-83cccfea8d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:54.404689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974dc8b-96e0-433d-bc16-83cccfea8d76 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:54.405157 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974dc8b-96e0-433d-bc16-83cccfea8d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:54.405500 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974dc8b-96e0-433d-bc16-83cccfea8d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:54.406215 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974dc8b-96e0-433d-bc16-83cccfea8d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:54.409300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974dc8b-96e0-433d-bc16-83cccfea8d76 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:54.435679 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 983/1978] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:54.436030 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87186718-9344-4783-aeb3-c38621848b0b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:54.450964 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87186718-9344-4783-aeb3-c38621848b0b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:54.464613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b44600-cce5-4b80-9037-95637f329187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:54.465459 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b44600-cce5-4b80-9037-95637f329187 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:54.466690 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b44600-cce5-4b80-9037-95637f329187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:54.466971 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b44600-cce5-4b80-9037-95637f329187 admin admin] PATH_INFO: `/v3/projects/7d30aba9592b469ca409361666855f2a/users/05860b04bf394bacbd6ec1623d70c89a/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:54.478236 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b44600-cce5-4b80-9037-95637f329187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d30aba9592b469ca409361666855f2a, user_id=05860b04bf394bacbd6ec1623d70c89a, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:54.481035 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b44600-cce5-4b80-9037-95637f329187 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:54.499075 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 996/1979] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:54 2022] PUT /identity/v3/projects/7d30aba9592b469ca409361666855f2a/users/05860b04bf394bacbd6ec1623d70c89a/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:54.511737 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02e04d-244e-4452-8c63-e3d1c1faa1fe None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:54.511991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02e04d-244e-4452-8c63-e3d1c1faa1fe None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:54.512268 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02e04d-244e-4452-8c63-e3d1c1faa1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:54.553740 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-2b02e04d-244e-4452-8c63-e3d1c1faa1fe None None] MFA Rules not processed for user `05860b04bf394bacbd6ec1623d70c89a`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:54.554984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-2b02e04d-244e-4452-8c63-e3d1c1faa1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:54.678308 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 984/1980] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:54 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:54.686884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b44600-cce5-4b80-9037-95637f329187 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:54.688416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-54b44600-cce5-4b80-9037-95637f329187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:54.809832 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b44600-cce5-4b80-9037-95637f329187 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:54.814679 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aee918-c74a-4386-b113-199890352d56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:54.815406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aee918-c74a-4386-b113-199890352d56 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:54.815787 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aee918-c74a-4386-b113-199890352d56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:54.816252 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aee918-c74a-4386-b113-199890352d56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:54.829077 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aee918-c74a-4386-b113-199890352d56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:54.830906 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aee918-c74a-4386-b113-199890352d56 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:54.845915 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 997/1981] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:54 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:55.736318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02e04d-244e-4452-8c63-e3d1c1faa1fe None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:55.737990 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-2b02e04d-244e-4452-8c63-e3d1c1faa1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:55.883624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02e04d-244e-4452-8c63-e3d1c1faa1fe None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:55.895766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439abc0-8f8e-41f2-b1ff-5d928ba39a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:55.896744 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439abc0-8f8e-41f2-b1ff-5d928ba39a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:55.897192 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439abc0-8f8e-41f2-b1ff-5d928ba39a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:55.897625 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439abc0-8f8e-41f2-b1ff-5d928ba39a4e admin admin] PATH_INFO: `/v3/users/9450a9c2e6d845f1a5dff3aba0ecb3e6` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:55.903156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439abc0-8f8e-41f2-b1ff-5d928ba39a4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9450a9c2e6d845f1a5dff3aba0ecb3e6)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:55.905935 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439abc0-8f8e-41f2-b1ff-5d928ba39a4e admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:56.045569 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aee918-c74a-4386-b113-199890352d56 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:56.071444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-b439abc0-8f8e-41f2-b1ff-5d928ba39a4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9450a9c2e6d845f1a5dff3aba0ecb3e6'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:56.076002 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aee918-c74a-4386-b113-199890352d56 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:56.079765 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-b439abc0-8f8e-41f2-b1ff-5d928ba39a4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9450a9c2e6d845f1a5dff3aba0ecb3e6'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:56.081774 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:56.091475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-b439abc0-8f8e-41f2-b1ff-5d928ba39a4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9450a9c2e6d845f1a5dff3aba0ecb3e6'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:56.092118 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473e8e9-0acd-4448-a078-249c929f502e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:56.093001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473e8e9-0acd-4448-a078-249c929f502e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:56.093640 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473e8e9-0acd-4448-a078-249c929f502e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:56.093995 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473e8e9-0acd-4448-a078-249c929f502e admin admin] PATH_INFO: `/v3/users/fde84ef17f3b4f188ce77778f8bca63f` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:56.095214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473e8e9-0acd-4448-a078-249c929f502e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde84ef17f3b4f188ce77778f8bca63f)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:56.098704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473e8e9-0acd-4448-a078-249c929f502e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:56.121730 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-b439abc0-8f8e-41f2-b1ff-5d928ba39a4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9450a9c2e6d845f1a5dff3aba0ecb3e6'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:56.122724 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-b439abc0-8f8e-41f2-b1ff-5d928ba39a4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9450a9c2e6d845f1a5dff3aba0ecb3e6'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:56.135338 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 985/1982] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:55 2022] DELETE /identity/v3/users/9450a9c2e6d845f1a5dff3aba0ecb3e6 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:56.185430 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:56.216538 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0473e8e9-0acd-4448-a078-249c929f502e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde84ef17f3b4f188ce77778f8bca63f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:56.227948 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0473e8e9-0acd-4448-a078-249c929f502e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde84ef17f3b4f188ce77778f8bca63f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:56.244005 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0473e8e9-0acd-4448-a078-249c929f502e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde84ef17f3b4f188ce77778f8bca63f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:56.257692 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0473e8e9-0acd-4448-a078-249c929f502e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde84ef17f3b4f188ce77778f8bca63f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:56.258806 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0473e8e9-0acd-4448-a078-249c929f502e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde84ef17f3b4f188ce77778f8bca63f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:56.279588 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 998/1983] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:56 2022] DELETE /identity/v3/users/fde84ef17f3b4f188ce77778f8bca63f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:56.284293 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dad6d3-745d-4eed-90f6-9fae0b103790 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:56.285010 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dad6d3-745d-4eed-90f6-9fae0b103790 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:56.285482 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dad6d3-745d-4eed-90f6-9fae0b103790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:56.314643 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-20dad6d3-745d-4eed-90f6-9fae0b103790 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:56.317106 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-20dad6d3-745d-4eed-90f6-9fae0b103790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:56.418966 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 986/1984] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:56.433313 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473e8e9-0acd-4448-a078-249c929f502e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:56.435209 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0473e8e9-0acd-4448-a078-249c929f502e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:56.450938 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dad6d3-745d-4eed-90f6-9fae0b103790 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:56.452437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-20dad6d3-745d-4eed-90f6-9fae0b103790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:56.469463 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dad6d3-745d-4eed-90f6-9fae0b103790 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:56.474569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c89ba0-25ef-4b1d-8177-84fc97ce96ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:56.475217 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c89ba0-25ef-4b1d-8177-84fc97ce96ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:56.475537 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c89ba0-25ef-4b1d-8177-84fc97ce96ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:56.475816 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c89ba0-25ef-4b1d-8177-84fc97ce96ab admin admin] PATH_INFO: `/v3/projects/30e283d079fb4dfbbe69d2ae92bc9f89` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:56.477556 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c89ba0-25ef-4b1d-8177-84fc97ce96ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=30e283d079fb4dfbbe69d2ae92bc9f89)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:56.479681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c89ba0-25ef-4b1d-8177-84fc97ce96ab admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:56.584421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-a1c89ba0-25ef-4b1d-8177-84fc97ce96ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30e283d079fb4dfbbe69d2ae92bc9f89', 'request_id': 'req-a1c89ba0-25ef-4b1d-8177-84fc97ce96ab'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:56.603149 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-a1c89ba0-25ef-4b1d-8177-84fc97ce96ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30e283d079fb4dfbbe69d2ae92bc9f89', 'request_id': 'req-a1c89ba0-25ef-4b1d-8177-84fc97ce96ab'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:56.603915 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473e8e9-0acd-4448-a078-249c929f502e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:56.613677 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-a1c89ba0-25ef-4b1d-8177-84fc97ce96ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30e283d079fb4dfbbe69d2ae92bc9f89', 'request_id': 'req-a1c89ba0-25ef-4b1d-8177-84fc97ce96ab'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:56.627288 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-a1c89ba0-25ef-4b1d-8177-84fc97ce96ab admin admin] The token cache is being invalidate because project 30e283d079fb4dfbbe69d2ae92bc9f89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:56.627644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-a1c89ba0-25ef-4b1d-8177-84fc97ce96ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:56.628398 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-a1c89ba0-25ef-4b1d-8177-84fc97ce96ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:56.630310 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 987/1985] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:56 2022] DELETE /identity/v3/projects/30e283d079fb4dfbbe69d2ae92bc9f89 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:56.634397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c89ba0-25ef-4b1d-8177-84fc97ce96ab admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:56.635901 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-a1c89ba0-25ef-4b1d-8177-84fc97ce96ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:56.679059 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff7425-3196-4694-a662-ca116d2a49f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:56.680198 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff7425-3196-4694-a662-ca116d2a49f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:56.680702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff7425-3196-4694-a662-ca116d2a49f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:56.681535 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff7425-3196-4694-a662-ca116d2a49f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:56.683770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-30ff7425-3196-4694-a662-ca116d2a49f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:56.749192 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:56.754738 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c89ba0-25ef-4b1d-8177-84fc97ce96ab admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:56.763779 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9500d-c3de-4130-9208-e8b76f28245f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:56.764497 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9500d-c3de-4130-9208-e8b76f28245f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:56.764784 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9500d-c3de-4130-9208-e8b76f28245f admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:56.765804 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9500d-c3de-4130-9208-e8b76f28245f admin admin] PATH_INFO: `/v3/users/7b4bdc7135134560a1f30daaa09ee804` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:56.767322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9500d-c3de-4130-9208-e8b76f28245f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b4bdc7135134560a1f30daaa09ee804)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:56.769732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9500d-c3de-4130-9208-e8b76f28245f admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:56.809335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff7425-3196-4694-a662-ca116d2a49f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:56.810887 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff7425-3196-4694-a662-ca116d2a49f1 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:56.826610 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 999/1986] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:56.874036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c0a9500d-c3de-4130-9208-e8b76f28245f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b4bdc7135134560a1f30daaa09ee804'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:56.888884 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c0a9500d-c3de-4130-9208-e8b76f28245f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b4bdc7135134560a1f30daaa09ee804'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:56.912144 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c0a9500d-c3de-4130-9208-e8b76f28245f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b4bdc7135134560a1f30daaa09ee804'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:56.942194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c0a9500d-c3de-4130-9208-e8b76f28245f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b4bdc7135134560a1f30daaa09ee804'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:56.943183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c0a9500d-c3de-4130-9208-e8b76f28245f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b4bdc7135134560a1f30daaa09ee804'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:56.951255 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 988/1987] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:56 2022] DELETE /identity/v3/users/7b4bdc7135134560a1f30daaa09ee804 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:57.298974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff7425-3196-4694-a662-ca116d2a49f1 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:57.313086 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff7425-3196-4694-a662-ca116d2a49f1 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:57.332062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:57.386496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9500d-c3de-4130-9208-e8b76f28245f admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:57.388127 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-c0a9500d-c3de-4130-9208-e8b76f28245f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:57.437598 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149fc6e-ee9c-4915-9d7b-9b8f32d17928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:57.438584 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149fc6e-ee9c-4915-9d7b-9b8f32d17928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:57.439192 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149fc6e-ee9c-4915-9d7b-9b8f32d17928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:57.439503 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149fc6e-ee9c-4915-9d7b-9b8f32d17928 admin admin] PATH_INFO: `/v3/projects/bd3d97cd5882427fb2fe68a35e316d8d` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:57.440680 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149fc6e-ee9c-4915-9d7b-9b8f32d17928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd3d97cd5882427fb2fe68a35e316d8d)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:57.442611 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149fc6e-ee9c-4915-9d7b-9b8f32d17928 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:57.516718 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9500d-c3de-4130-9208-e8b76f28245f admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:57.522146 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7149fc6e-ee9c-4915-9d7b-9b8f32d17928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd3d97cd5882427fb2fe68a35e316d8d', 'request_id': 'req-7149fc6e-ee9c-4915-9d7b-9b8f32d17928'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:57.533911 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7149fc6e-ee9c-4915-9d7b-9b8f32d17928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd3d97cd5882427fb2fe68a35e316d8d', 'request_id': 'req-7149fc6e-ee9c-4915-9d7b-9b8f32d17928'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:57.555290 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7149fc6e-ee9c-4915-9d7b-9b8f32d17928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd3d97cd5882427fb2fe68a35e316d8d', 'request_id': 'req-7149fc6e-ee9c-4915-9d7b-9b8f32d17928'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:57.569713 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7149fc6e-ee9c-4915-9d7b-9b8f32d17928 admin admin] The token cache is being invalidate because project bd3d97cd5882427fb2fe68a35e316d8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:57.570012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7149fc6e-ee9c-4915-9d7b-9b8f32d17928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:57.570656 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7149fc6e-ee9c-4915-9d7b-9b8f32d17928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:57.573001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1000/1988] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:57 2022] DELETE /identity/v3/projects/bd3d97cd5882427fb2fe68a35e316d8d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:57.576921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0aced0-113d-479e-b335-464b81a2a409 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:57.577207 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0aced0-113d-479e-b335-464b81a2a409 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:57.577540 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0aced0-113d-479e-b335-464b81a2a409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:57.605787 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-bb0aced0-113d-479e-b335-464b81a2a409 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:57.606997 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-bb0aced0-113d-479e-b335-464b81a2a409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:57.611903 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efa31d-4bb9-4c8f-8c8f-eca7668ab12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:57.613544 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efa31d-4bb9-4c8f-8c8f-eca7668ab12d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:57.613875 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efa31d-4bb9-4c8f-8c8f-eca7668ab12d admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:57.614149 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efa31d-4bb9-4c8f-8c8f-eca7668ab12d admin admin] PATH_INFO: `/v3/projects/571ab1da8ab14db3ab05678036c469a1` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:57.615404 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efa31d-4bb9-4c8f-8c8f-eca7668ab12d admin admin] RBAC: Authorizing `identity:delete_project(project_id=571ab1da8ab14db3ab05678036c469a1)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:57.622689 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1001/1989] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:57.622889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efa31d-4bb9-4c8f-8c8f-eca7668ab12d admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:57.624901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eceaf-2484-4cf6-8e5d-8a67355ea44f None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:57.625691 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eceaf-2484-4cf6-8e5d-8a67355ea44f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:57.626083 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eceaf-2484-4cf6-8e5d-8a67355ea44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:57.674194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:57.674356 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-577eceaf-2484-4cf6-8e5d-8a67355ea44f None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:57.675580 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-577eceaf-2484-4cf6-8e5d-8a67355ea44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:57.689148 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1002/1990] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:14:57.693481 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577eceaf-2484-4cf6-8e5d-8a67355ea44f None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:57.705541 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-12efa31d-4bb9-4c8f-8c8f-eca7668ab12d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '571ab1da8ab14db3ab05678036c469a1', 'request_id': 'req-12efa31d-4bb9-4c8f-8c8f-eca7668ab12d'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:57.713708 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577eceaf-2484-4cf6-8e5d-8a67355ea44f None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:57.717377 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-12efa31d-4bb9-4c8f-8c8f-eca7668ab12d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '571ab1da8ab14db3ab05678036c469a1', 'request_id': 'req-12efa31d-4bb9-4c8f-8c8f-eca7668ab12d'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:57.729325 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-12efa31d-4bb9-4c8f-8c8f-eca7668ab12d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '571ab1da8ab14db3ab05678036c469a1', 'request_id': 'req-12efa31d-4bb9-4c8f-8c8f-eca7668ab12d'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:57.762882 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-12efa31d-4bb9-4c8f-8c8f-eca7668ab12d admin admin] The token cache is being invalidate because project 571ab1da8ab14db3ab05678036c469a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:57.763542 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-12efa31d-4bb9-4c8f-8c8f-eca7668ab12d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:57.765884 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-12efa31d-4bb9-4c8f-8c8f-eca7668ab12d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:57.770045 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 989/1991] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:57 2022] DELETE /identity/v3/projects/571ab1da8ab14db3ab05678036c469a1 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:57.775386 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efa31d-4bb9-4c8f-8c8f-eca7668ab12d admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:57.779358 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-12efa31d-4bb9-4c8f-8c8f-eca7668ab12d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:57.823491 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b914a-0e47-4ffc-8604-7f65aec659b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:57.824393 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b914a-0e47-4ffc-8604-7f65aec659b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:57.824834 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b914a-0e47-4ffc-8604-7f65aec659b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:57.825306 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b914a-0e47-4ffc-8604-7f65aec659b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:57.827054 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b914a-0e47-4ffc-8604-7f65aec659b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:57.827543 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b914a-0e47-4ffc-8604-7f65aec659b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:57.832028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b914a-0e47-4ffc-8604-7f65aec659b3 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:57.850484 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1003/1992] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:14:57.855552 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b914a-0e47-4ffc-8604-7f65aec659b3 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:57.859097 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-130b914a-0e47-4ffc-8604-7f65aec659b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:57.879314 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b914a-0e47-4ffc-8604-7f65aec659b3 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:57.885656 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549cde5-363d-4a3e-85d7-b70cb07e5a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:57.885869 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efa31d-4bb9-4c8f-8c8f-eca7668ab12d admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:57.888519 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549cde5-363d-4a3e-85d7-b70cb07e5a31 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:57.889222 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549cde5-363d-4a3e-85d7-b70cb07e5a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:57.890032 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549cde5-363d-4a3e-85d7-b70cb07e5a31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:57.891354 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549cde5-363d-4a3e-85d7-b70cb07e5a31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:57.895337 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549cde5-363d-4a3e-85d7-b70cb07e5a31 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:57.899746 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dad01-a5bb-4645-b27d-b4710a682ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:57.900470 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dad01-a5bb-4645-b27d-b4710a682ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:57.900943 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dad01-a5bb-4645-b27d-b4710a682ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:57.901276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dad01-a5bb-4645-b27d-b4710a682ec0 admin admin] PATH_INFO: `/v3/users/05860b04bf394bacbd6ec1623d70c89a` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:57.902963 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698dad01-a5bb-4645-b27d-b4710a682ec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05860b04bf394bacbd6ec1623d70c89a)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:57.905043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698dad01-a5bb-4645-b27d-b4710a682ec0 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:57.944481 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:57.967772 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1004/1993] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:57 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:57.972708 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549cde5-363d-4a3e-85d7-b70cb07e5a31 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:58.023237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-698dad01-a5bb-4645-b27d-b4710a682ec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05860b04bf394bacbd6ec1623d70c89a'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:58.035138 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-698dad01-a5bb-4645-b27d-b4710a682ec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05860b04bf394bacbd6ec1623d70c89a'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:58.052160 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-698dad01-a5bb-4645-b27d-b4710a682ec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05860b04bf394bacbd6ec1623d70c89a'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:58.071687 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-698dad01-a5bb-4645-b27d-b4710a682ec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05860b04bf394bacbd6ec1623d70c89a'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:58.072638 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-698dad01-a5bb-4645-b27d-b4710a682ec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05860b04bf394bacbd6ec1623d70c89a'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:58.076121 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549cde5-363d-4a3e-85d7-b70cb07e5a31 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:58.086504 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0300a12-1681-49b9-a367-e50e179dd462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:58.090045 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 990/1994] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:57 2022] DELETE /identity/v3/users/05860b04bf394bacbd6ec1623d70c89a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:58.097760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0300a12-1681-49b9-a367-e50e179dd462 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:58.098209 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0300a12-1681-49b9-a367-e50e179dd462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:58.098604 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0300a12-1681-49b9-a367-e50e179dd462 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:58.099346 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0300a12-1681-49b9-a367-e50e179dd462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:58.102216 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0300a12-1681-49b9-a367-e50e179dd462 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:58.144491 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1005/1995] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:57 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:58.146058 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dad01-a5bb-4645-b27d-b4710a682ec0 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:58.148492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-698dad01-a5bb-4645-b27d-b4710a682ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:58.207307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:58.251591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dad01-a5bb-4645-b27d-b4710a682ec0 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:58.260599 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52078f6-5799-4f82-b3b7-68d4530a85c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:58.261415 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52078f6-5799-4f82-b3b7-68d4530a85c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:58.261580 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52078f6-5799-4f82-b3b7-68d4530a85c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:58.261963 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52078f6-5799-4f82-b3b7-68d4530a85c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:58.262705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52078f6-5799-4f82-b3b7-68d4530a85c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:58.264578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52078f6-5799-4f82-b3b7-68d4530a85c2 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:58.279943 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 991/1996] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:58.281037 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0300a12-1681-49b9-a367-e50e179dd462 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:58.306012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0300a12-1681-49b9-a367-e50e179dd462 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:58.312218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ddfa1-ef57-41ba-8bb5-b2a060a5a282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:58.312925 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ddfa1-ef57-41ba-8bb5-b2a060a5a282 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:58.313080 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ddfa1-ef57-41ba-8bb5-b2a060a5a282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:58.313345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ddfa1-ef57-41ba-8bb5-b2a060a5a282 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:58.314137 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ddfa1-ef57-41ba-8bb5-b2a060a5a282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:58.315773 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ddfa1-ef57-41ba-8bb5-b2a060a5a282 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:58.329361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1006/1997] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:58.336376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52078f6-5799-4f82-b3b7-68d4530a85c2 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:58.349458 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52078f6-5799-4f82-b3b7-68d4530a85c2 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:58.355335 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae15015-fba3-4b84-a29a-9a644ecea597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:58.356373 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae15015-fba3-4b84-a29a-9a644ecea597 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:58.356746 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae15015-fba3-4b84-a29a-9a644ecea597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:58.357082 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae15015-fba3-4b84-a29a-9a644ecea597 admin admin] PATH_INFO: `/v3/projects/6516d4eb40bb43249ccef1f6b6cc0464/users/5fe4ef00086649f1829e29188f0e272f/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:58.375025 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae15015-fba3-4b84-a29a-9a644ecea597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6516d4eb40bb43249ccef1f6b6cc0464, user_id=5fe4ef00086649f1829e29188f0e272f, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:58.378075 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae15015-fba3-4b84-a29a-9a644ecea597 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:58.411461 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 992/1998] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:58 2022] PUT /identity/v3/projects/6516d4eb40bb43249ccef1f6b6cc0464/users/5fe4ef00086649f1829e29188f0e272f/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:58.412356 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a304f3-61ed-4699-9420-2e115ec0b16f None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:58.412701 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a304f3-61ed-4699-9420-2e115ec0b16f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:58.413037 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a304f3-61ed-4699-9420-2e115ec0b16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:58.487218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b9a304f3-61ed-4699-9420-2e115ec0b16f None None] MFA Rules not processed for user `5fe4ef00086649f1829e29188f0e272f`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:58.488517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b9a304f3-61ed-4699-9420-2e115ec0b16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:58.508785 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae15015-fba3-4b84-a29a-9a644ecea597 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:58.510752 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-dae15015-fba3-4b84-a29a-9a644ecea597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:58.637885 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae15015-fba3-4b84-a29a-9a644ecea597 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:58.644420 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39fc64-2847-4895-ae97-c6c753a08e68 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0866de4d4e46d5b26719faf385d7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:58.647144 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39fc64-2847-4895-ae97-c6c753a08e68 service glance] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:58.647695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39fc64-2847-4895-ae97-c6c753a08e68 service glance] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:58.649299 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39fc64-2847-4895-ae97-c6c753a08e68 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:58.651912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-7f39fc64-2847-4895-ae97-c6c753a08e68 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:58.652998 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1007/1999] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:58.653981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a304f3-61ed-4699-9420-2e115ec0b16f None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:58.655288 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b9a304f3-61ed-4699-9420-2e115ec0b16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:58.743310 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39fc64-2847-4895-ae97-c6c753a08e68 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:58.748064 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39fc64-2847-4895-ae97-c6c753a08e68 service glance] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:58.760828 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 993/2000] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:14:58.761851 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39fc64-2847-4895-ae97-c6c753a08e68 service glance] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:58.763240 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-7f39fc64-2847-4895-ae97-c6c753a08e68 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:58.775234 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a304f3-61ed-4699-9420-2e115ec0b16f None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:58.791719 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c01a4e-3d4e-4b60-a52b-bd3d13843f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:58.792444 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c01a4e-3d4e-4b60-a52b-bd3d13843f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:58.792776 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c01a4e-3d4e-4b60-a52b-bd3d13843f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:58.793108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c01a4e-3d4e-4b60-a52b-bd3d13843f48 admin admin] PATH_INFO: `/v3/projects/7d30aba9592b469ca409361666855f2a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:58.795084 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c01a4e-3d4e-4b60-a52b-bd3d13843f48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d30aba9592b469ca409361666855f2a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:58.799750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c01a4e-3d4e-4b60-a52b-bd3d13843f48 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:58.830563 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:58.836585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39fc64-2847-4895-ae97-c6c753a08e68 service glance] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:58.841120 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afc8ce-63ab-4b5c-aff0-f2ff77c507fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:58.841974 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afc8ce-63ab-4b5c-aff0-f2ff77c507fe service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:58.842532 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afc8ce-63ab-4b5c-aff0-f2ff77c507fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:58.842971 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afc8ce-63ab-4b5c-aff0-f2ff77c507fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:58.856617 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8afc8ce-63ab-4b5c-aff0-f2ff77c507fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:58.858356 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8afc8ce-63ab-4b5c-aff0-f2ff77c507fe service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:58.877980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 994/2001] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:58.905869 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c8c01a4e-3d4e-4b60-a52b-bd3d13843f48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d30aba9592b469ca409361666855f2a', 'request_id': 'req-c8c01a4e-3d4e-4b60-a52b-bd3d13843f48'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:58.925283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c8c01a4e-3d4e-4b60-a52b-bd3d13843f48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d30aba9592b469ca409361666855f2a', 'request_id': 'req-c8c01a4e-3d4e-4b60-a52b-bd3d13843f48'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:58.945333 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c8c01a4e-3d4e-4b60-a52b-bd3d13843f48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d30aba9592b469ca409361666855f2a', 'request_id': 'req-c8c01a4e-3d4e-4b60-a52b-bd3d13843f48'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:58.965556 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c8c01a4e-3d4e-4b60-a52b-bd3d13843f48 admin admin] The token cache is being invalidate because project 7d30aba9592b469ca409361666855f2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:58.966436 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c8c01a4e-3d4e-4b60-a52b-bd3d13843f48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:58.968480 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c8c01a4e-3d4e-4b60-a52b-bd3d13843f48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:58.970901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1008/2002] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:58 2022] DELETE /identity/v3/projects/7d30aba9592b469ca409361666855f2a => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:58.976253 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5462b-b4e5-4565-912b-b11fb60ad864 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:58.976690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5462b-b4e5-4565-912b-b11fb60ad864 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:58.977157 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5462b-b4e5-4565-912b-b11fb60ad864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:58.997772 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:59.040897 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-90d5462b-b4e5-4565-912b-b11fb60ad864 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:59.042310 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-90d5462b-b4e5-4565-912b-b11fb60ad864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:59.161455 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 995/2003] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:59.162724 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da45cc-7b2a-44dc-b670-bae76d78c5a1 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:59.163020 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da45cc-7b2a-44dc-b670-bae76d78c5a1 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:59.164031 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da45cc-7b2a-44dc-b670-bae76d78c5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:59.196713 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-e9da45cc-7b2a-44dc-b670-bae76d78c5a1 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:59.198059 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e9da45cc-7b2a-44dc-b670-bae76d78c5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:59.235444 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1009/2004] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:59.236061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5462b-b4e5-4565-912b-b11fb60ad864 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:59.245544 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5462b-b4e5-4565-912b-b11fb60ad864 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:59.256165 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4581f-2db6-476a-8393-2a200ab34671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:59.259858 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4581f-2db6-476a-8393-2a200ab34671 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:59.260363 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4581f-2db6-476a-8393-2a200ab34671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:59.260799 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4581f-2db6-476a-8393-2a200ab34671 admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:59.262180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4581f-2db6-476a-8393-2a200ab34671 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:59.262834 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4581f-2db6-476a-8393-2a200ab34671 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:59.266958 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4581f-2db6-476a-8393-2a200ab34671 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:59.287179 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 996/2005] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:14:59.292945 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da45cc-7b2a-44dc-b670-bae76d78c5a1 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:59.308806 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da45cc-7b2a-44dc-b670-bae76d78c5a1 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:59.319001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56755cc9-3340-481b-9a42-c8180387073d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:59.320244 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56755cc9-3340-481b-9a42-c8180387073d admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:59.320412 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56755cc9-3340-481b-9a42-c8180387073d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:59.320657 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56755cc9-3340-481b-9a42-c8180387073d admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:59.322061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56755cc9-3340-481b-9a42-c8180387073d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:59.324915 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56755cc9-3340-481b-9a42-c8180387073d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:59.375261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1010/2006] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:59 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:59.379108 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4581f-2db6-476a-8393-2a200ab34671 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:59.392153 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4581f-2db6-476a-8393-2a200ab34671 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:59.479191 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb7aa2-4bff-45c8-afb0-b5a76d55cfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:59.479858 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb7aa2-4bff-45c8-afb0-b5a76d55cfd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:59.480310 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb7aa2-4bff-45c8-afb0-b5a76d55cfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:59.481283 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb7aa2-4bff-45c8-afb0-b5a76d55cfd6 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:59.482784 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb7aa2-4bff-45c8-afb0-b5a76d55cfd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:59.486373 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb7aa2-4bff-45c8-afb0-b5a76d55cfd6 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:59.562301 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 997/2007] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:59 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:59.580576 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56755cc9-3340-481b-9a42-c8180387073d admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:59.596641 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56755cc9-3340-481b-9a42-c8180387073d admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:59.607865 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457a0b1-ff73-4964-9839-a5cad3393903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:59.608491 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457a0b1-ff73-4964-9839-a5cad3393903 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:59.608783 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457a0b1-ff73-4964-9839-a5cad3393903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:59.609064 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457a0b1-ff73-4964-9839-a5cad3393903 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:59.611884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457a0b1-ff73-4964-9839-a5cad3393903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:59.613499 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457a0b1-ff73-4964-9839-a5cad3393903 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:59.640125 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1011/2008] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:14:59.643185 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb7aa2-4bff-45c8-afb0-b5a76d55cfd6 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:59.659469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb7aa2-4bff-45c8-afb0-b5a76d55cfd6 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:59.667278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dad7e-db3b-4aa0-a363-2eba95a72f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:59.668034 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dad7e-db3b-4aa0-a363-2eba95a72f2f admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:59.668319 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dad7e-db3b-4aa0-a363-2eba95a72f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:59.668583 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dad7e-db3b-4aa0-a363-2eba95a72f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:59.669398 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804dad7e-db3b-4aa0-a363-2eba95a72f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:59.671050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804dad7e-db3b-4aa0-a363-2eba95a72f2f admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:59.695273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457a0b1-ff73-4964-9839-a5cad3393903 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:59.696076 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 998/2009] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:59.712773 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457a0b1-ff73-4964-9839-a5cad3393903 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:59.728243 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a00189-28c4-4d27-8b54-40356f5c5ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:59.728989 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a00189-28c4-4d27-8b54-40356f5c5ee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:59.729256 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a00189-28c4-4d27-8b54-40356f5c5ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:59.729491 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a00189-28c4-4d27-8b54-40356f5c5ee9 admin admin] PATH_INFO: `/v3/projects/0e5b79ceaf7a4b54a6c35019420e2abd/users/e5ca07220aa64c4b918bad8eeaf2adb1/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:59.766846 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a00189-28c4-4d27-8b54-40356f5c5ee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5b79ceaf7a4b54a6c35019420e2abd, user_id=e5ca07220aa64c4b918bad8eeaf2adb1, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:59.783203 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a00189-28c4-4d27-8b54-40356f5c5ee9 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:59.811982 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1012/2010] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:59 2022] PUT /identity/v3/projects/0e5b79ceaf7a4b54a6c35019420e2abd/users/e5ca07220aa64c4b918bad8eeaf2adb1/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:59.823215 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12382740-78d4-439f-9e91-37807edd04e9 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:59.823795 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12382740-78d4-439f-9e91-37807edd04e9 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:59.823795 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12382740-78d4-439f-9e91-37807edd04e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:59.861687 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-12382740-78d4-439f-9e91-37807edd04e9 None None] MFA Rules not processed for user `e5ca07220aa64c4b918bad8eeaf2adb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:59.862909 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-12382740-78d4-439f-9e91-37807edd04e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:59.967785 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:59.975834 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 999/2011] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:14:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:59.980910 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a00189-28c4-4d27-8b54-40356f5c5ee9 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:00.073961 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a00189-28c4-4d27-8b54-40356f5c5ee9 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:00.079028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addab4f9-14f3-4ce6-9324-374558c5d9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:00.079670 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addab4f9-14f3-4ce6-9324-374558c5d9df admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:00.079946 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addab4f9-14f3-4ce6-9324-374558c5d9df admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:00.080215 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addab4f9-14f3-4ce6-9324-374558c5d9df admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:00.080915 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addab4f9-14f3-4ce6-9324-374558c5d9df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:00.082806 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addab4f9-14f3-4ce6-9324-374558c5d9df admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:00.116349 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1013/2012] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:59 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:15:00.121274 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12382740-78d4-439f-9e91-37807edd04e9 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:00.135200 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12382740-78d4-439f-9e91-37807edd04e9 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:00.201591 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b81291-8c1a-4c4d-8560-c3f5d1a710de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:00.202346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b81291-8c1a-4c4d-8560-c3f5d1a710de admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:00.202975 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b81291-8c1a-4c4d-8560-c3f5d1a710de admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:00.204783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b81291-8c1a-4c4d-8560-c3f5d1a710de admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:00.205253 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b81291-8c1a-4c4d-8560-c3f5d1a710de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:00.207093 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b81291-8c1a-4c4d-8560-c3f5d1a710de admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:00.236873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1000/2013] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:15:00 2022] POST /identity/v3/users => generated 297 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:15:00.240816 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addab4f9-14f3-4ce6-9324-374558c5d9df admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:00.254237 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addab4f9-14f3-4ce6-9324-374558c5d9df admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:00.261649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb1a44-9d62-4db9-9c3f-7256eea3a575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:00.262401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb1a44-9d62-4db9-9c3f-7256eea3a575 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:00.262689 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb1a44-9d62-4db9-9c3f-7256eea3a575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:00.263102 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb1a44-9d62-4db9-9c3f-7256eea3a575 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:00.263837 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb1a44-9d62-4db9-9c3f-7256eea3a575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:00.265605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb1a44-9d62-4db9-9c3f-7256eea3a575 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:00.288014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1014/2014] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:15:00.290112 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b81291-8c1a-4c4d-8560-c3f5d1a710de admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:00.310279 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b81291-8c1a-4c4d-8560-c3f5d1a710de admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:00.318123 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b95a45-2eb2-416f-89bf-3c8a30bc1601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:00.318791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b95a45-2eb2-416f-89bf-3c8a30bc1601 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:00.319088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b95a45-2eb2-416f-89bf-3c8a30bc1601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:00.319353 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b95a45-2eb2-416f-89bf-3c8a30bc1601 admin admin] PATH_INFO: `/v3/projects/2b0c78a32a894ebe92b790c70548df40/users/c885dba66cdf400297d5117f42ff8e1e/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:00.363898 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b95a45-2eb2-416f-89bf-3c8a30bc1601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b0c78a32a894ebe92b790c70548df40, user_id=c885dba66cdf400297d5117f42ff8e1e, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:00.367533 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b95a45-2eb2-416f-89bf-3c8a30bc1601 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:00.391157 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1001/2015] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:15:00 2022] PUT /identity/v3/projects/2b0c78a32a894ebe92b790c70548df40/users/c885dba66cdf400297d5117f42ff8e1e/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:15:00.392435 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb1a44-9d62-4db9-9c3f-7256eea3a575 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:00.412799 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb1a44-9d62-4db9-9c3f-7256eea3a575 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:00.432080 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:00.524468 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc0c73-5f7b-4fb9-a86d-33f23bd740a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:00.525204 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc0c73-5f7b-4fb9-a86d-33f23bd740a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:00.525647 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc0c73-5f7b-4fb9-a86d-33f23bd740a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:00.526644 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc0c73-5f7b-4fb9-a86d-33f23bd740a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:00.527651 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc0c73-5f7b-4fb9-a86d-33f23bd740a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:00.529360 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc0c73-5f7b-4fb9-a86d-33f23bd740a5 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:00.549164 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1015/2016] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:15:00.552672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b95a45-2eb2-416f-89bf-3c8a30bc1601 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:00.575020 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b95a45-2eb2-416f-89bf-3c8a30bc1601 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:00.597829 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1112a0-dd1a-4e69-ad43-e7ee349fc211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:00.598518 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1112a0-dd1a-4e69-ad43-e7ee349fc211 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:00.598845 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1112a0-dd1a-4e69-ad43-e7ee349fc211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:00.599068 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1112a0-dd1a-4e69-ad43-e7ee349fc211 admin admin] PATH_INFO: `/v3/projects/2b0c78a32a894ebe92b790c70548df40/users/c885dba66cdf400297d5117f42ff8e1e/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:00.614552 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1112a0-dd1a-4e69-ad43-e7ee349fc211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b0c78a32a894ebe92b790c70548df40, user_id=c885dba66cdf400297d5117f42ff8e1e, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:00.614552 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1112a0-dd1a-4e69-ad43-e7ee349fc211 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:00.631670 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1002/2017] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:15:00 2022] PUT /identity/v3/projects/2b0c78a32a894ebe92b790c70548df40/users/c885dba66cdf400297d5117f42ff8e1e/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:15:00.642426 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ae876-3532-45ef-b35f-9dbe5e229af0 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:00.642724 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ae876-3532-45ef-b35f-9dbe5e229af0 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:00.643004 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ae876-3532-45ef-b35f-9dbe5e229af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:00.714513 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-572ae876-3532-45ef-b35f-9dbe5e229af0 None None] MFA Rules not processed for user `c885dba66cdf400297d5117f42ff8e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:00.717108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-572ae876-3532-45ef-b35f-9dbe5e229af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:00.884676 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1016/2018] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:15:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:00.950293 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1112a0-dd1a-4e69-ad43-e7ee349fc211 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:00.958647 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-eb1112a0-dd1a-4e69-ad43-e7ee349fc211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:01.065417 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1112a0-dd1a-4e69-ad43-e7ee349fc211 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:01.070450 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1cdab-0170-4e62-8467-87b676f725f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:01.071269 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1cdab-0170-4e62-8467-87b676f725f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:01.071676 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1cdab-0170-4e62-8467-87b676f725f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:01.072044 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1cdab-0170-4e62-8467-87b676f725f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:01.086780 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1cdab-0170-4e62-8467-87b676f725f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:01.088380 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1cdab-0170-4e62-8467-87b676f725f3 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:01.099603 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1003/2019] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:00 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:01.217864 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ae876-3532-45ef-b35f-9dbe5e229af0 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:01.229901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ae876-3532-45ef-b35f-9dbe5e229af0 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:01.238801 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7442d3-3bc8-4ec0-b94c-52869065c138 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:01.240335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7442d3-3bc8-4ec0-b94c-52869065c138 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:01.240825 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7442d3-3bc8-4ec0-b94c-52869065c138 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:01.243585 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7442d3-3bc8-4ec0-b94c-52869065c138 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:01.317445 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7442d3-3bc8-4ec0-b94c-52869065c138 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:01.318983 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7442d3-3bc8-4ec0-b94c-52869065c138 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:01.330110 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1017/2020] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:01.654428 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1cdab-0170-4e62-8467-87b676f725f3 service cinder] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:01.690707 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d1de7-d3c8-4ba4-8fdf-9d8fdbc9c190 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:01.691109 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d1de7-d3c8-4ba4-8fdf-9d8fdbc9c190 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:01.691397 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d1de7-d3c8-4ba4-8fdf-9d8fdbc9c190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:01.714074 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-219d1de7-d3c8-4ba4-8fdf-9d8fdbc9c190 None None] MFA Rules not processed for user `51d25a1883184a93b9ca8a99b367c229`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:01.715360 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-219d1de7-d3c8-4ba4-8fdf-9d8fdbc9c190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:01.719260 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:01.728945 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1cdab-0170-4e62-8467-87b676f725f3 service cinder] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:01.733990 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825525f-bef8-4fca-a202-77bb68f1935d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:01.734623 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825525f-bef8-4fca-a202-77bb68f1935d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:01.734899 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825525f-bef8-4fca-a202-77bb68f1935d admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:01.735169 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825525f-bef8-4fca-a202-77bb68f1935d admin admin] PATH_INFO: `/v3/users/e5ca07220aa64c4b918bad8eeaf2adb1` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:01.736383 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825525f-bef8-4fca-a202-77bb68f1935d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5ca07220aa64c4b918bad8eeaf2adb1)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:01.738476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825525f-bef8-4fca-a202-77bb68f1935d admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:01.743673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:01.781441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1018/2021] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:15:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:15:01.807051 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-a825525f-bef8-4fca-a202-77bb68f1935d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5ca07220aa64c4b918bad8eeaf2adb1'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:01.814432 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-a825525f-bef8-4fca-a202-77bb68f1935d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5ca07220aa64c4b918bad8eeaf2adb1'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:01.822932 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-a825525f-bef8-4fca-a202-77bb68f1935d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5ca07220aa64c4b918bad8eeaf2adb1'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:01.837035 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-a825525f-bef8-4fca-a202-77bb68f1935d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5ca07220aa64c4b918bad8eeaf2adb1'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:01.837796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-a825525f-bef8-4fca-a202-77bb68f1935d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5ca07220aa64c4b918bad8eeaf2adb1'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:01.844352 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1004/2022] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:15:01 2022] DELETE /identity/v3/users/e5ca07220aa64c4b918bad8eeaf2adb1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:15:01.848862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56a056-7a63-428d-8d2f-e392bda9ccb6 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:01.849160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56a056-7a63-428d-8d2f-e392bda9ccb6 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:01.849428 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56a056-7a63-428d-8d2f-e392bda9ccb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:01.871876 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-9b56a056-7a63-428d-8d2f-e392bda9ccb6 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:01.873075 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9b56a056-7a63-428d-8d2f-e392bda9ccb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:01.933312 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1019/2023] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:01.945662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825525f-bef8-4fca-a202-77bb68f1935d admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:01.947317 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-a825525f-bef8-4fca-a202-77bb68f1935d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:02.040128 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825525f-bef8-4fca-a202-77bb68f1935d admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:02.050326 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268b5f0-cd77-4352-8102-5bfe7ca34604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:02.051042 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268b5f0-cd77-4352-8102-5bfe7ca34604 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:02.051309 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268b5f0-cd77-4352-8102-5bfe7ca34604 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:02.051611 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268b5f0-cd77-4352-8102-5bfe7ca34604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:02.062191 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268b5f0-cd77-4352-8102-5bfe7ca34604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:02.063660 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268b5f0-cd77-4352-8102-5bfe7ca34604 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:02.074121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1005/2024] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:02.524679 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56a056-7a63-428d-8d2f-e392bda9ccb6 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:02.526461 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9b56a056-7a63-428d-8d2f-e392bda9ccb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:02.555110 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56a056-7a63-428d-8d2f-e392bda9ccb6 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:02.565297 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f61c33-91f5-4b1a-84f6-a76f89f00f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:02.565954 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f61c33-91f5-4b1a-84f6-a76f89f00f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:02.566232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f61c33-91f5-4b1a-84f6-a76f89f00f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:02.566503 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f61c33-91f5-4b1a-84f6-a76f89f00f1d admin admin] PATH_INFO: `/v3/projects/0e5b79ceaf7a4b54a6c35019420e2abd` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:02.568208 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f61c33-91f5-4b1a-84f6-a76f89f00f1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e5b79ceaf7a4b54a6c35019420e2abd)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:02.570542 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f61c33-91f5-4b1a-84f6-a76f89f00f1d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:02.692196 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b0f61c33-91f5-4b1a-84f6-a76f89f00f1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e5b79ceaf7a4b54a6c35019420e2abd', 'request_id': 'req-b0f61c33-91f5-4b1a-84f6-a76f89f00f1d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:02.702047 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b0f61c33-91f5-4b1a-84f6-a76f89f00f1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e5b79ceaf7a4b54a6c35019420e2abd', 'request_id': 'req-b0f61c33-91f5-4b1a-84f6-a76f89f00f1d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:02.712402 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b0f61c33-91f5-4b1a-84f6-a76f89f00f1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e5b79ceaf7a4b54a6c35019420e2abd', 'request_id': 'req-b0f61c33-91f5-4b1a-84f6-a76f89f00f1d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:02.743317 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b0f61c33-91f5-4b1a-84f6-a76f89f00f1d admin admin] The token cache is being invalidate because project 0e5b79ceaf7a4b54a6c35019420e2abd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:15:02.743709 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b0f61c33-91f5-4b1a-84f6-a76f89f00f1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:02.749934 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b0f61c33-91f5-4b1a-84f6-a76f89f00f1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:02.751631 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1020/2025] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:15:02 2022] DELETE /identity/v3/projects/0e5b79ceaf7a4b54a6c35019420e2abd => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:15:02.755736 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268b5f0-cd77-4352-8102-5bfe7ca34604 service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:02.766048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268b5f0-cd77-4352-8102-5bfe7ca34604 service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:02.875371 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591e556-1e7b-45d7-8255-96f8013e1723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:02.876504 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591e556-1e7b-45d7-8255-96f8013e1723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:02.876966 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591e556-1e7b-45d7-8255-96f8013e1723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:02.877390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591e556-1e7b-45d7-8255-96f8013e1723 admin admin] PATH_INFO: `/v3/users/c885dba66cdf400297d5117f42ff8e1e` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:02.879351 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591e556-1e7b-45d7-8255-96f8013e1723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c885dba66cdf400297d5117f42ff8e1e)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:02.881917 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591e556-1e7b-45d7-8255-96f8013e1723 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:02.920150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:02.985353 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-0591e556-1e7b-45d7-8255-96f8013e1723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c885dba66cdf400297d5117f42ff8e1e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:02.995500 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-0591e556-1e7b-45d7-8255-96f8013e1723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c885dba66cdf400297d5117f42ff8e1e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:03.011657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-0591e556-1e7b-45d7-8255-96f8013e1723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c885dba66cdf400297d5117f42ff8e1e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:03.030421 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-0591e556-1e7b-45d7-8255-96f8013e1723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c885dba66cdf400297d5117f42ff8e1e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:03.031704 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-0591e556-1e7b-45d7-8255-96f8013e1723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c885dba66cdf400297d5117f42ff8e1e'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:03.043075 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1006/2026] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:15:02 2022] DELETE /identity/v3/users/c885dba66cdf400297d5117f42ff8e1e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:15:03.445375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f61c33-91f5-4b1a-84f6-a76f89f00f1d admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:03.447610 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b0f61c33-91f5-4b1a-84f6-a76f89f00f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:03.473949 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f61c33-91f5-4b1a-84f6-a76f89f00f1d admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:03.530346 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:03.546223 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f43e0-c317-459b-9e07-569b147fd284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:03.547657 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f43e0-c317-459b-9e07-569b147fd284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:03.548136 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f43e0-c317-459b-9e07-569b147fd284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:03.549202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f43e0-c317-459b-9e07-569b147fd284 admin admin] PATH_INFO: `/v3/projects/2b0c78a32a894ebe92b790c70548df40` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:03.553601 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f43e0-c317-459b-9e07-569b147fd284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b0c78a32a894ebe92b790c70548df40)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:03.557158 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f43e0-c317-459b-9e07-569b147fd284 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:03.610366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-908f43e0-c317-459b-9e07-569b147fd284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b0c78a32a894ebe92b790c70548df40', 'request_id': 'req-908f43e0-c317-459b-9e07-569b147fd284'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:03.618815 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-908f43e0-c317-459b-9e07-569b147fd284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b0c78a32a894ebe92b790c70548df40', 'request_id': 'req-908f43e0-c317-459b-9e07-569b147fd284'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:03.624829 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-908f43e0-c317-459b-9e07-569b147fd284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b0c78a32a894ebe92b790c70548df40', 'request_id': 'req-908f43e0-c317-459b-9e07-569b147fd284'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:03.636929 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-908f43e0-c317-459b-9e07-569b147fd284 admin admin] The token cache is being invalidate because project 2b0c78a32a894ebe92b790c70548df40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:15:03.637312 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-908f43e0-c317-459b-9e07-569b147fd284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:03.637967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-908f43e0-c317-459b-9e07-569b147fd284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:03.639480 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1021/2027] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:15:03 2022] DELETE /identity/v3/projects/2b0c78a32a894ebe92b790c70548df40 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:15:05.349124 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591e556-1e7b-45d7-8255-96f8013e1723 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:05.350707 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-0591e556-1e7b-45d7-8255-96f8013e1723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:05.365763 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591e556-1e7b-45d7-8255-96f8013e1723 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:05.462268 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf6318-1cc1-4343-ab64-4da1a6bfe78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:05.463012 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf6318-1cc1-4343-ab64-4da1a6bfe78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:05.463389 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf6318-1cc1-4343-ab64-4da1a6bfe78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:05.463763 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf6318-1cc1-4343-ab64-4da1a6bfe78e admin admin] PATH_INFO: `/v3/users/5fe4ef00086649f1829e29188f0e272f` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:05.465000 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf6318-1cc1-4343-ab64-4da1a6bfe78e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fe4ef00086649f1829e29188f0e272f)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:05.467324 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf6318-1cc1-4343-ab64-4da1a6bfe78e admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:05.553610 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-9ddf6318-1cc1-4343-ab64-4da1a6bfe78e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fe4ef00086649f1829e29188f0e272f'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:05.559221 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-9ddf6318-1cc1-4343-ab64-4da1a6bfe78e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fe4ef00086649f1829e29188f0e272f'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:05.578842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-9ddf6318-1cc1-4343-ab64-4da1a6bfe78e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fe4ef00086649f1829e29188f0e272f'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:05.609002 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-9ddf6318-1cc1-4343-ab64-4da1a6bfe78e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fe4ef00086649f1829e29188f0e272f'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:05.610900 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-9ddf6318-1cc1-4343-ab64-4da1a6bfe78e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fe4ef00086649f1829e29188f0e272f'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:05.634528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1007/2028] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:15:05 2022] DELETE /identity/v3/users/5fe4ef00086649f1829e29188f0e272f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:15:05.636402 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e65fb-8edf-4602-8149-a02fcdc65a4e None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:05.636904 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e65fb-8edf-4602-8149-a02fcdc65a4e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:05.637026 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e65fb-8edf-4602-8149-a02fcdc65a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:05.673352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-ca0e65fb-8edf-4602-8149-a02fcdc65a4e None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:05.674606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ca0e65fb-8edf-4602-8149-a02fcdc65a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:05.725477 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f530e-e0b5-4d16-ad01-46362222cfe8 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:05.725887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f530e-e0b5-4d16-ad01-46362222cfe8 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:05.727132 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f530e-e0b5-4d16-ad01-46362222cfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:05.771556 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-b74f530e-e0b5-4d16-ad01-46362222cfe8 None None] MFA Rules not processed for user `f3254b4fddaa4f099c6c44f4c139ee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:05.772698 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b74f530e-e0b5-4d16-ad01-46362222cfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:05.782786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:05.845334 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1022/2029] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:05.876403 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e65fb-8edf-4602-8149-a02fcdc65a4e None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:05.878073 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ca0e65fb-8edf-4602-8149-a02fcdc65a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:05.895221 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1008/2030] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 24 13:15:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:15:05.915926 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f530e-e0b5-4d16-ad01-46362222cfe8 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:05.917508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b74f530e-e0b5-4d16-ad01-46362222cfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:05.976385 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e65fb-8edf-4602-8149-a02fcdc65a4e None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:05.982895 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bd73f-4044-4df2-9e32-ae17aa43a740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:05.983710 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bd73f-4044-4df2-9e32-ae17aa43a740 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:05.984165 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bd73f-4044-4df2-9e32-ae17aa43a740 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:05.984608 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bd73f-4044-4df2-9e32-ae17aa43a740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:06.001497 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bd73f-4044-4df2-9e32-ae17aa43a740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:06.010810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bd73f-4044-4df2-9e32-ae17aa43a740 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:06.025308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1023/2031] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:15:06.038628 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f530e-e0b5-4d16-ad01-46362222cfe8 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:06.045819 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af411c72-48e1-4b40-a9c4-ae80868f57ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '768c71ab4ab241e4bfed9f7561ae3d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:06.046573 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af411c72-48e1-4b40-a9c4-ae80868f57ca service swift] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:06.046963 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af411c72-48e1-4b40-a9c4-ae80868f57ca service swift] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:06.047515 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af411c72-48e1-4b40-a9c4-ae80868f57ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:06.058335 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af411c72-48e1-4b40-a9c4-ae80868f57ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:06.060343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af411c72-48e1-4b40-a9c4-ae80868f57ca service swift] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:06.070935 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1009/2032] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 24 13:15:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 13:15:06.521021 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bd73f-4044-4df2-9e32-ae17aa43a740 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:06.522706 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1b4bd73f-4044-4df2-9e32-ae17aa43a740 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:06.540578 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bd73f-4044-4df2-9e32-ae17aa43a740 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:06.545515 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9aff6-d7bb-46c2-a6d2-2003297461fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:06.546190 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9aff6-d7bb-46c2-a6d2-2003297461fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:06.546473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9aff6-d7bb-46c2-a6d2-2003297461fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:06.546745 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9aff6-d7bb-46c2-a6d2-2003297461fa admin admin] PATH_INFO: `/v3/projects/6516d4eb40bb43249ccef1f6b6cc0464` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:06.551470 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9aff6-d7bb-46c2-a6d2-2003297461fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6516d4eb40bb43249ccef1f6b6cc0464)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:06.551470 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9aff6-d7bb-46c2-a6d2-2003297461fa admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:06.586447 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:06.606125 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cca9aff6-d7bb-46c2-a6d2-2003297461fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6516d4eb40bb43249ccef1f6b6cc0464', 'request_id': 'req-cca9aff6-d7bb-46c2-a6d2-2003297461fa'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:06.613827 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cca9aff6-d7bb-46c2-a6d2-2003297461fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6516d4eb40bb43249ccef1f6b6cc0464', 'request_id': 'req-cca9aff6-d7bb-46c2-a6d2-2003297461fa'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:06.619632 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cca9aff6-d7bb-46c2-a6d2-2003297461fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6516d4eb40bb43249ccef1f6b6cc0464', 'request_id': 'req-cca9aff6-d7bb-46c2-a6d2-2003297461fa'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:06.630560 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09972f-c803-4443-ae39-fbc0641d0c63 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:06.631079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cca9aff6-d7bb-46c2-a6d2-2003297461fa admin admin] The token cache is being invalidate because project 6516d4eb40bb43249ccef1f6b6cc0464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:15:06.631175 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09972f-c803-4443-ae39-fbc0641d0c63 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:06.631252 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cca9aff6-d7bb-46c2-a6d2-2003297461fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:06.631325 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09972f-c803-4443-ae39-fbc0641d0c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:06.631962 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cca9aff6-d7bb-46c2-a6d2-2003297461fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:06.634394 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1024/2033] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:15:06 2022] DELETE /identity/v3/projects/6516d4eb40bb43249ccef1f6b6cc0464 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:15:06.640999 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e11c8-1058-4f21-8fde-296f7a4cf25c None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:06.641578 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e11c8-1058-4f21-8fde-296f7a4cf25c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:06.642543 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e11c8-1058-4f21-8fde-296f7a4cf25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:06.655235 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-4b09972f-c803-4443-ae39-fbc0641d0c63 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:06.656465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-4b09972f-c803-4443-ae39-fbc0641d0c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:06.665358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-da2e11c8-1058-4f21-8fde-296f7a4cf25c None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:06.666843 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-da2e11c8-1058-4f21-8fde-296f7a4cf25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:06.735729 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1010/2034] 10.222.0.39 () {58 vars in 1016 bytes} [Mon Oct 24 13:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:15:06.756130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1025/2035] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:15:06.759050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994af8d-27c1-420a-bb54-b2ce7d82c845 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:06.759339 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994af8d-27c1-420a-bb54-b2ce7d82c845 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:06.759644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994af8d-27c1-420a-bb54-b2ce7d82c845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:06.780675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-6994af8d-27c1-420a-bb54-b2ce7d82c845 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:06.781977 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-6994af8d-27c1-420a-bb54-b2ce7d82c845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:06.792431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1011/2036] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:06.799112 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e11c8-1058-4f21-8fde-296f7a4cf25c None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:06.812275 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e11c8-1058-4f21-8fde-296f7a4cf25c None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:06.817085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dee71-9c9b-4108-9954-81d1885723a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:06.817743 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dee71-9c9b-4108-9954-81d1885723a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:06.818024 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dee71-9c9b-4108-9954-81d1885723a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:06.818293 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dee71-9c9b-4108-9954-81d1885723a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:06.818899 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994af8d-27c1-420a-bb54-b2ce7d82c845 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:06.819012 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751dee71-9c9b-4108-9954-81d1885723a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:15:06.819220 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751dee71-9c9b-4108-9954-81d1885723a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:06.821678 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-6994af8d-27c1-420a-bb54-b2ce7d82c845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:06.821905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751dee71-9c9b-4108-9954-81d1885723a8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:06.839205 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1026/2037] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:15:06.843913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dee71-9c9b-4108-9954-81d1885723a8 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:06.854170 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dee71-9c9b-4108-9954-81d1885723a8 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:06.859237 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d61b4-833d-4937-be5b-f95771117fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:06.860421 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d61b4-833d-4937-be5b-f95771117fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:06.860771 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d61b4-833d-4937-be5b-f95771117fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:06.861217 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d61b4-833d-4937-be5b-f95771117fa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:06.861825 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d61b4-833d-4937-be5b-f95771117fa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:06.863769 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d61b4-833d-4937-be5b-f95771117fa5 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:06.881320 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:06.911798 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994af8d-27c1-420a-bb54-b2ce7d82c845 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:06.918061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1027/2038] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:15:06 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:15:06.918282 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c616c0-72ee-481e-8cfc-c122989012d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:06.918972 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c616c0-72ee-481e-8cfc-c122989012d0 service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:06.919272 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c616c0-72ee-481e-8cfc-c122989012d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:06.919685 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c616c0-72ee-481e-8cfc-c122989012d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:06.922476 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d61b4-833d-4937-be5b-f95771117fa5 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:06.930747 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c616c0-72ee-481e-8cfc-c122989012d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:06.932411 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c616c0-72ee-481e-8cfc-c122989012d0 service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:06.944499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1012/2039] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:07.003859 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d61b4-833d-4937-be5b-f95771117fa5 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:07.009568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7f9a7-d28d-43a5-a01d-8d16f49e63e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:07.010301 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7f9a7-d28d-43a5-a01d-8d16f49e63e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:07.010677 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7f9a7-d28d-43a5-a01d-8d16f49e63e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:07.011042 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7f9a7-d28d-43a5-a01d-8d16f49e63e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:07.011790 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7f9a7-d28d-43a5-a01d-8d16f49e63e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:07.013918 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7f9a7-d28d-43a5-a01d-8d16f49e63e7 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:07.038053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1028/2040] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:15:06 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:15:07.042291 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c616c0-72ee-481e-8cfc-c122989012d0 service nova] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:07.058299 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c616c0-72ee-481e-8cfc-c122989012d0 service nova] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:07.063091 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806904a5-734c-4d0d-a0ec-e03e50a9abe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:07.063734 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806904a5-734c-4d0d-a0ec-e03e50a9abe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:07.063997 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806904a5-734c-4d0d-a0ec-e03e50a9abe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:07.064262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806904a5-734c-4d0d-a0ec-e03e50a9abe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:07.064901 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806904a5-734c-4d0d-a0ec-e03e50a9abe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:07.066502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806904a5-734c-4d0d-a0ec-e03e50a9abe0 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:07.077390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1013/2041] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:15:07.081308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7f9a7-d28d-43a5-a01d-8d16f49e63e7 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:07.091811 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7f9a7-d28d-43a5-a01d-8d16f49e63e7 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:07.096562 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af737c07-b6df-4df1-b642-11810cb70700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:07.097169 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af737c07-b6df-4df1-b642-11810cb70700 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:07.097447 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af737c07-b6df-4df1-b642-11810cb70700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:07.097719 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af737c07-b6df-4df1-b642-11810cb70700 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:07.098351 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af737c07-b6df-4df1-b642-11810cb70700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:07.099981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af737c07-b6df-4df1-b642-11810cb70700 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:07.102392 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:07.112501 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1029/2042] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:15:07.116342 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806904a5-734c-4d0d-a0ec-e03e50a9abe0 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:07.127030 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806904a5-734c-4d0d-a0ec-e03e50a9abe0 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:07.132009 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27236df2-3183-4f74-8627-643f0dffdf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:07.133616 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27236df2-3183-4f74-8627-643f0dffdf78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:07.133929 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27236df2-3183-4f74-8627-643f0dffdf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:07.134124 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27236df2-3183-4f74-8627-643f0dffdf78 admin admin] PATH_INFO: `/v3/projects/3493366e32404f0e9860120dd6027de1/users/a8c709728b714d0ca585d982ed536134/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:07.150526 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27236df2-3183-4f74-8627-643f0dffdf78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3493366e32404f0e9860120dd6027de1, user_id=a8c709728b714d0ca585d982ed536134, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:07.153234 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27236df2-3183-4f74-8627-643f0dffdf78 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:07.168149 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1014/2043] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:15:07 2022] PUT /identity/v3/projects/3493366e32404f0e9860120dd6027de1/users/a8c709728b714d0ca585d982ed536134/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:15:07.173011 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bd14a-017c-4261-ad26-f791c7898199 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:07.173371 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bd14a-017c-4261-ad26-f791c7898199 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:07.173711 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bd14a-017c-4261-ad26-f791c7898199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:07.194401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-999bd14a-017c-4261-ad26-f791c7898199 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:07.196158 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-999bd14a-017c-4261-ad26-f791c7898199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:07.256809 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1030/2044] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:07.267285 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27236df2-3183-4f74-8627-643f0dffdf78 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:07.269125 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-27236df2-3183-4f74-8627-643f0dffdf78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:07.341226 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27236df2-3183-4f74-8627-643f0dffdf78 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:07.344870 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a505c-757f-4dc0-9d4d-765a189454cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:07.345473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a505c-757f-4dc0-9d4d-765a189454cf service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:07.345747 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a505c-757f-4dc0-9d4d-765a189454cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:07.346013 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a505c-757f-4dc0-9d4d-765a189454cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:07.355803 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a505c-757f-4dc0-9d4d-765a189454cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:07.357333 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a505c-757f-4dc0-9d4d-765a189454cf service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:07.373136 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1015/2045] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:15:15.387199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c5e37-0411-4854-836e-3f254d6e05da None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:15.387763 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c5e37-0411-4854-836e-3f254d6e05da None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:15.387763 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c5e37-0411-4854-836e-3f254d6e05da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:15.482115 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-0b8c5e37-0411-4854-836e-3f254d6e05da None None] MFA Rules not processed for user `a8c709728b714d0ca585d982ed536134`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:15.485628 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0b8c5e37-0411-4854-836e-3f254d6e05da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:15.692400 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a505c-757f-4dc0-9d4d-765a189454cf service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:15.708383 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1031/2046] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:15:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:15.720713 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a505c-757f-4dc0-9d4d-765a189454cf service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:15.726005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a077b4-4fe0-46ae-adad-49b4ecd2f92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:15.726737 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a077b4-4fe0-46ae-adad-49b4ecd2f92d admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:15.727021 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a077b4-4fe0-46ae-adad-49b4ecd2f92d admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:15.729865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a077b4-4fe0-46ae-adad-49b4ecd2f92d admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:15.731217 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a077b4-4fe0-46ae-adad-49b4ecd2f92d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:15.738459 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a077b4-4fe0-46ae-adad-49b4ecd2f92d admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:15.809550 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1016/2047] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:15:15 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:15:15.811446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c5e37-0411-4854-836e-3f254d6e05da None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:15.830281 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c5e37-0411-4854-836e-3f254d6e05da None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:15.989130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566be268-f05b-4f4b-be67-c084aac095a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:15.992832 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566be268-f05b-4f4b-be67-c084aac095a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:15.994022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566be268-f05b-4f4b-be67-c084aac095a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:15.994554 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566be268-f05b-4f4b-be67-c084aac095a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:15.995644 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566be268-f05b-4f4b-be67-c084aac095a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:16.012399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566be268-f05b-4f4b-be67-c084aac095a5 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:16.077184 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1032/2048] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:15:15 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:15:16.081474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a077b4-4fe0-46ae-adad-49b4ecd2f92d admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:16.099833 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a077b4-4fe0-46ae-adad-49b4ecd2f92d admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:16.107929 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcffdd7-a35a-4faa-b9aa-e205c84274fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:16.108827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcffdd7-a35a-4faa-b9aa-e205c84274fd admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:16.109113 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcffdd7-a35a-4faa-b9aa-e205c84274fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:16.109387 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcffdd7-a35a-4faa-b9aa-e205c84274fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:16.110039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcffdd7-a35a-4faa-b9aa-e205c84274fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:16.119314 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcffdd7-a35a-4faa-b9aa-e205c84274fd admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:16.144134 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1017/2049] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:15:16.145196 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566be268-f05b-4f4b-be67-c084aac095a5 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:16.159179 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566be268-f05b-4f4b-be67-c084aac095a5 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:16.164917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697e185-c47a-4660-b280-e778e6d86145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:16.165954 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697e185-c47a-4660-b280-e778e6d86145 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:16.166432 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697e185-c47a-4660-b280-e778e6d86145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:16.166914 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697e185-c47a-4660-b280-e778e6d86145 admin admin] PATH_INFO: `/v3/projects/fbe73dad231e4609beae571499d8d358/users/03da186cd3b24e87890611623115a7b6/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:16.184273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697e185-c47a-4660-b280-e778e6d86145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe73dad231e4609beae571499d8d358, user_id=03da186cd3b24e87890611623115a7b6, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:16.186988 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697e185-c47a-4660-b280-e778e6d86145 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:16.189302 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:16.202553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1033/2050] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:15:16 2022] PUT /identity/v3/projects/fbe73dad231e4609beae571499d8d358/users/03da186cd3b24e87890611623115a7b6/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:15:16.206844 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcffdd7-a35a-4faa-b9aa-e205c84274fd admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:16.217827 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcffdd7-a35a-4faa-b9aa-e205c84274fd admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:16.289982 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c0600-c4a4-4406-b687-ebbbdcb43f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:16.290850 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c0600-c4a4-4406-b687-ebbbdcb43f8e admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:16.291323 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c0600-c4a4-4406-b687-ebbbdcb43f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:16.291966 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c0600-c4a4-4406-b687-ebbbdcb43f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:16.293494 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c0600-c4a4-4406-b687-ebbbdcb43f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:16.296027 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c0600-c4a4-4406-b687-ebbbdcb43f8e admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:16.298589 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:16.319041 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1018/2051] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:15:16.323724 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697e185-c47a-4660-b280-e778e6d86145 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:16.341745 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697e185-c47a-4660-b280-e778e6d86145 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:16.356737 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d97fe-c508-4cf3-ad7f-edc5484d0f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:16.357597 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d97fe-c508-4cf3-ad7f-edc5484d0f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:16.357978 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d97fe-c508-4cf3-ad7f-edc5484d0f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:16.358343 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d97fe-c508-4cf3-ad7f-edc5484d0f69 admin admin] PATH_INFO: `/v3/projects/fbe73dad231e4609beae571499d8d358/users/03da186cd3b24e87890611623115a7b6/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:16.361937 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d97fe-c508-4cf3-ad7f-edc5484d0f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe73dad231e4609beae571499d8d358, user_id=03da186cd3b24e87890611623115a7b6, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:16.364832 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d97fe-c508-4cf3-ad7f-edc5484d0f69 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:16.380059 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1034/2052] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:15:16 2022] PUT /identity/v3/projects/fbe73dad231e4609beae571499d8d358/users/03da186cd3b24e87890611623115a7b6/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:15:21.420676 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818d94d-2fc6-4c00-bb4c-162fd5fe7997 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:21.421331 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818d94d-2fc6-4c00-bb4c-162fd5fe7997 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:21.421331 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818d94d-2fc6-4c00-bb4c-162fd5fe7997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:21.475227 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-1818d94d-2fc6-4c00-bb4c-162fd5fe7997 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:21.479840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-1818d94d-2fc6-4c00-bb4c-162fd5fe7997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:21.709895 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1019/2053] 10.222.0.39 () {58 vars in 1016 bytes} [Mon Oct 24 13:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:21.939348 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d97fe-c508-4cf3-ad7f-edc5484d0f69 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:21.941859 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3d4d97fe-c508-4cf3-ad7f-edc5484d0f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:22.110927 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d97fe-c508-4cf3-ad7f-edc5484d0f69 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:22.124038 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65f158-9382-42d4-b268-203da5d81e59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:22.124672 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65f158-9382-42d4-b268-203da5d81e59 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:22.124959 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65f158-9382-42d4-b268-203da5d81e59 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:22.125265 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65f158-9382-42d4-b268-203da5d81e59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:22.150215 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65f158-9382-42d4-b268-203da5d81e59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:22.151902 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65f158-9382-42d4-b268-203da5d81e59 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:22.171704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1035/2054] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:23.420762 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b10dfa-f965-4916-9bd6-d6445bc7694c None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:23.422205 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b10dfa-f965-4916-9bd6-d6445bc7694c None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:23.422646 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b10dfa-f965-4916-9bd6-d6445bc7694c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:23.471463 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-21b10dfa-f965-4916-9bd6-d6445bc7694c None None] MFA Rules not processed for user `a2ed22a974be4cfd86108df0b98c4d50`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:23.478092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-21b10dfa-f965-4916-9bd6-d6445bc7694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:23.597298 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1020/2055] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:15:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:23.806939 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13871c-b66b-4bcd-9362-d9fc2a58f948 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:23.807873 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13871c-b66b-4bcd-9362-d9fc2a58f948 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:23.808256 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13871c-b66b-4bcd-9362-d9fc2a58f948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:23.870017 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-fa13871c-b66b-4bcd-9362-d9fc2a58f948 None None] MFA Rules not processed for user `03da186cd3b24e87890611623115a7b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:23.888046 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-fa13871c-b66b-4bcd-9362-d9fc2a58f948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:24.029738 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1036/2056] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:15:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:24.043018 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b10dfa-f965-4916-9bd6-d6445bc7694c None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:24.058466 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b10dfa-f965-4916-9bd6-d6445bc7694c None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:24.064658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9f1e3-1d22-43f4-ac2f-32826149049b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:24.065289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9f1e3-1d22-43f4-ac2f-32826149049b service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:24.065587 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9f1e3-1d22-43f4-ac2f-32826149049b service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:24.065860 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9f1e3-1d22-43f4-ac2f-32826149049b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:24.129329 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9f1e3-1d22-43f4-ac2f-32826149049b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:24.131066 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9f1e3-1d22-43f4-ac2f-32826149049b service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:24.142302 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1021/2057] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:25.370336 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe803648-8b28-405b-8118-4c3ddcc8b975 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:25.371240 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe803648-8b28-405b-8118-4c3ddcc8b975 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:25.372858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe803648-8b28-405b-8118-4c3ddcc8b975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:25.409839 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-fe803648-8b28-405b-8118-4c3ddcc8b975 None None] MFA Rules not processed for user `f3254b4fddaa4f099c6c44f4c139ee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:25.411412 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-fe803648-8b28-405b-8118-4c3ddcc8b975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:25.514025 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:25.531389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1037/2058] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 24 13:15:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:25.554451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9f1e3-1d22-43f4-ac2f-32826149049b service nova] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:25.556725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-25f9f1e3-1d22-43f4-ac2f-32826149049b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:25.777241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:25.841174 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9f1e3-1d22-43f4-ac2f-32826149049b service nova] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:25.874912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00deec85-2372-419c-9ae1-14776c79a568 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '768c71ab4ab241e4bfed9f7561ae3d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:25.876534 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00deec85-2372-419c-9ae1-14776c79a568 service swift] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:25.876837 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00deec85-2372-419c-9ae1-14776c79a568 service swift] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:25.877113 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00deec85-2372-419c-9ae1-14776c79a568 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:25.892776 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00deec85-2372-419c-9ae1-14776c79a568 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:25.895341 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00deec85-2372-419c-9ae1-14776c79a568 service swift] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:25.914802 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1022/2059] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 24 13:15:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:15:27.197676 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb965e-ee94-4159-81b7-e52c364af4c8 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:27.198597 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb965e-ee94-4159-81b7-e52c364af4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:27.199035 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb965e-ee94-4159-81b7-e52c364af4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:27.255553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-f0eb965e-ee94-4159-81b7-e52c364af4c8 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:27.273513 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f0eb965e-ee94-4159-81b7-e52c364af4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:27.304307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1038/2060] 10.222.0.39 () {58 vars in 1016 bytes} [Mon Oct 24 13:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:27.345101 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040885f-4c31-42de-a374-778532ea843a None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:27.345679 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040885f-4c31-42de-a374-778532ea843a None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:27.345784 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040885f-4c31-42de-a374-778532ea843a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:27.380043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-6040885f-4c31-42de-a374-778532ea843a None None] MFA Rules not processed for user `a8c709728b714d0ca585d982ed536134`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:27.381747 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-6040885f-4c31-42de-a374-778532ea843a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:27.394668 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1023/2061] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:15:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:27.528502 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb965e-ee94-4159-81b7-e52c364af4c8 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:27.560326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb965e-ee94-4159-81b7-e52c364af4c8 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:27.568711 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d1f3a-16a2-470e-99f3-86ccfcc30e54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:27.569384 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d1f3a-16a2-470e-99f3-86ccfcc30e54 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:27.569951 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d1f3a-16a2-470e-99f3-86ccfcc30e54 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:27.570229 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d1f3a-16a2-470e-99f3-86ccfcc30e54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:27.585526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d1f3a-16a2-470e-99f3-86ccfcc30e54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:27.587528 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d1f3a-16a2-470e-99f3-86ccfcc30e54 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:27.601753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1039/2062] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:28.638582 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040885f-4c31-42de-a374-778532ea843a None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:28.653254 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-6040885f-4c31-42de-a374-778532ea843a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:28.688292 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040885f-4c31-42de-a374-778532ea843a None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:28.705989 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c53cb5-a7ec-4c6b-bf95-4e774337bdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:28.706662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c53cb5-a7ec-4c6b-bf95-4e774337bdc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:28.706943 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c53cb5-a7ec-4c6b-bf95-4e774337bdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:28.707264 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c53cb5-a7ec-4c6b-bf95-4e774337bdc7 admin admin] PATH_INFO: `/v3/users/aca9fe48ad454cc9a7b4a023c54abd0b` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:28.709804 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c53cb5-a7ec-4c6b-bf95-4e774337bdc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aca9fe48ad454cc9a7b4a023c54abd0b)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:28.713447 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c53cb5-a7ec-4c6b-bf95-4e774337bdc7 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:28.844383 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-a7c53cb5-a7ec-4c6b-bf95-4e774337bdc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aca9fe48ad454cc9a7b4a023c54abd0b'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:28.881088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-a7c53cb5-a7ec-4c6b-bf95-4e774337bdc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aca9fe48ad454cc9a7b4a023c54abd0b'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:28.891798 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-a7c53cb5-a7ec-4c6b-bf95-4e774337bdc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aca9fe48ad454cc9a7b4a023c54abd0b'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:28.914252 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-a7c53cb5-a7ec-4c6b-bf95-4e774337bdc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aca9fe48ad454cc9a7b4a023c54abd0b'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:28.915928 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-a7c53cb5-a7ec-4c6b-bf95-4e774337bdc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aca9fe48ad454cc9a7b4a023c54abd0b'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:28.937922 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1024/2063] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:15:28 2022] DELETE /identity/v3/users/aca9fe48ad454cc9a7b4a023c54abd0b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:15:28.939850 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c0b19-fbe2-4f0d-9cad-108e06b65397 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:28.940438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c0b19-fbe2-4f0d-9cad-108e06b65397 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:28.940632 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c0b19-fbe2-4f0d-9cad-108e06b65397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:29.056059 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d21c0b19-fbe2-4f0d-9cad-108e06b65397 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:29.058877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d21c0b19-fbe2-4f0d-9cad-108e06b65397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:29.261380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1040/2064] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:29.270443 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c53cb5-a7ec-4c6b-bf95-4e774337bdc7 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:29.272076 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-a7c53cb5-a7ec-4c6b-bf95-4e774337bdc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:29.452216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c53cb5-a7ec-4c6b-bf95-4e774337bdc7 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:29.458522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4eb4e-bf1e-4c7e-a8f8-ccf99b358426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:29.459871 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4eb4e-bf1e-4c7e-a8f8-ccf99b358426 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:29.460675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4eb4e-bf1e-4c7e-a8f8-ccf99b358426 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:29.460943 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4eb4e-bf1e-4c7e-a8f8-ccf99b358426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:29.478738 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4eb4e-bf1e-4c7e-a8f8-ccf99b358426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:29.481903 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4eb4e-bf1e-4c7e-a8f8-ccf99b358426 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:29.499375 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1025/2065] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:30.542154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c0b19-fbe2-4f0d-9cad-108e06b65397 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:30.557514 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d21c0b19-fbe2-4f0d-9cad-108e06b65397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:30.572201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c0b19-fbe2-4f0d-9cad-108e06b65397 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:30.604840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83460bf2-6444-4d9e-8d4c-4a9e9a993687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:30.604840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83460bf2-6444-4d9e-8d4c-4a9e9a993687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:30.605465 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83460bf2-6444-4d9e-8d4c-4a9e9a993687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:30.605898 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83460bf2-6444-4d9e-8d4c-4a9e9a993687 admin admin] PATH_INFO: `/v3/projects/899edf10e9444df7b01fb790ffffec98` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:30.610088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83460bf2-6444-4d9e-8d4c-4a9e9a993687 admin admin] RBAC: Authorizing `identity:delete_project(project_id=899edf10e9444df7b01fb790ffffec98)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:30.612235 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83460bf2-6444-4d9e-8d4c-4a9e9a993687 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:30.767772 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-83460bf2-6444-4d9e-8d4c-4a9e9a993687 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '899edf10e9444df7b01fb790ffffec98', 'request_id': 'req-83460bf2-6444-4d9e-8d4c-4a9e9a993687'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:30.800470 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-83460bf2-6444-4d9e-8d4c-4a9e9a993687 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '899edf10e9444df7b01fb790ffffec98', 'request_id': 'req-83460bf2-6444-4d9e-8d4c-4a9e9a993687'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:30.808831 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-83460bf2-6444-4d9e-8d4c-4a9e9a993687 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '899edf10e9444df7b01fb790ffffec98', 'request_id': 'req-83460bf2-6444-4d9e-8d4c-4a9e9a993687'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:30.855239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-83460bf2-6444-4d9e-8d4c-4a9e9a993687 admin admin] The token cache is being invalidate because project 899edf10e9444df7b01fb790ffffec98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:15:30.856425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-83460bf2-6444-4d9e-8d4c-4a9e9a993687 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:30.857386 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-83460bf2-6444-4d9e-8d4c-4a9e9a993687 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:30.867345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1041/2066] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:15:30 2022] DELETE /identity/v3/projects/899edf10e9444df7b01fb790ffffec98 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:15:30.872949 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb96b7-663f-4a6d-a5f7-859834174fff None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:30.873545 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb96b7-663f-4a6d-a5f7-859834174fff None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:30.873545 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb96b7-663f-4a6d-a5f7-859834174fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:30.956724 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-eacb96b7-663f-4a6d-a5f7-859834174fff None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:30.958599 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-eacb96b7-663f-4a6d-a5f7-859834174fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:31.058902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:31.098999 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1026/2067] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:31.111853 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d1805-c57b-4149-a2fa-5d25e1aa8f8c None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:31.112407 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d1805-c57b-4149-a2fa-5d25e1aa8f8c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:31.114200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d1805-c57b-4149-a2fa-5d25e1aa8f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:31.181372 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-344d1805-c57b-4149-a2fa-5d25e1aa8f8c None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:31.183236 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-344d1805-c57b-4149-a2fa-5d25e1aa8f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:31.220593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1042/2068] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:31.225465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb96b7-663f-4a6d-a5f7-859834174fff None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:31.258214 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb96b7-663f-4a6d-a5f7-859834174fff None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:31.278187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd33037-9054-4d16-a7e1-f30ebf473251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:31.279151 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd33037-9054-4d16-a7e1-f30ebf473251 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:31.280575 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd33037-9054-4d16-a7e1-f30ebf473251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:31.281190 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd33037-9054-4d16-a7e1-f30ebf473251 admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:31.291280 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd33037-9054-4d16-a7e1-f30ebf473251 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:15:31.292657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd33037-9054-4d16-a7e1-f30ebf473251 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:31.311017 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd33037-9054-4d16-a7e1-f30ebf473251 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:31.326254 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1027/2069] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:15:31.330377 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d1805-c57b-4149-a2fa-5d25e1aa8f8c None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:31.340803 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d1805-c57b-4149-a2fa-5d25e1aa8f8c None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:31.371215 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f08df-cb5e-4a93-9dee-eb927766c748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:31.375271 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f08df-cb5e-4a93-9dee-eb927766c748 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:31.376937 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f08df-cb5e-4a93-9dee-eb927766c748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:31.379293 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f08df-cb5e-4a93-9dee-eb927766c748 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:31.380770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f08df-cb5e-4a93-9dee-eb927766c748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:31.386792 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f08df-cb5e-4a93-9dee-eb927766c748 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:31.432201 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2206ce-f88a-4b9a-9e11-5d6b52c2b7e9 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:31.432361 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2206ce-f88a-4b9a-9e11-5d6b52c2b7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:31.432638 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2206ce-f88a-4b9a-9e11-5d6b52c2b7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:31.489483 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-da2206ce-f88a-4b9a-9e11-5d6b52c2b7e9 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:31.494957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-da2206ce-f88a-4b9a-9e11-5d6b52c2b7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:31.524217 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1028/2070] 10.222.0.39 () {58 vars in 1016 bytes} [Mon Oct 24 13:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:15:31.524672 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1043/2071] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:15:31 2022] POST /identity/v3/projects => generated 373 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:15:31.526411 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2206ce-f88a-4b9a-9e11-5d6b52c2b7e9 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:31.550056 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2206ce-f88a-4b9a-9e11-5d6b52c2b7e9 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:31.676140 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f08df-cb5e-4a93-9dee-eb927766c748 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:31.680277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5b7f08df-cb5e-4a93-9dee-eb927766c748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:31.727474 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:31.727845 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58903781-354f-45b5-ac9e-76e657201702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:31.731447 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58903781-354f-45b5-ac9e-76e657201702 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:31.731807 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58903781-354f-45b5-ac9e-76e657201702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:31.732126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58903781-354f-45b5-ac9e-76e657201702 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:31.733091 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58903781-354f-45b5-ac9e-76e657201702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:31.736669 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58903781-354f-45b5-ac9e-76e657201702 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:31.767634 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1029/2072] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:15:31 2022] POST /identity/v3/users => generated 287 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:15:31.776052 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58903781-354f-45b5-ac9e-76e657201702 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:31.788344 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58903781-354f-45b5-ac9e-76e657201702 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:31.795683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391c090-faa9-4e2f-a8aa-9e9a48439ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:31.797496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391c090-faa9-4e2f-a8aa-9e9a48439ace admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:31.797787 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391c090-faa9-4e2f-a8aa-9e9a48439ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:31.798158 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391c090-faa9-4e2f-a8aa-9e9a48439ace admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:31.799517 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391c090-faa9-4e2f-a8aa-9e9a48439ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:31.801606 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391c090-faa9-4e2f-a8aa-9e9a48439ace admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:31.808863 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f08df-cb5e-4a93-9dee-eb927766c748 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:31.815230 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c975f4-a2bf-49dc-bca8-be9eb04f309a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:31.815607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1030/2073] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:15:31.816033 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c975f4-a2bf-49dc-bca8-be9eb04f309a service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:31.816387 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c975f4-a2bf-49dc-bca8-be9eb04f309a service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:31.816731 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c975f4-a2bf-49dc-bca8-be9eb04f309a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:31.820476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391c090-faa9-4e2f-a8aa-9e9a48439ace admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:31.837886 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c975f4-a2bf-49dc-bca8-be9eb04f309a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:31.839588 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c975f4-a2bf-49dc-bca8-be9eb04f309a service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:31.842880 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391c090-faa9-4e2f-a8aa-9e9a48439ace admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:31.848673 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c9e48-2234-450c-984d-1fbfffc64da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:31.849287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c9e48-2234-450c-984d-1fbfffc64da8 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:31.849560 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c9e48-2234-450c-984d-1fbfffc64da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:31.849834 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c9e48-2234-450c-984d-1fbfffc64da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:31.850458 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c9e48-2234-450c-984d-1fbfffc64da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:31.852747 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c9e48-2234-450c-984d-1fbfffc64da8 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:31.852896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1044/2074] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:31.865489 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1031/2075] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:15:31.873699 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c975f4-a2bf-49dc-bca8-be9eb04f309a service nova] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:31.892754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c975f4-a2bf-49dc-bca8-be9eb04f309a service nova] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:31.902877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f192d5b-bbb1-4769-b271-0caac8abf2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:31.903778 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f192d5b-bbb1-4769-b271-0caac8abf2eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:31.905588 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f192d5b-bbb1-4769-b271-0caac8abf2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:31.905906 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f192d5b-bbb1-4769-b271-0caac8abf2eb admin admin] PATH_INFO: `/v3/projects/92d4a0cb006743fa85bfb5c374dd7ea9/users/4dafc3c9c85648f4999121b8845a8bd3/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:31.934842 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f192d5b-bbb1-4769-b271-0caac8abf2eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d4a0cb006743fa85bfb5c374dd7ea9, user_id=4dafc3c9c85648f4999121b8845a8bd3, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:31.938837 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f192d5b-bbb1-4769-b271-0caac8abf2eb admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:31.965840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1045/2076] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:15:31 2022] PUT /identity/v3/projects/92d4a0cb006743fa85bfb5c374dd7ea9/users/4dafc3c9c85648f4999121b8845a8bd3/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:15:31.978521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85cb3d-cebf-4641-b0fe-8a05e5ac41a8 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:31.979126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85cb3d-cebf-4641-b0fe-8a05e5ac41a8 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:31.979126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85cb3d-cebf-4641-b0fe-8a05e5ac41a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:32.055604 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-8c85cb3d-cebf-4641-b0fe-8a05e5ac41a8 None None] MFA Rules not processed for user `4dafc3c9c85648f4999121b8845a8bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:32.057067 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-8c85cb3d-cebf-4641-b0fe-8a05e5ac41a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:32.303029 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1032/2077] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:15:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:32.314146 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f192d5b-bbb1-4769-b271-0caac8abf2eb admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:32.316734 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7f192d5b-bbb1-4769-b271-0caac8abf2eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:32.405065 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f192d5b-bbb1-4769-b271-0caac8abf2eb admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:32.409241 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ad01d-a588-4bb1-9129-bb0950713eb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:32.409977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ad01d-a588-4bb1-9129-bb0950713eb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:32.410374 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ad01d-a588-4bb1-9129-bb0950713eb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:32.410756 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ad01d-a588-4bb1-9129-bb0950713eb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:32.429705 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ad01d-a588-4bb1-9129-bb0950713eb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:32.431248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ad01d-a588-4bb1-9129-bb0950713eb3 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:32.480315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1046/2078] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:32.528258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85cb3d-cebf-4641-b0fe-8a05e5ac41a8 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:32.566821 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:32.731514 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85cb3d-cebf-4641-b0fe-8a05e5ac41a8 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:32.752422 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736994d7-4f47-4e64-87f7-7eac1123a9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:32.753075 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736994d7-4f47-4e64-87f7-7eac1123a9a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:32.753716 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736994d7-4f47-4e64-87f7-7eac1123a9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:32.754002 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736994d7-4f47-4e64-87f7-7eac1123a9a2 admin admin] PATH_INFO: `/v3/users/4dafc3c9c85648f4999121b8845a8bd3` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:32.755637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736994d7-4f47-4e64-87f7-7eac1123a9a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dafc3c9c85648f4999121b8845a8bd3)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:32.758606 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736994d7-4f47-4e64-87f7-7eac1123a9a2 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:32.872073 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-736994d7-4f47-4e64-87f7-7eac1123a9a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dafc3c9c85648f4999121b8845a8bd3'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:32.881154 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-736994d7-4f47-4e64-87f7-7eac1123a9a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dafc3c9c85648f4999121b8845a8bd3'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:32.897132 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-736994d7-4f47-4e64-87f7-7eac1123a9a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dafc3c9c85648f4999121b8845a8bd3'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:32.919705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-736994d7-4f47-4e64-87f7-7eac1123a9a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dafc3c9c85648f4999121b8845a8bd3'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:32.920830 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-736994d7-4f47-4e64-87f7-7eac1123a9a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dafc3c9c85648f4999121b8845a8bd3'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:32.927828 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1033/2079] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:15:32 2022] DELETE /identity/v3/users/4dafc3c9c85648f4999121b8845a8bd3 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:15:32.933549 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c54a15-ed09-4b9d-b6dd-61a46cd9b060 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:32.940717 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c54a15-ed09-4b9d-b6dd-61a46cd9b060 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:32.941005 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c54a15-ed09-4b9d-b6dd-61a46cd9b060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:32.995190 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-13c54a15-ed09-4b9d-b6dd-61a46cd9b060 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:32.996486 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-13c54a15-ed09-4b9d-b6dd-61a46cd9b060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:33.106280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1047/2080] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:33.115216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736994d7-4f47-4e64-87f7-7eac1123a9a2 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:33.118135 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-736994d7-4f47-4e64-87f7-7eac1123a9a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:33.201278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736994d7-4f47-4e64-87f7-7eac1123a9a2 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:33.207435 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec386613-8bdd-4a5e-9857-aed46487b9cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:33.209503 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec386613-8bdd-4a5e-9857-aed46487b9cd service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:33.209787 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec386613-8bdd-4a5e-9857-aed46487b9cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:33.211157 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec386613-8bdd-4a5e-9857-aed46487b9cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:33.241613 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec386613-8bdd-4a5e-9857-aed46487b9cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:33.243746 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec386613-8bdd-4a5e-9857-aed46487b9cd service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:33.255908 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1034/2081] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:33.814838 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c54a15-ed09-4b9d-b6dd-61a46cd9b060 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:33.815222 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-13c54a15-ed09-4b9d-b6dd-61a46cd9b060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:33.840288 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c54a15-ed09-4b9d-b6dd-61a46cd9b060 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:33.859767 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd773b-9cd5-4590-a629-c0fbbb0f48d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:33.860843 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd773b-9cd5-4590-a629-c0fbbb0f48d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:33.861189 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd773b-9cd5-4590-a629-c0fbbb0f48d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:33.861689 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd773b-9cd5-4590-a629-c0fbbb0f48d5 admin admin] PATH_INFO: `/v3/projects/92d4a0cb006743fa85bfb5c374dd7ea9` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:33.862936 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd773b-9cd5-4590-a629-c0fbbb0f48d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92d4a0cb006743fa85bfb5c374dd7ea9)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:33.865380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd773b-9cd5-4590-a629-c0fbbb0f48d5 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:33.937245 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:33.984317 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cdfd773b-9cd5-4590-a629-c0fbbb0f48d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92d4a0cb006743fa85bfb5c374dd7ea9', 'request_id': 'req-cdfd773b-9cd5-4590-a629-c0fbbb0f48d5'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:34.000001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cdfd773b-9cd5-4590-a629-c0fbbb0f48d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92d4a0cb006743fa85bfb5c374dd7ea9', 'request_id': 'req-cdfd773b-9cd5-4590-a629-c0fbbb0f48d5'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:34.011747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cdfd773b-9cd5-4590-a629-c0fbbb0f48d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92d4a0cb006743fa85bfb5c374dd7ea9', 'request_id': 'req-cdfd773b-9cd5-4590-a629-c0fbbb0f48d5'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:34.034935 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cdfd773b-9cd5-4590-a629-c0fbbb0f48d5 admin admin] The token cache is being invalidate because project 92d4a0cb006743fa85bfb5c374dd7ea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:15:34.035407 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cdfd773b-9cd5-4590-a629-c0fbbb0f48d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:34.036625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cdfd773b-9cd5-4590-a629-c0fbbb0f48d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:34.039054 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1048/2082] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:15:33 2022] DELETE /identity/v3/projects/92d4a0cb006743fa85bfb5c374dd7ea9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:15:34.044812 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d0f46-4d25-4542-aa64-f9b82f44a014 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:34.045090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d0f46-4d25-4542-aa64-f9b82f44a014 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:34.045360 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d0f46-4d25-4542-aa64-f9b82f44a014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:34.084298 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-148d0f46-4d25-4542-aa64-f9b82f44a014 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:34.086644 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-148d0f46-4d25-4542-aa64-f9b82f44a014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:34.130584 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:34.181990 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1035/2083] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:34.191200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd3e13-64b6-4473-bb8d-260d84ea9c6b None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:34.193633 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd3e13-64b6-4473-bb8d-260d84ea9c6b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:34.193633 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd3e13-64b6-4473-bb8d-260d84ea9c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:34.233819 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-c3fd3e13-64b6-4473-bb8d-260d84ea9c6b None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:34.235091 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c3fd3e13-64b6-4473-bb8d-260d84ea9c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:34.249201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1049/2084] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:34.254014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d0f46-4d25-4542-aa64-f9b82f44a014 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:34.266411 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d0f46-4d25-4542-aa64-f9b82f44a014 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:34.274141 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811574f-24e6-4067-b0e8-015f15971520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:34.274841 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811574f-24e6-4067-b0e8-015f15971520 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:34.275260 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811574f-24e6-4067-b0e8-015f15971520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:34.275577 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811574f-24e6-4067-b0e8-015f15971520 admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:34.276307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811574f-24e6-4067-b0e8-015f15971520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:15:34.276678 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811574f-24e6-4067-b0e8-015f15971520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:34.278373 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811574f-24e6-4067-b0e8-015f15971520 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:34.298089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1036/2085] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:15:34.302373 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd3e13-64b6-4473-bb8d-260d84ea9c6b None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:34.313318 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd3e13-64b6-4473-bb8d-260d84ea9c6b None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:34.319771 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180378a-58d1-44cb-82b0-819684cf4f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:34.320464 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180378a-58d1-44cb-82b0-819684cf4f41 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:34.320746 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180378a-58d1-44cb-82b0-819684cf4f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:34.321015 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180378a-58d1-44cb-82b0-819684cf4f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:34.321660 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180378a-58d1-44cb-82b0-819684cf4f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:34.326907 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180378a-58d1-44cb-82b0-819684cf4f41 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:34.367892 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1050/2086] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:15:34 2022] POST /identity/v3/projects => generated 389 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:15:34.373267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811574f-24e6-4067-b0e8-015f15971520 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:34.391873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811574f-24e6-4067-b0e8-015f15971520 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:34.503025 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d372e4f-5315-4f63-92d1-8492576dac19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:34.504113 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d372e4f-5315-4f63-92d1-8492576dac19 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:34.505240 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d372e4f-5315-4f63-92d1-8492576dac19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:34.505601 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d372e4f-5315-4f63-92d1-8492576dac19 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:34.507315 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d372e4f-5315-4f63-92d1-8492576dac19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:34.510490 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d372e4f-5315-4f63-92d1-8492576dac19 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:34.592887 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180378a-58d1-44cb-82b0-819684cf4f41 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:34.597950 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1037/2087] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:15:34 2022] POST /identity/v3/users => generated 295 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:15:34.610166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180378a-58d1-44cb-82b0-819684cf4f41 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:34.669401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66189f29-0e49-4ac9-91b7-7657d7fff4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:34.670651 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66189f29-0e49-4ac9-91b7-7657d7fff4cc admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:34.670651 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66189f29-0e49-4ac9-91b7-7657d7fff4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:34.670651 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66189f29-0e49-4ac9-91b7-7657d7fff4cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:34.671269 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66189f29-0e49-4ac9-91b7-7657d7fff4cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:34.685380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66189f29-0e49-4ac9-91b7-7657d7fff4cc admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:34.713205 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1051/2088] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:15:34.717946 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d372e4f-5315-4f63-92d1-8492576dac19 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:34.736434 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d372e4f-5315-4f63-92d1-8492576dac19 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:34.750776 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89988de-b0d6-42b2-99ed-eeb620c180b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:34.751803 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89988de-b0d6-42b2-99ed-eeb620c180b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:34.752262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89988de-b0d6-42b2-99ed-eeb620c180b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:34.752532 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89988de-b0d6-42b2-99ed-eeb620c180b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:34.754168 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89988de-b0d6-42b2-99ed-eeb620c180b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:34.755484 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89988de-b0d6-42b2-99ed-eeb620c180b7 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:34.771472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1038/2089] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:15:34.786033 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66189f29-0e49-4ac9-91b7-7657d7fff4cc admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:34.804894 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66189f29-0e49-4ac9-91b7-7657d7fff4cc admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:34.810304 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40230b5-3a89-4b61-b021-4c93e1228325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:34.810983 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40230b5-3a89-4b61-b021-4c93e1228325 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:34.811327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40230b5-3a89-4b61-b021-4c93e1228325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:34.811687 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40230b5-3a89-4b61-b021-4c93e1228325 admin admin] PATH_INFO: `/v3/projects/538f5bd1757b4213aac4d042e246498c/users/7d19572dee174f5aa809ea8bbf47e463/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:34.832509 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40230b5-3a89-4b61-b021-4c93e1228325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=538f5bd1757b4213aac4d042e246498c, user_id=7d19572dee174f5aa809ea8bbf47e463, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:34.836288 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40230b5-3a89-4b61-b021-4c93e1228325 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:34.860223 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1052/2090] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:15:34 2022] PUT /identity/v3/projects/538f5bd1757b4213aac4d042e246498c/users/7d19572dee174f5aa809ea8bbf47e463/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:15:34.866915 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78eb858-7fca-466e-8a11-95e68f9958db None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:34.867836 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78eb858-7fca-466e-8a11-95e68f9958db None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:34.868365 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78eb858-7fca-466e-8a11-95e68f9958db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:34.919460 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-c78eb858-7fca-466e-8a11-95e68f9958db None None] MFA Rules not processed for user `7d19572dee174f5aa809ea8bbf47e463`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:34.921640 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-c78eb858-7fca-466e-8a11-95e68f9958db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:35.064009 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1039/2091] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:15:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:35.081747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40230b5-3a89-4b61-b021-4c93e1228325 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:35.087981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e40230b5-3a89-4b61-b021-4c93e1228325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:35.204842 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40230b5-3a89-4b61-b021-4c93e1228325 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:35.209420 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0bd2d-404b-45bc-ad40-08f0462c859d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:35.209613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0bd2d-404b-45bc-ad40-08f0462c859d service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:35.210453 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0bd2d-404b-45bc-ad40-08f0462c859d service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:35.210693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0bd2d-404b-45bc-ad40-08f0462c859d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:35.223521 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0bd2d-404b-45bc-ad40-08f0462c859d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:35.227238 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0bd2d-404b-45bc-ad40-08f0462c859d service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:35.247213 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1053/2092] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:35.805086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c3fe7-07c9-4b0f-a65a-e74fd7bb2768 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:35.805693 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c3fe7-07c9-4b0f-a65a-e74fd7bb2768 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:35.805919 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c3fe7-07c9-4b0f-a65a-e74fd7bb2768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:35.871721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-856c3fe7-07c9-4b0f-a65a-e74fd7bb2768 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:35.873467 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-856c3fe7-07c9-4b0f-a65a-e74fd7bb2768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:35.912866 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:35.977712 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1040/2093] 10.222.0.39 () {58 vars in 1016 bytes} [Mon Oct 24 13:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:36.026543 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0bd2d-404b-45bc-ad40-08f0462c859d service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:36.028744 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a8f0bd2d-404b-45bc-ad40-08f0462c859d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:36.161384 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:36.202764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0bd2d-404b-45bc-ad40-08f0462c859d service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:36.213100 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96602e4c-de48-4176-99c4-aaf45925867e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:36.213993 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96602e4c-de48-4176-99c4-aaf45925867e service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:36.214351 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96602e4c-de48-4176-99c4-aaf45925867e service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:36.215029 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96602e4c-de48-4176-99c4-aaf45925867e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:36.227035 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96602e4c-de48-4176-99c4-aaf45925867e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:36.228694 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96602e4c-de48-4176-99c4-aaf45925867e service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:36.240205 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1054/2094] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:40.262085 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7adee3-fd7f-4e89-b529-48d74d1b5a3a None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:40.262765 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7adee3-fd7f-4e89-b529-48d74d1b5a3a None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:40.262765 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7adee3-fd7f-4e89-b529-48d74d1b5a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:40.284812 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-cb7adee3-fd7f-4e89-b529-48d74d1b5a3a None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:40.286312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-cb7adee3-fd7f-4e89-b529-48d74d1b5a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:40.295126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1041/2095] 10.222.0.39 () {58 vars in 1016 bytes} [Mon Oct 24 13:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:40.312421 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96602e4c-de48-4176-99c4-aaf45925867e service nova] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:40.329647 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96602e4c-de48-4176-99c4-aaf45925867e service nova] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:40.338130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b4693-a432-438c-92c0-ee6ff6a7c47f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:40.338847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b4693-a432-438c-92c0-ee6ff6a7c47f service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:40.339186 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b4693-a432-438c-92c0-ee6ff6a7c47f service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:40.339567 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b4693-a432-438c-92c0-ee6ff6a7c47f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:40.358288 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b4693-a432-438c-92c0-ee6ff6a7c47f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:40.359951 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b4693-a432-438c-92c0-ee6ff6a7c47f service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:40.371384 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1055/2096] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:41.111566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7adee3-fd7f-4e89-b529-48d74d1b5a3a None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:41.113039 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-cb7adee3-fd7f-4e89-b529-48d74d1b5a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:41.186952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7adee3-fd7f-4e89-b529-48d74d1b5a3a None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:41.190697 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9d59a-fe2b-4399-89ff-9ad33764da58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:41.192546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9d59a-fe2b-4399-89ff-9ad33764da58 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:41.192546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9d59a-fe2b-4399-89ff-9ad33764da58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:41.192546 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9d59a-fe2b-4399-89ff-9ad33764da58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:41.193914 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b2e9d59a-fe2b-4399-89ff-9ad33764da58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:41.282743 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9d59a-fe2b-4399-89ff-9ad33764da58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:41.284575 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9d59a-fe2b-4399-89ff-9ad33764da58 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:41.299607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1042/2097] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:46.431293 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b4693-a432-438c-92c0-ee6ff6a7c47f service nova] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:46.441366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b4693-a432-438c-92c0-ee6ff6a7c47f service nova] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:46.446954 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7c38b-1ea6-44d4-814f-ce01ccf24d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:46.448005 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7c38b-1ea6-44d4-814f-ce01ccf24d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:46.448288 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7c38b-1ea6-44d4-814f-ce01ccf24d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:46.448567 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7c38b-1ea6-44d4-814f-ce01ccf24d34 admin admin] PATH_INFO: `/v3/users/7d19572dee174f5aa809ea8bbf47e463` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:46.449905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7c38b-1ea6-44d4-814f-ce01ccf24d34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d19572dee174f5aa809ea8bbf47e463)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:46.452072 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7c38b-1ea6-44d4-814f-ce01ccf24d34 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:46.568660 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c6c7c38b-1ea6-44d4-814f-ce01ccf24d34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d19572dee174f5aa809ea8bbf47e463'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:46.586815 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c6c7c38b-1ea6-44d4-814f-ce01ccf24d34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d19572dee174f5aa809ea8bbf47e463'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:46.614670 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c6c7c38b-1ea6-44d4-814f-ce01ccf24d34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d19572dee174f5aa809ea8bbf47e463'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:46.634791 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c6c7c38b-1ea6-44d4-814f-ce01ccf24d34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d19572dee174f5aa809ea8bbf47e463'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:46.635817 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c6c7c38b-1ea6-44d4-814f-ce01ccf24d34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d19572dee174f5aa809ea8bbf47e463'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:46.644685 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1056/2098] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:15:46 2022] DELETE /identity/v3/users/7d19572dee174f5aa809ea8bbf47e463 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:15:46.650409 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb271677-6844-4261-a3f9-037d9f3d8f82 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:46.651295 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb271677-6844-4261-a3f9-037d9f3d8f82 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:46.651896 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb271677-6844-4261-a3f9-037d9f3d8f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:46.714055 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-eb271677-6844-4261-a3f9-037d9f3d8f82 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:46.715534 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-eb271677-6844-4261-a3f9-037d9f3d8f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:46.906679 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1043/2099] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:46.924083 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7c38b-1ea6-44d4-814f-ce01ccf24d34 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:46.925638 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c6c7c38b-1ea6-44d4-814f-ce01ccf24d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:47.046080 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7c38b-1ea6-44d4-814f-ce01ccf24d34 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:47.052091 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5797a-0bf3-4499-8b9e-151c4b6bcd16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:47.052706 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5797a-0bf3-4499-8b9e-151c4b6bcd16 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:47.052985 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5797a-0bf3-4499-8b9e-151c4b6bcd16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:47.053870 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5797a-0bf3-4499-8b9e-151c4b6bcd16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:47.063996 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5797a-0bf3-4499-8b9e-151c4b6bcd16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:47.065464 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5797a-0bf3-4499-8b9e-151c4b6bcd16 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:47.083401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1057/2100] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:47.447567 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb271677-6844-4261-a3f9-037d9f3d8f82 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:47.449599 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-eb271677-6844-4261-a3f9-037d9f3d8f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:47.465374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb271677-6844-4261-a3f9-037d9f3d8f82 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:47.473043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e7c23-14b9-4c93-9284-d25c6c29ffa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:47.474176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e7c23-14b9-4c93-9284-d25c6c29ffa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:47.476470 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e7c23-14b9-4c93-9284-d25c6c29ffa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:47.476984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e7c23-14b9-4c93-9284-d25c6c29ffa6 admin admin] PATH_INFO: `/v3/projects/538f5bd1757b4213aac4d042e246498c` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:47.480381 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e7c23-14b9-4c93-9284-d25c6c29ffa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=538f5bd1757b4213aac4d042e246498c)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:47.485397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e7c23-14b9-4c93-9284-d25c6c29ffa6 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:47.515619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:47.563262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-5a8e7c23-14b9-4c93-9284-d25c6c29ffa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538f5bd1757b4213aac4d042e246498c', 'request_id': 'req-5a8e7c23-14b9-4c93-9284-d25c6c29ffa6'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:47.572663 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-5a8e7c23-14b9-4c93-9284-d25c6c29ffa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538f5bd1757b4213aac4d042e246498c', 'request_id': 'req-5a8e7c23-14b9-4c93-9284-d25c6c29ffa6'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:47.580912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-5a8e7c23-14b9-4c93-9284-d25c6c29ffa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538f5bd1757b4213aac4d042e246498c', 'request_id': 'req-5a8e7c23-14b9-4c93-9284-d25c6c29ffa6'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:47.605330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-5a8e7c23-14b9-4c93-9284-d25c6c29ffa6 admin admin] The token cache is being invalidate because project 538f5bd1757b4213aac4d042e246498c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:15:47.605742 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-5a8e7c23-14b9-4c93-9284-d25c6c29ffa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:47.607010 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-5a8e7c23-14b9-4c93-9284-d25c6c29ffa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:47.611486 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1044/2101] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:15:47 2022] DELETE /identity/v3/projects/538f5bd1757b4213aac4d042e246498c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:15:47.907113 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962e2e5-c3da-4047-b70b-c19c2bfc9e05 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:47.908031 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962e2e5-c3da-4047-b70b-c19c2bfc9e05 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:47.908307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962e2e5-c3da-4047-b70b-c19c2bfc9e05 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:47.909632 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1058/2102] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 24 13:15:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:15:47.916996 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a6e49-8b98-48bf-9cc5-e250a0faaf8f None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:47.917459 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a6e49-8b98-48bf-9cc5-e250a0faaf8f None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:47.917660 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a6e49-8b98-48bf-9cc5-e250a0faaf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:47.938512 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-b77a6e49-8b98-48bf-9cc5-e250a0faaf8f None None] MFA Rules not processed for user `4f6b27c7d052437a949a371169fb48ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:47.939994 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b77a6e49-8b98-48bf-9cc5-e250a0faaf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:48.047345 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1045/2103] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 24 13:15:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:48.057863 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962e2e5-c3da-4047-b70b-c19c2bfc9e05 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:48.059653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a962e2e5-c3da-4047-b70b-c19c2bfc9e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:48.115868 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:48.133287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962e2e5-c3da-4047-b70b-c19c2bfc9e05 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:48.137806 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e892bf1-1522-4cdd-99bf-430fdda13e51 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0866de4d4e46d5b26719faf385d7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:48.138423 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e892bf1-1522-4cdd-99bf-430fdda13e51 service glance] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:48.138702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e892bf1-1522-4cdd-99bf-430fdda13e51 service glance] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:48.138976 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e892bf1-1522-4cdd-99bf-430fdda13e51 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:48.150809 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e892bf1-1522-4cdd-99bf-430fdda13e51 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:48.152285 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e892bf1-1522-4cdd-99bf-430fdda13e51 service glance] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:48.165458 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1059/2104] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:48.268539 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c726c5b-b7ed-4b5b-b285-157bf89e056a None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:48.269991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c726c5b-b7ed-4b5b-b285-157bf89e056a None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:48.270465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c726c5b-b7ed-4b5b-b285-157bf89e056a None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:48.273417 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1046/2105] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 24 13:15:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:15:48.279628 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e158a3-f976-43e5-85bb-e130cadc2645 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:48.279915 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e158a3-f976-43e5-85bb-e130cadc2645 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:48.280213 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e158a3-f976-43e5-85bb-e130cadc2645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:48.303185 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-83e158a3-f976-43e5-85bb-e130cadc2645 None None] MFA Rules not processed for user `0f2295659f2e467d8d798bf93f731330`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:48.305029 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-83e158a3-f976-43e5-85bb-e130cadc2645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:48.369083 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1060/2106] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 24 13:15:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:48.381102 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c726c5b-b7ed-4b5b-b285-157bf89e056a None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:48.383964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-9c726c5b-b7ed-4b5b-b285-157bf89e056a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:48.398193 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c726c5b-b7ed-4b5b-b285-157bf89e056a None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:48.402018 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5402e0-e96c-4e28-b067-968afa4ac8bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:48.402745 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5402e0-e96c-4e28-b067-968afa4ac8bd service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:48.403020 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5402e0-e96c-4e28-b067-968afa4ac8bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:48.403292 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5402e0-e96c-4e28-b067-968afa4ac8bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:48.410923 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5402e0-e96c-4e28-b067-968afa4ac8bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:48.412474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5402e0-e96c-4e28-b067-968afa4ac8bd service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:48.421377 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1047/2107] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:48.505910 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dbaac-5c57-43e2-a3c7-16a4de3b51d6 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:48.506229 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dbaac-5c57-43e2-a3c7-16a4de3b51d6 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:48.506508 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dbaac-5c57-43e2-a3c7-16a4de3b51d6 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:48.508637 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1061/2108] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 24 13:15:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:15:48.514525 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4d146-98ac-4bb1-b915-5b6dfb22a41f None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:48.514877 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4d146-98ac-4bb1-b915-5b6dfb22a41f None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:48.515212 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4d146-98ac-4bb1-b915-5b6dfb22a41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:48.535664 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-98e4d146-98ac-4bb1-b915-5b6dfb22a41f None None] MFA Rules not processed for user `4f6b27c7d052437a949a371169fb48ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:48.536873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-98e4d146-98ac-4bb1-b915-5b6dfb22a41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:48.548878 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1048/2109] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 24 13:15:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:48.561142 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8dbaac-5c57-43e2-a3c7-16a4de3b51d6 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:48.572967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8dbaac-5c57-43e2-a3c7-16a4de3b51d6 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:48.576517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25cde8-2598-4c4f-8354-e62114736623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:48.577099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25cde8-2598-4c4f-8354-e62114736623 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:48.577371 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25cde8-2598-4c4f-8354-e62114736623 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:48.577973 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25cde8-2598-4c4f-8354-e62114736623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:48.588110 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25cde8-2598-4c4f-8354-e62114736623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:48.589734 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25cde8-2598-4c4f-8354-e62114736623 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:48.600255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1062/2110] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:58.530605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=58,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:58.556093 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97181e-e18e-462f-ace1-08d239d64430 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:58.556382 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97181e-e18e-462f-ace1-08d239d64430 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:58.556657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97181e-e18e-462f-ace1-08d239d64430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:58.577781 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-0a97181e-e18e-462f-ace1-08d239d64430 None None] MFA Rules not processed for user `f3254b4fddaa4f099c6c44f4c139ee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:58.579102 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-0a97181e-e18e-462f-ace1-08d239d64430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:58.595777 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=35 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:58.654672 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1049/2111] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 24 13:15:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:58.680338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25cde8-2598-4c4f-8354-e62114736623 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:58.683407 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0b25cde8-2598-4c4f-8354-e62114736623 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:58.813364 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25cde8-2598-4c4f-8354-e62114736623 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:58.821860 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e21d7-21ca-4ae8-9833-4665cac52497 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '768c71ab4ab241e4bfed9f7561ae3d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:58.822499 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e21d7-21ca-4ae8-9833-4665cac52497 service swift] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:58.822774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e21d7-21ca-4ae8-9833-4665cac52497 service swift] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:58.823042 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e21d7-21ca-4ae8-9833-4665cac52497 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:58.836328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e21d7-21ca-4ae8-9833-4665cac52497 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:58.839729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e21d7-21ca-4ae8-9833-4665cac52497 service swift] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:58.856857 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1063/2112] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 24 13:15:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:16:00.775895 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339783b-4adf-4437-9092-2fe4788b5929 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:16:00.776453 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339783b-4adf-4437-9092-2fe4788b5929 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:16:00.776453 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339783b-4adf-4437-9092-2fe4788b5929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:16:00.800976 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-b339783b-4adf-4437-9092-2fe4788b5929 None None] MFA Rules not processed for user `297eccc7c02443e8bd2b98cfaad3b1fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:16:00.802192 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b339783b-4adf-4437-9092-2fe4788b5929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:16:00.886741 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1050/2113] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:16:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:16:08.852156 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=32 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:10.875968 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=50 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:12.481039 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e21d7-21ca-4ae8-9833-4665cac52497 service swift] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:16:12.492648 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e21d7-21ca-4ae8-9833-4665cac52497 service swift] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:16:12.497216 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22139d02-1f82-47f8-adf7-460618f5f4c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:16:12.498606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22139d02-1f82-47f8-adf7-460618f5f4c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:16:12.498997 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22139d02-1f82-47f8-adf7-460618f5f4c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:16:12.499561 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22139d02-1f82-47f8-adf7-460618f5f4c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:16:12.501884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-22139d02-1f82-47f8-adf7-460618f5f4c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:16:12.592876 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22139d02-1f82-47f8-adf7-460618f5f4c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:16:12.594422 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22139d02-1f82-47f8-adf7-460618f5f4c6 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:16:12.605615 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1064/2114] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:16:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:16:14.974883 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b5f3a-6c42-40f9-99ad-c92d80169ba7 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:16:14.975635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b5f3a-6c42-40f9-99ad-c92d80169ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:16:14.975913 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b5f3a-6c42-40f9-99ad-c92d80169ba7 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:16:14.978149 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1051/2115] 10.222.0.18 () {54 vars in 961 bytes} [Mon Oct 24 13:16:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:16:14.988490 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed501bf0-d1df-47de-b6fa-4d2746faae1b None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:16:14.989967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed501bf0-d1df-47de-b6fa-4d2746faae1b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:16:14.990625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed501bf0-d1df-47de-b6fa-4d2746faae1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:16:15.034414 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-ed501bf0-d1df-47de-b6fa-4d2746faae1b None None] MFA Rules not processed for user `60b3ca8694ab4a169a3c36561290d8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:16:15.035687 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ed501bf0-d1df-47de-b6fa-4d2746faae1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:16:15.106595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1065/2116] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Oct 24 13:16:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:16:15.116122 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b5f3a-6c42-40f9-99ad-c92d80169ba7 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:16:15.133616 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b5f3a-6c42-40f9-99ad-c92d80169ba7 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:16:15.140757 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195da36c-3b35-467d-ba55-1b115c8a2ad9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b3ca8694ab4a169a3c36561290d8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:16:15.142629 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195da36c-3b35-467d-ba55-1b115c8a2ad9 service placement] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:16:15.143082 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195da36c-3b35-467d-ba55-1b115c8a2ad9 service placement] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:16:15.143356 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195da36c-3b35-467d-ba55-1b115c8a2ad9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:16:15.145907 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-195da36c-3b35-467d-ba55-1b115c8a2ad9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:16:15.159078 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195da36c-3b35-467d-ba55-1b115c8a2ad9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:16:15.161161 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195da36c-3b35-467d-ba55-1b115c8a2ad9 service placement] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:16:15.173548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1052/2117] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:16:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:16:18.176288 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a9c37-0305-4de1-9fee-c009265d3cea None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:16:18.176739 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a9c37-0305-4de1-9fee-c009265d3cea None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:16:18.176849 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a9c37-0305-4de1-9fee-c009265d3cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:16:18.196936 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d93a9c37-0305-4de1-9fee-c009265d3cea None None] MFA Rules not processed for user `f3254b4fddaa4f099c6c44f4c139ee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:16:18.198064 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d93a9c37-0305-4de1-9fee-c009265d3cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:16:18.205039 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1066/2118] 10.222.0.18 () {58 vars in 967 bytes} [Mon Oct 24 13:16:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:16:18.218590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195da36c-3b35-467d-ba55-1b115c8a2ad9 service placement] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:16:18.230064 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195da36c-3b35-467d-ba55-1b115c8a2ad9 service placement] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:16:18.235389 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e12599-b27e-463c-9972-a24aa2168482 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '768c71ab4ab241e4bfed9f7561ae3d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:16:18.235943 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e12599-b27e-463c-9972-a24aa2168482 service swift] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:16:18.236214 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e12599-b27e-463c-9972-a24aa2168482 service swift] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:16:18.236479 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e12599-b27e-463c-9972-a24aa2168482 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:16:18.245126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e12599-b27e-463c-9972-a24aa2168482 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:16:18.246705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e12599-b27e-463c-9972-a24aa2168482 service swift] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:16:18.255081 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1053/2119] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 24 13:16:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:16:24.652967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cebd3b-acc5-445b-a1db-dbb285471f58 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:16:24.653407 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cebd3b-acc5-445b-a1db-dbb285471f58 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:16:24.653505 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cebd3b-acc5-445b-a1db-dbb285471f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:16:24.672755 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-41cebd3b-acc5-445b-a1db-dbb285471f58 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:16:24.673932 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-41cebd3b-acc5-445b-a1db-dbb285471f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:16:24.731501 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1067/2120] 10.222.0.39 () {58 vars in 1016 bytes} [Mon Oct 24 13:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:16:24.750247 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e12599-b27e-463c-9972-a24aa2168482 service swift] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:16:24.751665 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-25e12599-b27e-463c-9972-a24aa2168482 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:16:24.767026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e12599-b27e-463c-9972-a24aa2168482 service swift] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:16:24.772297 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b8576-3ad0-4c69-bbe5-d11710f99d4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:16:24.772933 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b8576-3ad0-4c69-bbe5-d11710f99d4c service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:16:24.773721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b8576-3ad0-4c69-bbe5-d11710f99d4c service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:16:24.774027 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b8576-3ad0-4c69-bbe5-d11710f99d4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:16:24.781918 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b8576-3ad0-4c69-bbe5-d11710f99d4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:16:24.783498 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b8576-3ad0-4c69-bbe5-d11710f99d4c service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:16:24.793096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1054/2121] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:16:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:16:27.940594 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a1777-b6c5-45f6-82af-4fc49e2f8526 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:16:27.941152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a1777-b6c5-45f6-82af-4fc49e2f8526 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:16:27.941152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a1777-b6c5-45f6-82af-4fc49e2f8526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:16:27.960257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-259a1777-b6c5-45f6-82af-4fc49e2f8526 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:16:27.962155 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-259a1777-b6c5-45f6-82af-4fc49e2f8526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:16:27.970469 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1068/2122] 10.222.0.39 () {58 vars in 1016 bytes} [Mon Oct 24 13:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:16:27.985437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b8576-3ad0-4c69-bbe5-d11710f99d4c service nova] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:16:27.986876 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-883b8576-3ad0-4c69-bbe5-d11710f99d4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:16:28.001404 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b8576-3ad0-4c69-bbe5-d11710f99d4c service nova] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:16:28.006822 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96254d-4cee-4a47-961c-1283ee38adc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:16:28.007576 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96254d-4cee-4a47-961c-1283ee38adc9 service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:16:28.007871 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96254d-4cee-4a47-961c-1283ee38adc9 service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:16:28.008138 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96254d-4cee-4a47-961c-1283ee38adc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:16:28.016590 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96254d-4cee-4a47-961c-1283ee38adc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:16:28.018176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96254d-4cee-4a47-961c-1283ee38adc9 service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:16:28.028545 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1055/2123] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:16:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:16:31.013472 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042cb7b-b097-458a-b095-ac93801ab5f5 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:16:31.013990 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042cb7b-b097-458a-b095-ac93801ab5f5 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:16:31.013990 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042cb7b-b097-458a-b095-ac93801ab5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:16:31.032974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-e042cb7b-b097-458a-b095-ac93801ab5f5 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:16:31.034154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e042cb7b-b097-458a-b095-ac93801ab5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:16:31.043185 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1069/2124] 10.222.0.39 () {58 vars in 1016 bytes} [Mon Oct 24 13:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:16:31.057433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96254d-4cee-4a47-961c-1283ee38adc9 service nova] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:16:31.068671 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96254d-4cee-4a47-961c-1283ee38adc9 service nova] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:16:31.074176 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082e513-4bc0-47b2-84e4-8318f51a3774 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:16:31.074770 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082e513-4bc0-47b2-84e4-8318f51a3774 service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:16:31.075032 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082e513-4bc0-47b2-84e4-8318f51a3774 service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:16:31.075299 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082e513-4bc0-47b2-84e4-8318f51a3774 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:16:31.083694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082e513-4bc0-47b2-84e4-8318f51a3774 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:16:31.086027 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082e513-4bc0-47b2-84e4-8318f51a3774 service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:16:31.096705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1056/2125] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:16:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:16:34.189173 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f88832-ec3f-41a2-9dc4-910452a605fb None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:16:34.189709 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f88832-ec3f-41a2-9dc4-910452a605fb None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:16:34.189709 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f88832-ec3f-41a2-9dc4-910452a605fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:16:34.210664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b1f88832-ec3f-41a2-9dc4-910452a605fb None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:16:34.211972 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b1f88832-ec3f-41a2-9dc4-910452a605fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:16:34.219819 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1070/2126] 10.222.0.39 () {58 vars in 1016 bytes} [Mon Oct 24 13:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:16:34.235056 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082e513-4bc0-47b2-84e4-8318f51a3774 service nova] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:16:34.246835 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082e513-4bc0-47b2-84e4-8318f51a3774 service nova] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:16:34.252351 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccafb7-48a3-498d-8d41-dc1a61fc7fae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:16:34.252937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccafb7-48a3-498d-8d41-dc1a61fc7fae service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:16:34.253211 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccafb7-48a3-498d-8d41-dc1a61fc7fae service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:16:34.253477 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccafb7-48a3-498d-8d41-dc1a61fc7fae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:16:34.262608 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccafb7-48a3-498d-8d41-dc1a61fc7fae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:16:34.264321 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccafb7-48a3-498d-8d41-dc1a61fc7fae service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:16:34.274337 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1057/2127] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:16:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:16:37.338764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54327db8-b991-4f83-84ff-b0ec1be720b9 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:16:37.339269 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54327db8-b991-4f83-84ff-b0ec1be720b9 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:16:37.339370 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54327db8-b991-4f83-84ff-b0ec1be720b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:16:37.347977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:37.360125 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-54327db8-b991-4f83-84ff-b0ec1be720b9 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:16:37.361315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-54327db8-b991-4f83-84ff-b0ec1be720b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:16:37.369354 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1071/2128] 10.222.0.39 () {58 vars in 1016 bytes} [Mon Oct 24 13:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:16:37.384261 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccafb7-48a3-498d-8d41-dc1a61fc7fae service nova] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:16:37.395134 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccafb7-48a3-498d-8d41-dc1a61fc7fae service nova] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:16:37.401247 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cada2-fe6b-438d-be6c-374e550dc638 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:16:37.401822 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cada2-fe6b-438d-be6c-374e550dc638 service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:16:37.402096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cada2-fe6b-438d-be6c-374e550dc638 service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:16:37.402359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cada2-fe6b-438d-be6c-374e550dc638 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:16:37.410171 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2cada2-fe6b-438d-be6c-374e550dc638 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:16:37.411772 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2cada2-fe6b-438d-be6c-374e550dc638 service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:16:37.421535 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1058/2129] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:16:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:16:47.356577 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:47.417270 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=42 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:08.702051 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54327db8-b991-4f83-84ff-b0ec1be720b9 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:08.703565 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-54327db8-b991-4f83-84ff-b0ec1be720b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:08.718180 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54327db8-b991-4f83-84ff-b0ec1be720b9 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:08.722667 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b0f1d-5a97-4b77-8607-53a363e07925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:08.723345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b0f1d-5a97-4b77-8607-53a363e07925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:08.723649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b0f1d-5a97-4b77-8607-53a363e07925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:08.723913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b0f1d-5a97-4b77-8607-53a363e07925 admin admin] PATH_INFO: `/v3/users/297eccc7c02443e8bd2b98cfaad3b1fc` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:08.725028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b0f1d-5a97-4b77-8607-53a363e07925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=297eccc7c02443e8bd2b98cfaad3b1fc)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:08.727174 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b0f1d-5a97-4b77-8607-53a363e07925 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:08.773098 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c80b0f1d-5a97-4b77-8607-53a363e07925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '297eccc7c02443e8bd2b98cfaad3b1fc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:08.779942 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c80b0f1d-5a97-4b77-8607-53a363e07925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '297eccc7c02443e8bd2b98cfaad3b1fc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:08.792388 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c80b0f1d-5a97-4b77-8607-53a363e07925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '297eccc7c02443e8bd2b98cfaad3b1fc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:08.800845 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c80b0f1d-5a97-4b77-8607-53a363e07925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '297eccc7c02443e8bd2b98cfaad3b1fc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:08.801521 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c80b0f1d-5a97-4b77-8607-53a363e07925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '297eccc7c02443e8bd2b98cfaad3b1fc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:08.808447 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1072/2130] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:17:08 2022] DELETE /identity/v3/users/297eccc7c02443e8bd2b98cfaad3b1fc => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:08.986126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cada2-fe6b-438d-be6c-374e550dc638 service nova] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:08.998468 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cada2-fe6b-438d-be6c-374e550dc638 service nova] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:09.061495 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243421b-c0c0-4900-bcd5-9ca853244cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:09.062232 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243421b-c0c0-4900-bcd5-9ca853244cbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:09.062514 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243421b-c0c0-4900-bcd5-9ca853244cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:09.062842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243421b-c0c0-4900-bcd5-9ca853244cbc admin admin] PATH_INFO: `/v3/projects/b19ca135ce804b4dbe2717308cc9497a` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:09.064018 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243421b-c0c0-4900-bcd5-9ca853244cbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b19ca135ce804b4dbe2717308cc9497a)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:09.066077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243421b-c0c0-4900-bcd5-9ca853244cbc admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:09.129159 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-3243421b-c0c0-4900-bcd5-9ca853244cbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b19ca135ce804b4dbe2717308cc9497a', 'request_id': 'req-3243421b-c0c0-4900-bcd5-9ca853244cbc'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:09.139139 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-3243421b-c0c0-4900-bcd5-9ca853244cbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b19ca135ce804b4dbe2717308cc9497a', 'request_id': 'req-3243421b-c0c0-4900-bcd5-9ca853244cbc'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:09.146206 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-3243421b-c0c0-4900-bcd5-9ca853244cbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b19ca135ce804b4dbe2717308cc9497a', 'request_id': 'req-3243421b-c0c0-4900-bcd5-9ca853244cbc'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:09.158638 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-3243421b-c0c0-4900-bcd5-9ca853244cbc admin admin] The token cache is being invalidate because project b19ca135ce804b4dbe2717308cc9497a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:17:09.158923 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-3243421b-c0c0-4900-bcd5-9ca853244cbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:09.159611 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-3243421b-c0c0-4900-bcd5-9ca853244cbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:09.161080 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1059/2131] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:17:08 2022] DELETE /identity/v3/projects/b19ca135ce804b4dbe2717308cc9497a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:16.064583 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28c544-9f55-45bf-a7a7-50cb4f72a673 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:16.065465 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28c544-9f55-45bf-a7a7-50cb4f72a673 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:16.065906 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28c544-9f55-45bf-a7a7-50cb4f72a673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:16.095262 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-dd28c544-9f55-45bf-a7a7-50cb4f72a673 None None] MFA Rules not processed for user `a2ed22a974be4cfd86108df0b98c4d50`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:16.096943 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-dd28c544-9f55-45bf-a7a7-50cb4f72a673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:16.161685 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1073/2132] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:17:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:17.506267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a213b6-ed0e-444b-b46d-22f140784cce None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:17.506746 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a213b6-ed0e-444b-b46d-22f140784cce None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:17.506841 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a213b6-ed0e-444b-b46d-22f140784cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:17.526080 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-f3a213b6-ed0e-444b-b46d-22f140784cce None None] MFA Rules not processed for user `2716cf78afb84caf866acd4d5526168c`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:17.527273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f3a213b6-ed0e-444b-b46d-22f140784cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:17.582969 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1060/2133] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:17:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:26.152419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:27.576027 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:36.015839 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541262d-cebd-4f63-9c53-fb559e8231f2 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:36.016308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541262d-cebd-4f63-9c53-fb559e8231f2 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:36.016406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541262d-cebd-4f63-9c53-fb559e8231f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:36.035953 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-a541262d-cebd-4f63-9c53-fb559e8231f2 None None] MFA Rules not processed for user `f3254b4fddaa4f099c6c44f4c139ee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:36.037130 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a541262d-cebd-4f63-9c53-fb559e8231f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:36.092553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1074/2134] 10.222.0.18 () {58 vars in 967 bytes} [Mon Oct 24 13:17:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:36.140390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a213b6-ed0e-444b-b46d-22f140784cce None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:36.141771 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f3a213b6-ed0e-444b-b46d-22f140784cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:36.209816 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a213b6-ed0e-444b-b46d-22f140784cce None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:36.215488 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a531fd-83d2-4318-817c-7c3e775ddffb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '768c71ab4ab241e4bfed9f7561ae3d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:36.216079 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a531fd-83d2-4318-817c-7c3e775ddffb service swift] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:36.216357 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a531fd-83d2-4318-817c-7c3e775ddffb service swift] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:36.216622 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a531fd-83d2-4318-817c-7c3e775ddffb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:36.224550 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a531fd-83d2-4318-817c-7c3e775ddffb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:36.226140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a531fd-83d2-4318-817c-7c3e775ddffb service swift] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:36.234333 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1061/2135] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 24 13:17:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:17:44.500773 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541262d-cebd-4f63-9c53-fb559e8231f2 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:44.502453 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a541262d-cebd-4f63-9c53-fb559e8231f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:44.579334 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541262d-cebd-4f63-9c53-fb559e8231f2 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:44.583774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6ffc7-c251-4616-829e-36cfb8edfe53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:44.584398 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6ffc7-c251-4616-829e-36cfb8edfe53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:44.584700 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6ffc7-c251-4616-829e-36cfb8edfe53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:44.584992 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6ffc7-c251-4616-829e-36cfb8edfe53 admin admin] PATH_INFO: `/v3/users/51d25a1883184a93b9ca8a99b367c229` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:44.586276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6ffc7-c251-4616-829e-36cfb8edfe53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d25a1883184a93b9ca8a99b367c229)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:44.589263 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6ffc7-c251-4616-829e-36cfb8edfe53 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:44.645190 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-edc6ffc7-c251-4616-829e-36cfb8edfe53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d25a1883184a93b9ca8a99b367c229'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:44.652723 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-edc6ffc7-c251-4616-829e-36cfb8edfe53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d25a1883184a93b9ca8a99b367c229'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:44.665179 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-edc6ffc7-c251-4616-829e-36cfb8edfe53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d25a1883184a93b9ca8a99b367c229'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:44.674351 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-edc6ffc7-c251-4616-829e-36cfb8edfe53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d25a1883184a93b9ca8a99b367c229'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:44.675207 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-edc6ffc7-c251-4616-829e-36cfb8edfe53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d25a1883184a93b9ca8a99b367c229'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:44.686687 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1075/2136] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:17:44 2022] DELETE /identity/v3/users/51d25a1883184a93b9ca8a99b367c229 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:17:45.251127 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a531fd-83d2-4318-817c-7c3e775ddffb service swift] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:45.261841 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a531fd-83d2-4318-817c-7c3e775ddffb service swift] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:45.332714 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f500b-0c37-4fef-ad89-e95d7fb62024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:45.333322 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f500b-0c37-4fef-ad89-e95d7fb62024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:45.333595 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f500b-0c37-4fef-ad89-e95d7fb62024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:45.333860 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f500b-0c37-4fef-ad89-e95d7fb62024 admin admin] PATH_INFO: `/v3/projects/b9d0c931b559407091b3d76929caf55a` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:45.334955 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f500b-0c37-4fef-ad89-e95d7fb62024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9d0c931b559407091b3d76929caf55a)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:45.336897 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f500b-0c37-4fef-ad89-e95d7fb62024 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:45.387926 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c92f500b-0c37-4fef-ad89-e95d7fb62024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9d0c931b559407091b3d76929caf55a', 'request_id': 'req-c92f500b-0c37-4fef-ad89-e95d7fb62024'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:45.396863 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c92f500b-0c37-4fef-ad89-e95d7fb62024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9d0c931b559407091b3d76929caf55a', 'request_id': 'req-c92f500b-0c37-4fef-ad89-e95d7fb62024'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:45.404049 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c92f500b-0c37-4fef-ad89-e95d7fb62024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9d0c931b559407091b3d76929caf55a', 'request_id': 'req-c92f500b-0c37-4fef-ad89-e95d7fb62024'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:45.416073 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c92f500b-0c37-4fef-ad89-e95d7fb62024 admin admin] The token cache is being invalidate because project b9d0c931b559407091b3d76929caf55a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:17:45.416361 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c92f500b-0c37-4fef-ad89-e95d7fb62024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:45.417015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c92f500b-0c37-4fef-ad89-e95d7fb62024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:45.417549 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98214344-0c76-4d59-ac4f-51c4016c2252 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:45.417822 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98214344-0c76-4d59-ac4f-51c4016c2252 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:45.418094 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98214344-0c76-4d59-ac4f-51c4016c2252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:45.418495 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1062/2137] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:17:45 2022] DELETE /identity/v3/projects/b9d0c931b559407091b3d76929caf55a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:45.422143 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f500b-0c37-4fef-ad89-e95d7fb62024 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:45.424014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-c92f500b-0c37-4fef-ad89-e95d7fb62024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:45.437984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-98214344-0c76-4d59-ac4f-51c4016c2252 None None] MFA Rules not processed for user `3b52c3ae1fff462899aa156fe978b03b`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:45.439158 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-98214344-0c76-4d59-ac4f-51c4016c2252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:45.446059 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:45.458910 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:45.493093 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f500b-0c37-4fef-ad89-e95d7fb62024 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:45.498376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21083a5a-ee3f-41e6-af85-496423af96e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:45.498991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21083a5a-ee3f-41e6-af85-496423af96e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:45.499277 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21083a5a-ee3f-41e6-af85-496423af96e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:45.499555 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21083a5a-ee3f-41e6-af85-496423af96e6 admin admin] PATH_INFO: `/v3/users/6c07ba7394f94a11afff691b4723bb60` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:45.500669 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21083a5a-ee3f-41e6-af85-496423af96e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c07ba7394f94a11afff691b4723bb60)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:45.500850 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1076/2138] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:17:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:17:45.502668 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21083a5a-ee3f-41e6-af85-496423af96e6 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:45.551957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-21083a5a-ee3f-41e6-af85-496423af96e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c07ba7394f94a11afff691b4723bb60'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:45.562559 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-21083a5a-ee3f-41e6-af85-496423af96e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c07ba7394f94a11afff691b4723bb60'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:45.570090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-21083a5a-ee3f-41e6-af85-496423af96e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c07ba7394f94a11afff691b4723bb60'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:45.582530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-21083a5a-ee3f-41e6-af85-496423af96e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c07ba7394f94a11afff691b4723bb60'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:45.583307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-21083a5a-ee3f-41e6-af85-496423af96e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c07ba7394f94a11afff691b4723bb60'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:45.591456 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1063/2139] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:17:45 2022] DELETE /identity/v3/users/6c07ba7394f94a11afff691b4723bb60 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:17:45.803085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98214344-0c76-4d59-ac4f-51c4016c2252 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:45.819047 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98214344-0c76-4d59-ac4f-51c4016c2252 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:45.888624 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56229443-0410-4d63-97b8-b3d7f7eea439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:45.889264 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56229443-0410-4d63-97b8-b3d7f7eea439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:45.889541 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56229443-0410-4d63-97b8-b3d7f7eea439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:45.889815 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56229443-0410-4d63-97b8-b3d7f7eea439 admin admin] PATH_INFO: `/v3/projects/45d981f6df3d4fef91a11ecdeaeb89d9` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:45.890926 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56229443-0410-4d63-97b8-b3d7f7eea439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d981f6df3d4fef91a11ecdeaeb89d9)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:45.892889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56229443-0410-4d63-97b8-b3d7f7eea439 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:45.942096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-56229443-0410-4d63-97b8-b3d7f7eea439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d981f6df3d4fef91a11ecdeaeb89d9', 'request_id': 'req-56229443-0410-4d63-97b8-b3d7f7eea439'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:45.949335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-56229443-0410-4d63-97b8-b3d7f7eea439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d981f6df3d4fef91a11ecdeaeb89d9', 'request_id': 'req-56229443-0410-4d63-97b8-b3d7f7eea439'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:45.954967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-56229443-0410-4d63-97b8-b3d7f7eea439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d981f6df3d4fef91a11ecdeaeb89d9', 'request_id': 'req-56229443-0410-4d63-97b8-b3d7f7eea439'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:45.967486 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-56229443-0410-4d63-97b8-b3d7f7eea439 admin admin] The token cache is being invalidate because project 45d981f6df3d4fef91a11ecdeaeb89d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:17:45.967780 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-56229443-0410-4d63-97b8-b3d7f7eea439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:45.968467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-56229443-0410-4d63-97b8-b3d7f7eea439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:45.969966 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1077/2140] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:17:45 2022] DELETE /identity/v3/projects/45d981f6df3d4fef91a11ecdeaeb89d9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:55.585774 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=44,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:55.964334 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=65,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:08.955085 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21083a5a-ee3f-41e6-af85-496423af96e6 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:08.956420 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-21083a5a-ee3f-41e6-af85-496423af96e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:09.013683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21083a5a-ee3f-41e6-af85-496423af96e6 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:09.061714 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c000ada-d337-42cb-b420-674df61e7f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:09.062305 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c000ada-d337-42cb-b420-674df61e7f6f service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:09.062583 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c000ada-d337-42cb-b420-674df61e7f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:09.062857 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c000ada-d337-42cb-b420-674df61e7f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:09.064576 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-3c000ada-d337-42cb-b420-674df61e7f6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:09.133334 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c000ada-d337-42cb-b420-674df61e7f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:09.134769 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c000ada-d337-42cb-b420-674df61e7f6f service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:09.145914 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1064/2141] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:09.710262 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56229443-0410-4d63-97b8-b3d7f7eea439 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:09.711704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-56229443-0410-4d63-97b8-b3d7f7eea439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:09.769330 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56229443-0410-4d63-97b8-b3d7f7eea439 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:09.773051 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194fa619-8672-497d-b4cb-4ce8728f4e68 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0866de4d4e46d5b26719faf385d7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:09.773671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fa619-8672-497d-b4cb-4ce8728f4e68 service glance] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:09.773947 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fa619-8672-497d-b4cb-4ce8728f4e68 service glance] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:09.774215 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fa619-8672-497d-b4cb-4ce8728f4e68 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:09.775933 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-194fa619-8672-497d-b4cb-4ce8728f4e68 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:09.790345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194fa619-8672-497d-b4cb-4ce8728f4e68 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:09.791838 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194fa619-8672-497d-b4cb-4ce8728f4e68 service glance] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:09.803483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1078/2142] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:13.851798 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c000ada-d337-42cb-b420-674df61e7f6f service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:13.853253 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-3c000ada-d337-42cb-b420-674df61e7f6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:13.864410 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c000ada-d337-42cb-b420-674df61e7f6f service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:13.867899 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3ce78-d0c2-4eef-8466-299bff3c987a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:13.868478 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3ce78-d0c2-4eef-8466-299bff3c987a service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:13.868751 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3ce78-d0c2-4eef-8466-299bff3c987a service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:13.869019 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3ce78-d0c2-4eef-8466-299bff3c987a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:13.870638 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b7b3ce78-d0c2-4eef-8466-299bff3c987a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:13.923324 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:13.935109 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3ce78-d0c2-4eef-8466-299bff3c987a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:13.937164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3ce78-d0c2-4eef-8466-299bff3c987a service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:13.946572 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1065/2143] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:15.900504 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194fa619-8672-497d-b4cb-4ce8728f4e68 service glance] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:15.902105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-194fa619-8672-497d-b4cb-4ce8728f4e68 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:15.921894 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194fa619-8672-497d-b4cb-4ce8728f4e68 service glance] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:15.928138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237c185-88f0-4329-8368-fcd08c6beb0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:15.929052 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237c185-88f0-4329-8368-fcd08c6beb0f service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:15.929500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237c185-88f0-4329-8368-fcd08c6beb0f service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:15.929965 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237c185-88f0-4329-8368-fcd08c6beb0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:15.932239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4237c185-88f0-4329-8368-fcd08c6beb0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:16.009210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237c185-88f0-4329-8368-fcd08c6beb0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:16.011149 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237c185-88f0-4329-8368-fcd08c6beb0f service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:16.023325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1079/2144] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:17.775959 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3ce78-d0c2-4eef-8466-299bff3c987a service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:17.777517 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b7b3ce78-d0c2-4eef-8466-299bff3c987a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:17.791129 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3ce78-d0c2-4eef-8466-299bff3c987a service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:17.796997 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66569953-1595-40d1-bb35-db3a55821d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:17.797624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66569953-1595-40d1-bb35-db3a55821d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:17.797902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66569953-1595-40d1-bb35-db3a55821d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:17.798177 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66569953-1595-40d1-bb35-db3a55821d7d admin admin] PATH_INFO: `/v3/users/a2ed22a974be4cfd86108df0b98c4d50` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:17.799296 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66569953-1595-40d1-bb35-db3a55821d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2ed22a974be4cfd86108df0b98c4d50)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:17.801256 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66569953-1595-40d1-bb35-db3a55821d7d admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:17.854769 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-66569953-1595-40d1-bb35-db3a55821d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2ed22a974be4cfd86108df0b98c4d50'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:17.862822 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-66569953-1595-40d1-bb35-db3a55821d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2ed22a974be4cfd86108df0b98c4d50'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:17.871452 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-66569953-1595-40d1-bb35-db3a55821d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2ed22a974be4cfd86108df0b98c4d50'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:17.886381 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-66569953-1595-40d1-bb35-db3a55821d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2ed22a974be4cfd86108df0b98c4d50'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:17.887106 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-66569953-1595-40d1-bb35-db3a55821d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2ed22a974be4cfd86108df0b98c4d50'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:17.893354 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1066/2145] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:17 2022] DELETE /identity/v3/users/a2ed22a974be4cfd86108df0b98c4d50 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:18.059646 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237c185-88f0-4329-8368-fcd08c6beb0f service nova] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:18.073352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237c185-88f0-4329-8368-fcd08c6beb0f service nova] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:18.130289 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa3ec5-92f6-436b-82e4-aee58ef03ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:18.130919 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa3ec5-92f6-436b-82e4-aee58ef03ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:18.131199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa3ec5-92f6-436b-82e4-aee58ef03ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:18.131497 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa3ec5-92f6-436b-82e4-aee58ef03ccb admin admin] PATH_INFO: `/v3/projects/ff77096b3088490fb52dd53991e18336` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:18.132600 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa3ec5-92f6-436b-82e4-aee58ef03ccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff77096b3088490fb52dd53991e18336)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:18.134552 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa3ec5-92f6-436b-82e4-aee58ef03ccb admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:18.176885 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:18.181932 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c5fa3ec5-92f6-436b-82e4-aee58ef03ccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff77096b3088490fb52dd53991e18336', 'request_id': 'req-c5fa3ec5-92f6-436b-82e4-aee58ef03ccb'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:18.189601 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c5fa3ec5-92f6-436b-82e4-aee58ef03ccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff77096b3088490fb52dd53991e18336', 'request_id': 'req-c5fa3ec5-92f6-436b-82e4-aee58ef03ccb'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:18.194980 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c5fa3ec5-92f6-436b-82e4-aee58ef03ccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff77096b3088490fb52dd53991e18336', 'request_id': 'req-c5fa3ec5-92f6-436b-82e4-aee58ef03ccb'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:18.206480 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c5fa3ec5-92f6-436b-82e4-aee58ef03ccb admin admin] The token cache is being invalidate because project ff77096b3088490fb52dd53991e18336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:18.206765 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c5fa3ec5-92f6-436b-82e4-aee58ef03ccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:18.207394 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c5fa3ec5-92f6-436b-82e4-aee58ef03ccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:18.208955 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1080/2146] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:18 2022] DELETE /identity/v3/projects/ff77096b3088490fb52dd53991e18336 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:18.214088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adceef78-c1f3-41c9-9a11-08bdf5ba73e7 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:18.214367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adceef78-c1f3-41c9-9a11-08bdf5ba73e7 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:18.214634 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adceef78-c1f3-41c9-9a11-08bdf5ba73e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:18.234014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-adceef78-c1f3-41c9-9a11-08bdf5ba73e7 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:18.235215 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-adceef78-c1f3-41c9-9a11-08bdf5ba73e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:18.292713 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1067/2147] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:18.300770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045dfa7d-e518-4d20-a924-0093553017e3 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:18.301056 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045dfa7d-e518-4d20-a924-0093553017e3 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:18.301331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045dfa7d-e518-4d20-a924-0093553017e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:18.321444 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-045dfa7d-e518-4d20-a924-0093553017e3 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:18.322644 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-045dfa7d-e518-4d20-a924-0093553017e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:18.331089 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1081/2148] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:18.335235 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adceef78-c1f3-41c9-9a11-08bdf5ba73e7 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:18.345014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adceef78-c1f3-41c9-9a11-08bdf5ba73e7 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:18.349585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49392aa3-e3ad-46e7-a632-09921b050b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:18.350175 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49392aa3-e3ad-46e7-a632-09921b050b60 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:18.350456 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49392aa3-e3ad-46e7-a632-09921b050b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:18.350726 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49392aa3-e3ad-46e7-a632-09921b050b60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:18.351374 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49392aa3-e3ad-46e7-a632-09921b050b60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:18:18.351703 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49392aa3-e3ad-46e7-a632-09921b050b60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:18.353301 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49392aa3-e3ad-46e7-a632-09921b050b60 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:18.365463 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1068/2149] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:18:18.369818 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045dfa7d-e518-4d20-a924-0093553017e3 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:18.380377 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045dfa7d-e518-4d20-a924-0093553017e3 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:18.385228 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee0106-efee-4c20-a248-b363ec439c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:18.385942 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee0106-efee-4c20-a248-b363ec439c77 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:18.386405 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee0106-efee-4c20-a248-b363ec439c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:18.386969 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee0106-efee-4c20-a248-b363ec439c77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:18.387644 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee0106-efee-4c20-a248-b363ec439c77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:18.389584 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee0106-efee-4c20-a248-b363ec439c77 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:18.417061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1082/2150] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:18 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:18.421774 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49392aa3-e3ad-46e7-a632-09921b050b60 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:18.431397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49392aa3-e3ad-46e7-a632-09921b050b60 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:18.477064 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:18.489433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4217d-e584-451a-beae-3c2cc56116c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:18.490028 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4217d-e584-451a-beae-3c2cc56116c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:18.490304 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4217d-e584-451a-beae-3c2cc56116c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:18.490575 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4217d-e584-451a-beae-3c2cc56116c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:18.491218 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4217d-e584-451a-beae-3c2cc56116c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:18.493184 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4217d-e584-451a-beae-3c2cc56116c2 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:18.514976 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1069/2151] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:18 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:18.519117 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee0106-efee-4c20-a248-b363ec439c77 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:18.530039 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee0106-efee-4c20-a248-b363ec439c77 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:18.534705 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d80c2-05d2-4780-aab4-a9c43952e5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:18.535303 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d80c2-05d2-4780-aab4-a9c43952e5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:18.535611 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d80c2-05d2-4780-aab4-a9c43952e5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:18.535893 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d80c2-05d2-4780-aab4-a9c43952e5c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:18.536530 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d80c2-05d2-4780-aab4-a9c43952e5c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:18.538127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d80c2-05d2-4780-aab4-a9c43952e5c8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:18.548435 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1083/2152] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:18.552353 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4217d-e584-451a-beae-3c2cc56116c2 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:18.562569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4217d-e584-451a-beae-3c2cc56116c2 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:18.567144 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192288e1-e19d-416c-8a5d-dc58f791d3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:18.567766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192288e1-e19d-416c-8a5d-dc58f791d3af admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:18.568044 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192288e1-e19d-416c-8a5d-dc58f791d3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:18.568310 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192288e1-e19d-416c-8a5d-dc58f791d3af admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:18.568943 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192288e1-e19d-416c-8a5d-dc58f791d3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:18.570528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192288e1-e19d-416c-8a5d-dc58f791d3af admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:18.583396 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1070/2153] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:18.587723 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d80c2-05d2-4780-aab4-a9c43952e5c8 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:18.598701 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d80c2-05d2-4780-aab4-a9c43952e5c8 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:18.603655 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f3cf7-d88f-4647-a5e4-c7f212a76111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:18.604312 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f3cf7-d88f-4647-a5e4-c7f212a76111 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:18.604601 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f3cf7-d88f-4647-a5e4-c7f212a76111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:18.604912 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f3cf7-d88f-4647-a5e4-c7f212a76111 admin admin] PATH_INFO: `/v3/projects/7415c60884634a60947380e5226e1649/users/69d1f2c8cfd440ffabe040caf5179430/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:18.620516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f3cf7-d88f-4647-a5e4-c7f212a76111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7415c60884634a60947380e5226e1649, user_id=69d1f2c8cfd440ffabe040caf5179430, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:18.624061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f3cf7-d88f-4647-a5e4-c7f212a76111 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:18.639616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1084/2154] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:18 2022] PUT /identity/v3/projects/7415c60884634a60947380e5226e1649/users/69d1f2c8cfd440ffabe040caf5179430/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:18.651044 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf0a2a-123b-4db3-8b77-c4835d0389a6 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:18.651326 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf0a2a-123b-4db3-8b77-c4835d0389a6 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:18.651625 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf0a2a-123b-4db3-8b77-c4835d0389a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:18.686868 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-4eaf0a2a-123b-4db3-8b77-c4835d0389a6 None None] MFA Rules not processed for user `69d1f2c8cfd440ffabe040caf5179430`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:18.688114 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-4eaf0a2a-123b-4db3-8b77-c4835d0389a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:18.768505 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1071/2155] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:18.772981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f3cf7-d88f-4647-a5e4-c7f212a76111 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:18.839575 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f3cf7-d88f-4647-a5e4-c7f212a76111 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:18.844735 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6f791-a5f1-4931-8591-02aa22d22ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:18.845328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6f791-a5f1-4931-8591-02aa22d22ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:18.845603 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6f791-a5f1-4931-8591-02aa22d22ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:18.845872 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6f791-a5f1-4931-8591-02aa22d22ab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:18.846491 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6f791-a5f1-4931-8591-02aa22d22ab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:18.848419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6f791-a5f1-4931-8591-02aa22d22ab4 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:18.877910 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1085/2156] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:18 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:18.879147 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf0a2a-123b-4db3-8b77-c4835d0389a6 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:18.889841 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf0a2a-123b-4db3-8b77-c4835d0389a6 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:18.945452 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558292a-cc88-4ec9-b2fa-1dab50504f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:18.946051 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558292a-cc88-4ec9-b2fa-1dab50504f10 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:18.946325 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558292a-cc88-4ec9-b2fa-1dab50504f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:18.946593 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558292a-cc88-4ec9-b2fa-1dab50504f10 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:18.947205 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558292a-cc88-4ec9-b2fa-1dab50504f10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:18.949164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558292a-cc88-4ec9-b2fa-1dab50504f10 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:18.970576 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1072/2157] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:18 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:18:18.974729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6f791-a5f1-4931-8591-02aa22d22ab4 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:18.985542 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6f791-a5f1-4931-8591-02aa22d22ab4 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:18.990167 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80db36-d9e1-4730-891b-b4a2ba84eb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:18.990758 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80db36-d9e1-4730-891b-b4a2ba84eb8c admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:18.991036 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80db36-d9e1-4730-891b-b4a2ba84eb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:18.991308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80db36-d9e1-4730-891b-b4a2ba84eb8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:18.991981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80db36-d9e1-4730-891b-b4a2ba84eb8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:18.993690 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80db36-d9e1-4730-891b-b4a2ba84eb8c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:19.004389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1086/2158] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:19.008666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558292a-cc88-4ec9-b2fa-1dab50504f10 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:19.018956 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558292a-cc88-4ec9-b2fa-1dab50504f10 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:19.023534 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc81d5-0f50-43c1-8f44-fbc743c7e8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:19.024175 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc81d5-0f50-43c1-8f44-fbc743c7e8b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:19.024446 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc81d5-0f50-43c1-8f44-fbc743c7e8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:19.024709 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc81d5-0f50-43c1-8f44-fbc743c7e8b9 admin admin] PATH_INFO: `/v3/projects/683f14b36b0d4d5c97be3153f7938e46/users/c31feca200f54dc681a73ec5afe31682/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:19.039489 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc81d5-0f50-43c1-8f44-fbc743c7e8b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=683f14b36b0d4d5c97be3153f7938e46, user_id=c31feca200f54dc681a73ec5afe31682, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:19.042125 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc81d5-0f50-43c1-8f44-fbc743c7e8b9 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:19.056747 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1073/2159] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:19 2022] PUT /identity/v3/projects/683f14b36b0d4d5c97be3153f7938e46/users/c31feca200f54dc681a73ec5afe31682/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:19.060787 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80db36-d9e1-4730-891b-b4a2ba84eb8c admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:19.070819 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80db36-d9e1-4730-891b-b4a2ba84eb8c admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:19.110868 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:19.129200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b1512-e479-48b8-90e2-d7255d5234d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:19.129799 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b1512-e479-48b8-90e2-d7255d5234d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:19.130077 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b1512-e479-48b8-90e2-d7255d5234d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:19.130349 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b1512-e479-48b8-90e2-d7255d5234d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:19.130979 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b1512-e479-48b8-90e2-d7255d5234d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:19.132623 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b1512-e479-48b8-90e2-d7255d5234d3 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:19.142824 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1087/2160] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:19.147119 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc81d5-0f50-43c1-8f44-fbc743c7e8b9 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:19.157928 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc81d5-0f50-43c1-8f44-fbc743c7e8b9 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:19.162688 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3dd39-94f8-4d8a-b17b-181b9f69317e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:19.163362 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3dd39-94f8-4d8a-b17b-181b9f69317e admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:19.163675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3dd39-94f8-4d8a-b17b-181b9f69317e admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:19.163948 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3dd39-94f8-4d8a-b17b-181b9f69317e admin admin] PATH_INFO: `/v3/projects/683f14b36b0d4d5c97be3153f7938e46/users/c31feca200f54dc681a73ec5afe31682/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:19.165884 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3dd39-94f8-4d8a-b17b-181b9f69317e admin admin] RBAC: Authorizing `identity:create_grant(project_id=683f14b36b0d4d5c97be3153f7938e46, user_id=c31feca200f54dc681a73ec5afe31682, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:19.168695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3dd39-94f8-4d8a-b17b-181b9f69317e admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:19.179543 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1074/2161] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:19 2022] PUT /identity/v3/projects/683f14b36b0d4d5c97be3153f7938e46/users/c31feca200f54dc681a73ec5afe31682/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:19.190732 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a010a34-bc2c-4069-84ec-fa176f58f43a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:19.191014 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a010a34-bc2c-4069-84ec-fa176f58f43a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:19.191284 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a010a34-bc2c-4069-84ec-fa176f58f43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:19.219215 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-6a010a34-bc2c-4069-84ec-fa176f58f43a None None] MFA Rules not processed for user `c31feca200f54dc681a73ec5afe31682`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:19.220606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6a010a34-bc2c-4069-84ec-fa176f58f43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:19.286841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1088/2162] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:19.299212 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3dd39-94f8-4d8a-b17b-181b9f69317e admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:19.300919 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-9eb3dd39-94f8-4d8a-b17b-181b9f69317e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:19.315281 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:19.360483 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3dd39-94f8-4d8a-b17b-181b9f69317e admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:19.364048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ebeaa-badc-4188-9f3c-75accf3fc410 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:19.364637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ebeaa-badc-4188-9f3c-75accf3fc410 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:19.364909 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ebeaa-badc-4188-9f3c-75accf3fc410 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:19.365174 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ebeaa-badc-4188-9f3c-75accf3fc410 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:19.373899 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ebeaa-badc-4188-9f3c-75accf3fc410 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:19.375316 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ebeaa-badc-4188-9f3c-75accf3fc410 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:19.384621 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1075/2163] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:19.459085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a010a34-bc2c-4069-84ec-fa176f58f43a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:19.469592 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a010a34-bc2c-4069-84ec-fa176f58f43a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:19.473212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b917077-f584-456a-a2c9-d6fa9273bd0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:19.473805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b917077-f584-456a-a2c9-d6fa9273bd0f service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:19.474085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b917077-f584-456a-a2c9-d6fa9273bd0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:19.474358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b917077-f584-456a-a2c9-d6fa9273bd0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:19.530789 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b917077-f584-456a-a2c9-d6fa9273bd0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:19.532254 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b917077-f584-456a-a2c9-d6fa9273bd0f service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:19.541198 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1089/2164] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:25.496386 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ebeaa-badc-4188-9f3c-75accf3fc410 service cinder] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:25.558520 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ebeaa-badc-4188-9f3c-75accf3fc410 service cinder] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:25.563022 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6c9e2-13c5-44e3-8c58-f454d3a08e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:25.563698 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6c9e2-13c5-44e3-8c58-f454d3a08e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:25.563977 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6c9e2-13c5-44e3-8c58-f454d3a08e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:25.564249 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6c9e2-13c5-44e3-8c58-f454d3a08e69 admin admin] PATH_INFO: `/v3/users/69d1f2c8cfd440ffabe040caf5179430` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:25.565360 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6c9e2-13c5-44e3-8c58-f454d3a08e69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69d1f2c8cfd440ffabe040caf5179430)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:25.567287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6c9e2-13c5-44e3-8c58-f454d3a08e69 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:25.618306 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-38a6c9e2-13c5-44e3-8c58-f454d3a08e69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69d1f2c8cfd440ffabe040caf5179430'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:25.625775 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-38a6c9e2-13c5-44e3-8c58-f454d3a08e69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69d1f2c8cfd440ffabe040caf5179430'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:25.632291 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-38a6c9e2-13c5-44e3-8c58-f454d3a08e69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69d1f2c8cfd440ffabe040caf5179430'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:25.644817 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-38a6c9e2-13c5-44e3-8c58-f454d3a08e69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69d1f2c8cfd440ffabe040caf5179430'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:25.645443 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-38a6c9e2-13c5-44e3-8c58-f454d3a08e69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69d1f2c8cfd440ffabe040caf5179430'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:25.651133 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1076/2165] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:25 2022] DELETE /identity/v3/users/69d1f2c8cfd440ffabe040caf5179430 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:18:25.656303 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abe9a6-19b0-4eec-a2d6-151ae3943ece None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:25.656764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abe9a6-19b0-4eec-a2d6-151ae3943ece None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:25.656922 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abe9a6-19b0-4eec-a2d6-151ae3943ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:25.675394 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d8abe9a6-19b0-4eec-a2d6-151ae3943ece None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:25.676602 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d8abe9a6-19b0-4eec-a2d6-151ae3943ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:25.734739 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1090/2166] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:18:25.746237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6c9e2-13c5-44e3-8c58-f454d3a08e69 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:25.748279 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-38a6c9e2-13c5-44e3-8c58-f454d3a08e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:25.785918 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:25.809255 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6c9e2-13c5-44e3-8c58-f454d3a08e69 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:25.813709 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccacbcb6-1421-411d-bd82-83d6fefc393f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:25.814317 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacbcb6-1421-411d-bd82-83d6fefc393f service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:25.814593 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacbcb6-1421-411d-bd82-83d6fefc393f service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:25.814862 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacbcb6-1421-411d-bd82-83d6fefc393f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:25.824000 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccacbcb6-1421-411d-bd82-83d6fefc393f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:25.825440 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccacbcb6-1421-411d-bd82-83d6fefc393f service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:25.836285 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1077/2167] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:26.097680 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abe9a6-19b0-4eec-a2d6-151ae3943ece None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:26.099102 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d8abe9a6-19b0-4eec-a2d6-151ae3943ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:26.106149 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:26.112136 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abe9a6-19b0-4eec-a2d6-151ae3943ece None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:26.116784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9b394-dde0-42c4-9929-ed195a79a293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:26.117539 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9b394-dde0-42c4-9929-ed195a79a293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:26.117885 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9b394-dde0-42c4-9929-ed195a79a293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:26.118229 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9b394-dde0-42c4-9929-ed195a79a293 admin admin] PATH_INFO: `/v3/projects/7415c60884634a60947380e5226e1649` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:26.119339 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9b394-dde0-42c4-9929-ed195a79a293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7415c60884634a60947380e5226e1649)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:26.121287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9b394-dde0-42c4-9929-ed195a79a293 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:26.171046 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-4ec9b394-dde0-42c4-9929-ed195a79a293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7415c60884634a60947380e5226e1649', 'request_id': 'req-4ec9b394-dde0-42c4-9929-ed195a79a293'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:26.181475 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-4ec9b394-dde0-42c4-9929-ed195a79a293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7415c60884634a60947380e5226e1649', 'request_id': 'req-4ec9b394-dde0-42c4-9929-ed195a79a293'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:26.187868 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-4ec9b394-dde0-42c4-9929-ed195a79a293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7415c60884634a60947380e5226e1649', 'request_id': 'req-4ec9b394-dde0-42c4-9929-ed195a79a293'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:26.198774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-4ec9b394-dde0-42c4-9929-ed195a79a293 admin admin] The token cache is being invalidate because project 7415c60884634a60947380e5226e1649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:26.199059 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-4ec9b394-dde0-42c4-9929-ed195a79a293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:26.199714 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-4ec9b394-dde0-42c4-9929-ed195a79a293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:26.201368 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1091/2168] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:26 2022] DELETE /identity/v3/projects/7415c60884634a60947380e5226e1649 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:26.205468 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccacbcb6-1421-411d-bd82-83d6fefc393f service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:26.215191 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccacbcb6-1421-411d-bd82-83d6fefc393f service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:26.271496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec847c-a13b-4501-b940-c5225d4b3831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:26.272117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec847c-a13b-4501-b940-c5225d4b3831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:26.272394 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec847c-a13b-4501-b940-c5225d4b3831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:26.272666 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec847c-a13b-4501-b940-c5225d4b3831 admin admin] PATH_INFO: `/v3/users/c31feca200f54dc681a73ec5afe31682` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:26.273789 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec847c-a13b-4501-b940-c5225d4b3831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c31feca200f54dc681a73ec5afe31682)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:26.275764 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec847c-a13b-4501-b940-c5225d4b3831 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:26.321360 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-d0ec847c-a13b-4501-b940-c5225d4b3831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c31feca200f54dc681a73ec5afe31682'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:26.329175 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-d0ec847c-a13b-4501-b940-c5225d4b3831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c31feca200f54dc681a73ec5afe31682'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:26.338429 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-d0ec847c-a13b-4501-b940-c5225d4b3831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c31feca200f54dc681a73ec5afe31682'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:26.351596 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-d0ec847c-a13b-4501-b940-c5225d4b3831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c31feca200f54dc681a73ec5afe31682'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:26.352190 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-d0ec847c-a13b-4501-b940-c5225d4b3831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c31feca200f54dc681a73ec5afe31682'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:26.359673 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1078/2169] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:26 2022] DELETE /identity/v3/users/c31feca200f54dc681a73ec5afe31682 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:26.645237 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9b394-dde0-42c4-9929-ed195a79a293 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:26.646741 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4ec9b394-dde0-42c4-9929-ed195a79a293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:26.661622 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9b394-dde0-42c4-9929-ed195a79a293 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:26.725023 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac916e95-1972-4336-a317-08db87830618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:26.725649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac916e95-1972-4336-a317-08db87830618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:26.725927 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac916e95-1972-4336-a317-08db87830618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:26.726222 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac916e95-1972-4336-a317-08db87830618 admin admin] PATH_INFO: `/v3/projects/683f14b36b0d4d5c97be3153f7938e46` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:26.727319 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac916e95-1972-4336-a317-08db87830618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=683f14b36b0d4d5c97be3153f7938e46)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:26.729250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac916e95-1972-4336-a317-08db87830618 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:26.775195 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ac916e95-1972-4336-a317-08db87830618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '683f14b36b0d4d5c97be3153f7938e46', 'request_id': 'req-ac916e95-1972-4336-a317-08db87830618'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:26.783079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ac916e95-1972-4336-a317-08db87830618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '683f14b36b0d4d5c97be3153f7938e46', 'request_id': 'req-ac916e95-1972-4336-a317-08db87830618'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:26.788426 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ac916e95-1972-4336-a317-08db87830618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '683f14b36b0d4d5c97be3153f7938e46', 'request_id': 'req-ac916e95-1972-4336-a317-08db87830618'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:26.799738 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ac916e95-1972-4336-a317-08db87830618 admin admin] The token cache is being invalidate because project 683f14b36b0d4d5c97be3153f7938e46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:26.800020 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ac916e95-1972-4336-a317-08db87830618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:26.800632 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ac916e95-1972-4336-a317-08db87830618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:26.802340 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1092/2170] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:26 2022] DELETE /identity/v3/projects/683f14b36b0d4d5c97be3153f7938e46 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:26.807295 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d0259-2684-4485-9f81-4beac0970df7 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:26.807806 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d0259-2684-4485-9f81-4beac0970df7 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:26.807902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d0259-2684-4485-9f81-4beac0970df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:26.828772 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-a94d0259-2684-4485-9f81-4beac0970df7 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:26.829944 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-a94d0259-2684-4485-9f81-4beac0970df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:26.877822 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:26.892447 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1079/2171] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:26.900271 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96660913-d947-4d38-ab63-ecb6c3b92707 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:26.900636 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96660913-d947-4d38-ab63-ecb6c3b92707 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:26.900971 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96660913-d947-4d38-ab63-ecb6c3b92707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:26.922915 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-96660913-d947-4d38-ab63-ecb6c3b92707 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:26.924329 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-96660913-d947-4d38-ab63-ecb6c3b92707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:26.932245 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1093/2172] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:26.937253 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d0259-2684-4485-9f81-4beac0970df7 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:26.946764 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d0259-2684-4485-9f81-4beac0970df7 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:26.951850 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd6c25-30a3-4023-93ac-dcf40ab2a67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:26.952437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd6c25-30a3-4023-93ac-dcf40ab2a67f admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:26.952710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd6c25-30a3-4023-93ac-dcf40ab2a67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:26.952976 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd6c25-30a3-4023-93ac-dcf40ab2a67f admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:26.953609 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd6c25-30a3-4023-93ac-dcf40ab2a67f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:18:26.953902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd6c25-30a3-4023-93ac-dcf40ab2a67f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:26.955521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd6c25-30a3-4023-93ac-dcf40ab2a67f admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:26.968450 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1080/2173] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:18:26.972974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96660913-d947-4d38-ab63-ecb6c3b92707 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:26.982816 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96660913-d947-4d38-ab63-ecb6c3b92707 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:26.987446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25cf681-af3a-49e1-9342-4140bd5adbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:26.988172 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cf681-af3a-49e1-9342-4140bd5adbba admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:26.988448 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cf681-af3a-49e1-9342-4140bd5adbba admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:26.988714 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cf681-af3a-49e1-9342-4140bd5adbba admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:26.989338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25cf681-af3a-49e1-9342-4140bd5adbba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:26.991259 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25cf681-af3a-49e1-9342-4140bd5adbba admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:26.996728 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:27.025154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1094/2174] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:26 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:18:27.026695 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd6c25-30a3-4023-93ac-dcf40ab2a67f admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:27.037437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd6c25-30a3-4023-93ac-dcf40ab2a67f admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:27.095959 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe1fe0-8321-47bb-bda8-1ed7d7bdb96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:27.096593 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe1fe0-8321-47bb-bda8-1ed7d7bdb96d admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:27.096982 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe1fe0-8321-47bb-bda8-1ed7d7bdb96d admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:27.097325 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe1fe0-8321-47bb-bda8-1ed7d7bdb96d admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:27.097966 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe1fe0-8321-47bb-bda8-1ed7d7bdb96d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:27.099919 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe1fe0-8321-47bb-bda8-1ed7d7bdb96d admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:27.120749 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1081/2175] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:27 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:18:27.125685 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25cf681-af3a-49e1-9342-4140bd5adbba admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:27.136064 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25cf681-af3a-49e1-9342-4140bd5adbba admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:27.141321 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311de81-4ef0-4e4d-825a-66de5799ab26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:27.141842 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311de81-4ef0-4e4d-825a-66de5799ab26 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:27.142120 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311de81-4ef0-4e4d-825a-66de5799ab26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:27.142392 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311de81-4ef0-4e4d-825a-66de5799ab26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:27.143029 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311de81-4ef0-4e4d-825a-66de5799ab26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:27.144671 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311de81-4ef0-4e4d-825a-66de5799ab26 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:27.154931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1095/2176] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:27.158797 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe1fe0-8321-47bb-bda8-1ed7d7bdb96d admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:27.168640 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe1fe0-8321-47bb-bda8-1ed7d7bdb96d admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:27.174357 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc45025-a903-4bc4-a0cd-32a0883dad50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:27.174943 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc45025-a903-4bc4-a0cd-32a0883dad50 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:27.175228 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc45025-a903-4bc4-a0cd-32a0883dad50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:27.175534 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc45025-a903-4bc4-a0cd-32a0883dad50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:27.176172 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc45025-a903-4bc4-a0cd-32a0883dad50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:27.177770 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc45025-a903-4bc4-a0cd-32a0883dad50 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:27.188976 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1082/2177] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:27.192640 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311de81-4ef0-4e4d-825a-66de5799ab26 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:27.203258 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311de81-4ef0-4e4d-825a-66de5799ab26 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:27.208178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34f5c7-3f07-4a4c-b584-c925ca0ea163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:27.208966 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34f5c7-3f07-4a4c-b584-c925ca0ea163 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:27.209325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34f5c7-3f07-4a4c-b584-c925ca0ea163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:27.209655 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34f5c7-3f07-4a4c-b584-c925ca0ea163 admin admin] PATH_INFO: `/v3/projects/099a751aa40e4948b0d01c26ed583559/users/360a1a36d0f44e70a95a28ed9c4b68ec/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:27.227653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34f5c7-3f07-4a4c-b584-c925ca0ea163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=099a751aa40e4948b0d01c26ed583559, user_id=360a1a36d0f44e70a95a28ed9c4b68ec, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:27.230375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34f5c7-3f07-4a4c-b584-c925ca0ea163 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:27.243927 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1096/2178] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:27 2022] PUT /identity/v3/projects/099a751aa40e4948b0d01c26ed583559/users/360a1a36d0f44e70a95a28ed9c4b68ec/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:27.255569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfba66a-bdce-4967-a549-449438ade73f None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:27.255853 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfba66a-bdce-4967-a549-449438ade73f None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:27.256124 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfba66a-bdce-4967-a549-449438ade73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:27.284055 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-7dfba66a-bdce-4967-a549-449438ade73f None None] MFA Rules not processed for user `360a1a36d0f44e70a95a28ed9c4b68ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:27.285252 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-7dfba66a-bdce-4967-a549-449438ade73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:27.349143 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1083/2179] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:27.353611 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34f5c7-3f07-4a4c-b584-c925ca0ea163 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:27.414727 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34f5c7-3f07-4a4c-b584-c925ca0ea163 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:27.419289 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8505bf9-3b04-47bf-8cfb-cd4ac9f5f972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:27.420043 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8505bf9-3b04-47bf-8cfb-cd4ac9f5f972 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:27.420321 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8505bf9-3b04-47bf-8cfb-cd4ac9f5f972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:27.420593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8505bf9-3b04-47bf-8cfb-cd4ac9f5f972 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:27.421228 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8505bf9-3b04-47bf-8cfb-cd4ac9f5f972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:27.423136 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8505bf9-3b04-47bf-8cfb-cd4ac9f5f972 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:27.448580 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1097/2180] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:27 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:18:27.453211 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfba66a-bdce-4967-a549-449438ade73f None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:27.464210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfba66a-bdce-4967-a549-449438ade73f None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:27.511669 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:27.524256 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581725a-4a64-4bfa-a6a4-096de1b1bd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:27.524857 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581725a-4a64-4bfa-a6a4-096de1b1bd8f admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:27.525133 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581725a-4a64-4bfa-a6a4-096de1b1bd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:27.525400 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581725a-4a64-4bfa-a6a4-096de1b1bd8f admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:27.526020 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581725a-4a64-4bfa-a6a4-096de1b1bd8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:27.528008 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581725a-4a64-4bfa-a6a4-096de1b1bd8f admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:27.557390 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1084/2181] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:27 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:27.558618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8505bf9-3b04-47bf-8cfb-cd4ac9f5f972 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:27.568991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8505bf9-3b04-47bf-8cfb-cd4ac9f5f972 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:27.573670 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c1959-a1ac-436a-8c68-a9a86e40f5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:27.574273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c1959-a1ac-436a-8c68-a9a86e40f5fe admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:27.574558 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c1959-a1ac-436a-8c68-a9a86e40f5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:27.574830 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c1959-a1ac-436a-8c68-a9a86e40f5fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:27.575486 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c1959-a1ac-436a-8c68-a9a86e40f5fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:27.577735 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c1959-a1ac-436a-8c68-a9a86e40f5fe admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:27.589966 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1098/2182] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:27.594759 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581725a-4a64-4bfa-a6a4-096de1b1bd8f admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:27.604627 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581725a-4a64-4bfa-a6a4-096de1b1bd8f admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:27.609889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfaeb1-65ad-49cb-b4dd-07e397a23296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:27.610534 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfaeb1-65ad-49cb-b4dd-07e397a23296 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:27.610805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfaeb1-65ad-49cb-b4dd-07e397a23296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:27.611070 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfaeb1-65ad-49cb-b4dd-07e397a23296 admin admin] PATH_INFO: `/v3/projects/8d0a1c6054104c7580ecb1af950230b2/users/8dac60ec0e0b44a683475592d334347a/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:27.628319 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfaeb1-65ad-49cb-b4dd-07e397a23296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d0a1c6054104c7580ecb1af950230b2, user_id=8dac60ec0e0b44a683475592d334347a, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:27.631059 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfaeb1-65ad-49cb-b4dd-07e397a23296 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:27.645286 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1085/2183] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:27 2022] PUT /identity/v3/projects/8d0a1c6054104c7580ecb1af950230b2/users/8dac60ec0e0b44a683475592d334347a/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:27.649039 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c1959-a1ac-436a-8c68-a9a86e40f5fe admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:27.658968 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c1959-a1ac-436a-8c68-a9a86e40f5fe admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:27.715223 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c316c4f-0988-4f71-b536-0e47aeac093e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:27.715900 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c316c4f-0988-4f71-b536-0e47aeac093e admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:27.716111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c316c4f-0988-4f71-b536-0e47aeac093e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:27.716962 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c316c4f-0988-4f71-b536-0e47aeac093e admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:27.717572 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c316c4f-0988-4f71-b536-0e47aeac093e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:27.719146 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c316c4f-0988-4f71-b536-0e47aeac093e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:27.728542 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1099/2184] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:27.733106 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfaeb1-65ad-49cb-b4dd-07e397a23296 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:27.743404 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfaeb1-65ad-49cb-b4dd-07e397a23296 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:27.748494 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fec98-39a3-4402-b610-5efd4187a00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:27.749130 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fec98-39a3-4402-b610-5efd4187a00e admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:27.749408 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fec98-39a3-4402-b610-5efd4187a00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:27.749675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fec98-39a3-4402-b610-5efd4187a00e admin admin] PATH_INFO: `/v3/projects/8d0a1c6054104c7580ecb1af950230b2/users/8dac60ec0e0b44a683475592d334347a/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:27.751595 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8fec98-39a3-4402-b610-5efd4187a00e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d0a1c6054104c7580ecb1af950230b2, user_id=8dac60ec0e0b44a683475592d334347a, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:27.754248 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8fec98-39a3-4402-b610-5efd4187a00e admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:27.765028 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1086/2185] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:27 2022] PUT /identity/v3/projects/8d0a1c6054104c7580ecb1af950230b2/users/8dac60ec0e0b44a683475592d334347a/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:27.775291 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778075c2-7e77-431d-a654-83c25b554dbf None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:27.775673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778075c2-7e77-431d-a654-83c25b554dbf None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:27.776013 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778075c2-7e77-431d-a654-83c25b554dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:27.804547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-778075c2-7e77-431d-a654-83c25b554dbf None None] MFA Rules not processed for user `8dac60ec0e0b44a683475592d334347a`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:27.805737 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-778075c2-7e77-431d-a654-83c25b554dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:27.815648 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:27.875813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1100/2186] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:27.887090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fec98-39a3-4402-b610-5efd4187a00e admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:27.889396 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-2f8fec98-39a3-4402-b610-5efd4187a00e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:27.945964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fec98-39a3-4402-b610-5efd4187a00e admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:27.949584 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2389e-f379-4bc2-a7d9-8fc10e95237a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:27.950208 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2389e-f379-4bc2-a7d9-8fc10e95237a service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:27.950480 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2389e-f379-4bc2-a7d9-8fc10e95237a service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:27.951357 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2389e-f379-4bc2-a7d9-8fc10e95237a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:28.005971 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2389e-f379-4bc2-a7d9-8fc10e95237a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:28.007403 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2389e-f379-4bc2-a7d9-8fc10e95237a service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:28.016633 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1087/2187] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:29.414258 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778075c2-7e77-431d-a654-83c25b554dbf None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:29.416009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-778075c2-7e77-431d-a654-83c25b554dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:29.429822 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778075c2-7e77-431d-a654-83c25b554dbf None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:29.434072 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b17b67-90fe-4d7c-a599-b1c862e1420b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:29.434825 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b17b67-90fe-4d7c-a599-b1c862e1420b service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:29.435167 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b17b67-90fe-4d7c-a599-b1c862e1420b service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:29.435550 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b17b67-90fe-4d7c-a599-b1c862e1420b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:29.445565 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b17b67-90fe-4d7c-a599-b1c862e1420b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:29.447011 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b17b67-90fe-4d7c-a599-b1c862e1420b service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:29.457756 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1101/2188] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:29 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:29.943657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14469fb6-2abb-4396-9e47-37f998515a8d None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:29.944225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14469fb6-2abb-4396-9e47-37f998515a8d None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:29.944337 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14469fb6-2abb-4396-9e47-37f998515a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:29.970009 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-14469fb6-2abb-4396-9e47-37f998515a8d None None] MFA Rules not processed for user `f3254b4fddaa4f099c6c44f4c139ee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:29.971577 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-14469fb6-2abb-4396-9e47-37f998515a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:30.055851 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1088/2189] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 24 13:18:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:30.068430 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b17b67-90fe-4d7c-a599-b1c862e1420b service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:30.069795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a3b17b67-90fe-4d7c-a599-b1c862e1420b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:30.140586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b17b67-90fe-4d7c-a599-b1c862e1420b service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:30.145602 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348026ef-b11b-46fd-9ddd-05c79767a463 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '768c71ab4ab241e4bfed9f7561ae3d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:30.146213 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348026ef-b11b-46fd-9ddd-05c79767a463 service swift] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:30.146489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348026ef-b11b-46fd-9ddd-05c79767a463 service swift] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:30.146762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348026ef-b11b-46fd-9ddd-05c79767a463 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:30.154715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348026ef-b11b-46fd-9ddd-05c79767a463 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:30.156795 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348026ef-b11b-46fd-9ddd-05c79767a463 service swift] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:30.164916 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1102/2190] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 24 13:18:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:18:33.523047 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14469fb6-2abb-4396-9e47-37f998515a8d None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:33.527400 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:33.607706 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14469fb6-2abb-4396-9e47-37f998515a8d None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:33.613368 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7559b-f714-4a50-914f-41400ed91823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:33.614129 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7559b-f714-4a50-914f-41400ed91823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:33.614404 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7559b-f714-4a50-914f-41400ed91823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:33.614667 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7559b-f714-4a50-914f-41400ed91823 admin admin] PATH_INFO: `/v3/users/360a1a36d0f44e70a95a28ed9c4b68ec` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:33.615819 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7559b-f714-4a50-914f-41400ed91823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=360a1a36d0f44e70a95a28ed9c4b68ec)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:33.617744 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7559b-f714-4a50-914f-41400ed91823 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:33.699442 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-bae7559b-f714-4a50-914f-41400ed91823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '360a1a36d0f44e70a95a28ed9c4b68ec'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:33.716122 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-bae7559b-f714-4a50-914f-41400ed91823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '360a1a36d0f44e70a95a28ed9c4b68ec'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:33.726493 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-bae7559b-f714-4a50-914f-41400ed91823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '360a1a36d0f44e70a95a28ed9c4b68ec'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:33.756624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-bae7559b-f714-4a50-914f-41400ed91823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '360a1a36d0f44e70a95a28ed9c4b68ec'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:33.758943 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-bae7559b-f714-4a50-914f-41400ed91823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '360a1a36d0f44e70a95a28ed9c4b68ec'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:33.767663 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1089/2191] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:33 2022] DELETE /identity/v3/users/360a1a36d0f44e70a95a28ed9c4b68ec => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:33.771217 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79429edb-5df5-4224-a45b-09c380edb2ba None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:33.772390 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79429edb-5df5-4224-a45b-09c380edb2ba None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:33.772390 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79429edb-5df5-4224-a45b-09c380edb2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:33.803490 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-79429edb-5df5-4224-a45b-09c380edb2ba None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:33.805647 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-79429edb-5df5-4224-a45b-09c380edb2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:33.887592 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1103/2192] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:33.901491 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7559b-f714-4a50-914f-41400ed91823 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:33.904161 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-bae7559b-f714-4a50-914f-41400ed91823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:33.976602 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7559b-f714-4a50-914f-41400ed91823 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:33.980684 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92d00d-1f73-44f5-8557-fb4809cd177a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:33.981393 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92d00d-1f73-44f5-8557-fb4809cd177a service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:33.981916 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92d00d-1f73-44f5-8557-fb4809cd177a service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:33.982278 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92d00d-1f73-44f5-8557-fb4809cd177a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:33.994330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92d00d-1f73-44f5-8557-fb4809cd177a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:33.995987 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92d00d-1f73-44f5-8557-fb4809cd177a service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:34.006931 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1090/2193] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:34.423722 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79429edb-5df5-4224-a45b-09c380edb2ba None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:34.425219 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-79429edb-5df5-4224-a45b-09c380edb2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:34.465398 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79429edb-5df5-4224-a45b-09c380edb2ba None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:34.471205 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c744f7-4b32-441b-bd27-d2da00268dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:34.471991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c744f7-4b32-441b-bd27-d2da00268dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:34.472337 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c744f7-4b32-441b-bd27-d2da00268dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:34.472687 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c744f7-4b32-441b-bd27-d2da00268dfe admin admin] PATH_INFO: `/v3/projects/099a751aa40e4948b0d01c26ed583559` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:34.473886 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c744f7-4b32-441b-bd27-d2da00268dfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=099a751aa40e4948b0d01c26ed583559)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:34.476011 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c744f7-4b32-441b-bd27-d2da00268dfe admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:34.502277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:34.553902 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-76c744f7-4b32-441b-bd27-d2da00268dfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '099a751aa40e4948b0d01c26ed583559', 'request_id': 'req-76c744f7-4b32-441b-bd27-d2da00268dfe'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:34.567859 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-76c744f7-4b32-441b-bd27-d2da00268dfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '099a751aa40e4948b0d01c26ed583559', 'request_id': 'req-76c744f7-4b32-441b-bd27-d2da00268dfe'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:34.575720 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-76c744f7-4b32-441b-bd27-d2da00268dfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '099a751aa40e4948b0d01c26ed583559', 'request_id': 'req-76c744f7-4b32-441b-bd27-d2da00268dfe'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:34.593643 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-76c744f7-4b32-441b-bd27-d2da00268dfe admin admin] The token cache is being invalidate because project 099a751aa40e4948b0d01c26ed583559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:34.594579 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-76c744f7-4b32-441b-bd27-d2da00268dfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:34.595401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-76c744f7-4b32-441b-bd27-d2da00268dfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:34.599999 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1104/2194] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:34 2022] DELETE /identity/v3/projects/099a751aa40e4948b0d01c26ed583559 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:34.601219 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92d00d-1f73-44f5-8557-fb4809cd177a service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:34.615905 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92d00d-1f73-44f5-8557-fb4809cd177a service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:34.643823 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:34.694127 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01720a-d395-4f6a-9362-1d2230980b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:34.695101 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01720a-d395-4f6a-9362-1d2230980b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:34.695380 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01720a-d395-4f6a-9362-1d2230980b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:34.695682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01720a-d395-4f6a-9362-1d2230980b1a admin admin] PATH_INFO: `/v3/users/8dac60ec0e0b44a683475592d334347a` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:34.697023 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01720a-d395-4f6a-9362-1d2230980b1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dac60ec0e0b44a683475592d334347a)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:34.698956 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01720a-d395-4f6a-9362-1d2230980b1a admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:34.756348 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-bc01720a-d395-4f6a-9362-1d2230980b1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dac60ec0e0b44a683475592d334347a'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:34.768320 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-bc01720a-d395-4f6a-9362-1d2230980b1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dac60ec0e0b44a683475592d334347a'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:34.782194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-bc01720a-d395-4f6a-9362-1d2230980b1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dac60ec0e0b44a683475592d334347a'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:34.798210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-bc01720a-d395-4f6a-9362-1d2230980b1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dac60ec0e0b44a683475592d334347a'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:34.798919 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-bc01720a-d395-4f6a-9362-1d2230980b1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dac60ec0e0b44a683475592d334347a'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:34.807517 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1091/2195] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:34 2022] DELETE /identity/v3/users/8dac60ec0e0b44a683475592d334347a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:35.298986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c744f7-4b32-441b-bd27-d2da00268dfe admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:35.300739 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-76c744f7-4b32-441b-bd27-d2da00268dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:35.349113 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c744f7-4b32-441b-bd27-d2da00268dfe admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:35.419463 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915e88c-3963-4b13-8765-a41ab6b79601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:35.420049 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915e88c-3963-4b13-8765-a41ab6b79601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:35.420368 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915e88c-3963-4b13-8765-a41ab6b79601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:35.420732 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915e88c-3963-4b13-8765-a41ab6b79601 admin admin] PATH_INFO: `/v3/projects/8d0a1c6054104c7580ecb1af950230b2` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:35.422639 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915e88c-3963-4b13-8765-a41ab6b79601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d0a1c6054104c7580ecb1af950230b2)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:35.424828 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915e88c-3963-4b13-8765-a41ab6b79601 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:35.523481 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a915e88c-3963-4b13-8765-a41ab6b79601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d0a1c6054104c7580ecb1af950230b2', 'request_id': 'req-a915e88c-3963-4b13-8765-a41ab6b79601'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:35.539077 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a915e88c-3963-4b13-8765-a41ab6b79601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d0a1c6054104c7580ecb1af950230b2', 'request_id': 'req-a915e88c-3963-4b13-8765-a41ab6b79601'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:35.551456 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a915e88c-3963-4b13-8765-a41ab6b79601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d0a1c6054104c7580ecb1af950230b2', 'request_id': 'req-a915e88c-3963-4b13-8765-a41ab6b79601'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:35.571106 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a915e88c-3963-4b13-8765-a41ab6b79601 admin admin] The token cache is being invalidate because project 8d0a1c6054104c7580ecb1af950230b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:35.571396 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a915e88c-3963-4b13-8765-a41ab6b79601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:35.572187 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a915e88c-3963-4b13-8765-a41ab6b79601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:35.579071 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1105/2196] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:35 2022] DELETE /identity/v3/projects/8d0a1c6054104c7580ecb1af950230b2 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:35.580817 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a98eb-3aee-4195-a3a0-d705cb360e40 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:35.581109 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a98eb-3aee-4195-a3a0-d705cb360e40 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:35.581373 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a98eb-3aee-4195-a3a0-d705cb360e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:35.629187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-b18a98eb-3aee-4195-a3a0-d705cb360e40 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:35.630989 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b18a98eb-3aee-4195-a3a0-d705cb360e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:35.710368 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1092/2197] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:18:35.718607 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5467ab5-df5d-474e-8027-71a106693a9f None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:35.718897 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5467ab5-df5d-474e-8027-71a106693a9f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:35.719180 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5467ab5-df5d-474e-8027-71a106693a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:35.741023 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-e5467ab5-df5d-474e-8027-71a106693a9f None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:35.742354 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e5467ab5-df5d-474e-8027-71a106693a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:35.758272 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1106/2198] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:35.760119 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a98eb-3aee-4195-a3a0-d705cb360e40 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:35.773459 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a98eb-3aee-4195-a3a0-d705cb360e40 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:35.780737 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae388e2d-cb27-480d-9d01-75471494a282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:35.781344 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae388e2d-cb27-480d-9d01-75471494a282 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:35.781623 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae388e2d-cb27-480d-9d01-75471494a282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:35.781872 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae388e2d-cb27-480d-9d01-75471494a282 admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:35.782636 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae388e2d-cb27-480d-9d01-75471494a282 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:18:35.782939 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae388e2d-cb27-480d-9d01-75471494a282 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:35.787453 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae388e2d-cb27-480d-9d01-75471494a282 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:35.802284 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1093/2199] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:18:35.807000 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5467ab5-df5d-474e-8027-71a106693a9f None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:35.818360 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5467ab5-df5d-474e-8027-71a106693a9f None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:35.824808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f34a0d-75be-4f8e-93c5-b7b60197c84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:35.825529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f34a0d-75be-4f8e-93c5-b7b60197c84c admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:35.825878 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f34a0d-75be-4f8e-93c5-b7b60197c84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:35.826233 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f34a0d-75be-4f8e-93c5-b7b60197c84c admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:35.827196 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f34a0d-75be-4f8e-93c5-b7b60197c84c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:35.829752 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f34a0d-75be-4f8e-93c5-b7b60197c84c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:35.873251 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1107/2200] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:35 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:35.874903 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae388e2d-cb27-480d-9d01-75471494a282 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:35.898879 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae388e2d-cb27-480d-9d01-75471494a282 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:35.935232 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:35.975508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728b02d-9033-4144-aa84-2ca7d8cf341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:35.976413 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728b02d-9033-4144-aa84-2ca7d8cf341a admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:35.976548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728b02d-9033-4144-aa84-2ca7d8cf341a admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:35.979478 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728b02d-9033-4144-aa84-2ca7d8cf341a admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:35.979478 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728b02d-9033-4144-aa84-2ca7d8cf341a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:35.979478 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728b02d-9033-4144-aa84-2ca7d8cf341a admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:36.009853 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1094/2201] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:35 2022] POST /identity/v3/users => generated 294 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:18:36.011364 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f34a0d-75be-4f8e-93c5-b7b60197c84c admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:36.026595 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f34a0d-75be-4f8e-93c5-b7b60197c84c admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:36.034717 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06b6f5-2ee5-45d4-b01f-42c32db186ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:36.035446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06b6f5-2ee5-45d4-b01f-42c32db186ce admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:36.035754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06b6f5-2ee5-45d4-b01f-42c32db186ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:36.036004 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06b6f5-2ee5-45d4-b01f-42c32db186ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:36.036681 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06b6f5-2ee5-45d4-b01f-42c32db186ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:36.038369 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06b6f5-2ee5-45d4-b01f-42c32db186ce admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:36.041148 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:36.054993 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1108/2202] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:36.056325 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728b02d-9033-4144-aa84-2ca7d8cf341a admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:36.069658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728b02d-9033-4144-aa84-2ca7d8cf341a admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:36.074618 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9cf42-9369-4cfd-9392-4eec67e32e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:36.075235 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9cf42-9369-4cfd-9392-4eec67e32e9a admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:36.075563 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9cf42-9369-4cfd-9392-4eec67e32e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:36.075927 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9cf42-9369-4cfd-9392-4eec67e32e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:36.076582 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea9cf42-9369-4cfd-9392-4eec67e32e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:36.078822 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea9cf42-9369-4cfd-9392-4eec67e32e9a admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:36.093961 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1095/2203] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:36.097935 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06b6f5-2ee5-45d4-b01f-42c32db186ce admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:36.109880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06b6f5-2ee5-45d4-b01f-42c32db186ce admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:36.114677 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e75e58-a605-40f1-8717-62f7daf5876a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:36.115405 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e75e58-a605-40f1-8717-62f7daf5876a admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:36.115719 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e75e58-a605-40f1-8717-62f7daf5876a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:36.115996 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e75e58-a605-40f1-8717-62f7daf5876a admin admin] PATH_INFO: `/v3/projects/04deaa73df4c494c8672100c594e7a90/users/7afa260191ba4a2fadeffb3ff4877b63/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:36.132432 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e75e58-a605-40f1-8717-62f7daf5876a admin admin] RBAC: Authorizing `identity:create_grant(project_id=04deaa73df4c494c8672100c594e7a90, user_id=7afa260191ba4a2fadeffb3ff4877b63, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:36.135566 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e75e58-a605-40f1-8717-62f7daf5876a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:36.149281 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1109/2204] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:36 2022] PUT /identity/v3/projects/04deaa73df4c494c8672100c594e7a90/users/7afa260191ba4a2fadeffb3ff4877b63/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:36.162055 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56d821-f11a-49b8-b8b8-f3f092bfa1d9 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:36.162333 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56d821-f11a-49b8-b8b8-f3f092bfa1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:36.162618 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56d821-f11a-49b8-b8b8-f3f092bfa1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:36.218104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-1f56d821-f11a-49b8-b8b8-f3f092bfa1d9 None None] MFA Rules not processed for user `7afa260191ba4a2fadeffb3ff4877b63`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:36.219986 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-1f56d821-f11a-49b8-b8b8-f3f092bfa1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:36.308542 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e75e58-a605-40f1-8717-62f7daf5876a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:36.309769 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1096/2205] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:36.404021 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e75e58-a605-40f1-8717-62f7daf5876a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:36.419496 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fc1aa-a435-4a95-80eb-eb3e4b8689df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:36.419496 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fc1aa-a435-4a95-80eb-eb3e4b8689df admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:36.419496 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fc1aa-a435-4a95-80eb-eb3e4b8689df admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:36.419496 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fc1aa-a435-4a95-80eb-eb3e4b8689df admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:36.419940 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fc1aa-a435-4a95-80eb-eb3e4b8689df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:36.419940 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fc1aa-a435-4a95-80eb-eb3e4b8689df admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:36.450905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1110/2206] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:36 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:36.457225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56d821-f11a-49b8-b8b8-f3f092bfa1d9 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:36.470185 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56d821-f11a-49b8-b8b8-f3f092bfa1d9 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:36.554780 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccc011-f252-4fc3-994c-87efc209c70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:36.555404 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccc011-f252-4fc3-994c-87efc209c70b admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:36.555788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccc011-f252-4fc3-994c-87efc209c70b admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:36.556158 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccc011-f252-4fc3-994c-87efc209c70b admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:36.556654 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccc011-f252-4fc3-994c-87efc209c70b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:36.558662 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccc011-f252-4fc3-994c-87efc209c70b admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:36.588725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1097/2207] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:36 2022] POST /identity/v3/users => generated 300 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:36.589914 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fc1aa-a435-4a95-80eb-eb3e4b8689df admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:36.602618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fc1aa-a435-4a95-80eb-eb3e4b8689df admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:36.611927 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f914bf-e44f-4a41-b9ad-adb3684907ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:36.612867 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f914bf-e44f-4a41-b9ad-adb3684907ff admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:36.613153 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f914bf-e44f-4a41-b9ad-adb3684907ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:36.613439 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f914bf-e44f-4a41-b9ad-adb3684907ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:36.614062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f914bf-e44f-4a41-b9ad-adb3684907ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:36.615826 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f914bf-e44f-4a41-b9ad-adb3684907ff admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:36.629645 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1111/2208] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:36.634257 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccc011-f252-4fc3-994c-87efc209c70b admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:36.646260 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccc011-f252-4fc3-994c-87efc209c70b admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:36.651205 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f852103-2883-4b49-8fe8-99c3bf64f4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:36.651948 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f852103-2883-4b49-8fe8-99c3bf64f4b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:36.652313 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f852103-2883-4b49-8fe8-99c3bf64f4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:36.652697 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f852103-2883-4b49-8fe8-99c3bf64f4b1 admin admin] PATH_INFO: `/v3/projects/3a47fea949464e3dbda27d05ae552a75/users/4a049c8370a94c138f96c4a6050e98ac/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:36.670153 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f852103-2883-4b49-8fe8-99c3bf64f4b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a47fea949464e3dbda27d05ae552a75, user_id=4a049c8370a94c138f96c4a6050e98ac, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:36.673862 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f852103-2883-4b49-8fe8-99c3bf64f4b1 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:36.698974 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1098/2209] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:36 2022] PUT /identity/v3/projects/3a47fea949464e3dbda27d05ae552a75/users/4a049c8370a94c138f96c4a6050e98ac/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:36.699875 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f914bf-e44f-4a41-b9ad-adb3684907ff admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:36.713168 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f914bf-e44f-4a41-b9ad-adb3684907ff admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:36.799259 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa3b19-49ca-4ab6-af23-42473b96a97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:36.799937 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa3b19-49ca-4ab6-af23-42473b96a97c admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:36.800216 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa3b19-49ca-4ab6-af23-42473b96a97c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:36.800483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa3b19-49ca-4ab6-af23-42473b96a97c admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:36.801368 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa3b19-49ca-4ab6-af23-42473b96a97c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:36.803115 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa3b19-49ca-4ab6-af23-42473b96a97c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:36.818211 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1112/2210] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:18:36.819455 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f852103-2883-4b49-8fe8-99c3bf64f4b1 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:36.830484 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:36.838663 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f852103-2883-4b49-8fe8-99c3bf64f4b1 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:36.845989 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613105c9-1634-4218-a4d1-9c0be95194f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:36.846663 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613105c9-1634-4218-a4d1-9c0be95194f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:36.847014 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613105c9-1634-4218-a4d1-9c0be95194f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:36.847360 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613105c9-1634-4218-a4d1-9c0be95194f4 admin admin] PATH_INFO: `/v3/projects/3a47fea949464e3dbda27d05ae552a75/users/4a049c8370a94c138f96c4a6050e98ac/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:36.849423 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613105c9-1634-4218-a4d1-9c0be95194f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a47fea949464e3dbda27d05ae552a75, user_id=4a049c8370a94c138f96c4a6050e98ac, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:36.852690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613105c9-1634-4218-a4d1-9c0be95194f4 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:36.875548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1099/2211] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:36 2022] PUT /identity/v3/projects/3a47fea949464e3dbda27d05ae552a75/users/4a049c8370a94c138f96c4a6050e98ac/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:36.878505 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccd556-7faf-44c1-a8f4-cd271f0477b7 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:36.878699 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccd556-7faf-44c1-a8f4-cd271f0477b7 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:36.878960 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccd556-7faf-44c1-a8f4-cd271f0477b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:36.912988 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-19ccd556-7faf-44c1-a8f4-cd271f0477b7 None None] MFA Rules not processed for user `4a049c8370a94c138f96c4a6050e98ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:36.914545 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-19ccd556-7faf-44c1-a8f4-cd271f0477b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:36.952982 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:36.999574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1113/2212] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:36 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:37.009148 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613105c9-1634-4218-a4d1-9c0be95194f4 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:37.012395 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-613105c9-1634-4218-a4d1-9c0be95194f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:37.086385 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613105c9-1634-4218-a4d1-9c0be95194f4 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:37.092341 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d9199-5b87-4f42-a106-811ea7a14a11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:37.093594 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d9199-5b87-4f42-a106-811ea7a14a11 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:37.093875 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d9199-5b87-4f42-a106-811ea7a14a11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:37.094137 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d9199-5b87-4f42-a106-811ea7a14a11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:37.104222 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d9199-5b87-4f42-a106-811ea7a14a11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:37.105592 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d9199-5b87-4f42-a106-811ea7a14a11 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:37.120275 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1100/2213] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:37 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:37.197195 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccd556-7faf-44c1-a8f4-cd271f0477b7 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:37.276383 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccd556-7faf-44c1-a8f4-cd271f0477b7 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:37.281895 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3dac4-6410-4b3f-a4b1-a39ca8cee33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:37.282505 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3dac4-6410-4b3f-a4b1-a39ca8cee33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:37.282784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3dac4-6410-4b3f-a4b1-a39ca8cee33f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:37.283056 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3dac4-6410-4b3f-a4b1-a39ca8cee33f admin admin] PATH_INFO: `/v3/users/7afa260191ba4a2fadeffb3ff4877b63` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:37.284215 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3dac4-6410-4b3f-a4b1-a39ca8cee33f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7afa260191ba4a2fadeffb3ff4877b63)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:37.286261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3dac4-6410-4b3f-a4b1-a39ca8cee33f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:37.340539 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0cc3dac4-6410-4b3f-a4b1-a39ca8cee33f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7afa260191ba4a2fadeffb3ff4877b63'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:37.349866 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0cc3dac4-6410-4b3f-a4b1-a39ca8cee33f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7afa260191ba4a2fadeffb3ff4877b63'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:37.363761 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0cc3dac4-6410-4b3f-a4b1-a39ca8cee33f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7afa260191ba4a2fadeffb3ff4877b63'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:37.373054 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0cc3dac4-6410-4b3f-a4b1-a39ca8cee33f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7afa260191ba4a2fadeffb3ff4877b63'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:37.374493 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0cc3dac4-6410-4b3f-a4b1-a39ca8cee33f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7afa260191ba4a2fadeffb3ff4877b63'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:37.381222 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1114/2214] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:37 2022] DELETE /identity/v3/users/7afa260191ba4a2fadeffb3ff4877b63 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:37.385823 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bdab5-fce9-4996-8d25-c55e85b803cc None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:37.386200 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bdab5-fce9-4996-8d25-c55e85b803cc None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:37.386473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bdab5-fce9-4996-8d25-c55e85b803cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:37.408431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-da7bdab5-fce9-4996-8d25-c55e85b803cc None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:37.409611 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-da7bdab5-fce9-4996-8d25-c55e85b803cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:37.511193 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1101/2215] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:18:37.521817 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3dac4-6410-4b3f-a4b1-a39ca8cee33f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:37.524027 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0cc3dac4-6410-4b3f-a4b1-a39ca8cee33f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:37.648721 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:37.658762 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3dac4-6410-4b3f-a4b1-a39ca8cee33f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:37.673958 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146c377-9f9b-4df7-bd94-40633a1703ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:37.675120 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146c377-9f9b-4df7-bd94-40633a1703ae service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:37.675534 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146c377-9f9b-4df7-bd94-40633a1703ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:37.676039 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146c377-9f9b-4df7-bd94-40633a1703ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:37.687261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146c377-9f9b-4df7-bd94-40633a1703ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:37.689030 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146c377-9f9b-4df7-bd94-40633a1703ae service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:37.702861 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1115/2216] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:37.865521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bdab5-fce9-4996-8d25-c55e85b803cc None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:37.866952 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-da7bdab5-fce9-4996-8d25-c55e85b803cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:38.006500 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bdab5-fce9-4996-8d25-c55e85b803cc None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:38.015444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ccc2c-f9e2-4950-b656-4e9b31979283 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:38.015444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ccc2c-f9e2-4950-b656-4e9b31979283 service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:38.015444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ccc2c-f9e2-4950-b656-4e9b31979283 service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:38.015444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ccc2c-f9e2-4950-b656-4e9b31979283 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:38.017392 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f79ccc2c-f9e2-4950-b656-4e9b31979283 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:38.090064 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:38.136116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ccc2c-f9e2-4950-b656-4e9b31979283 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:38.137757 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ccc2c-f9e2-4950-b656-4e9b31979283 service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:38.156163 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1102/2217] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:38.235293 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146c377-9f9b-4df7-bd94-40633a1703ae service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:38.236811 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2146c377-9f9b-4df7-bd94-40633a1703ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:38.253483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146c377-9f9b-4df7-bd94-40633a1703ae service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:38.260611 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a62e5-e98b-4d7e-81ca-43cc4e509d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:38.261424 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a62e5-e98b-4d7e-81ca-43cc4e509d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:38.261772 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a62e5-e98b-4d7e-81ca-43cc4e509d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:38.262265 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a62e5-e98b-4d7e-81ca-43cc4e509d0a admin admin] PATH_INFO: `/v3/projects/04deaa73df4c494c8672100c594e7a90` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:38.263813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a62e5-e98b-4d7e-81ca-43cc4e509d0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=04deaa73df4c494c8672100c594e7a90)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:38.266720 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a62e5-e98b-4d7e-81ca-43cc4e509d0a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:38.336670 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ab3a62e5-e98b-4d7e-81ca-43cc4e509d0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04deaa73df4c494c8672100c594e7a90', 'request_id': 'req-ab3a62e5-e98b-4d7e-81ca-43cc4e509d0a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:38.347183 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ab3a62e5-e98b-4d7e-81ca-43cc4e509d0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04deaa73df4c494c8672100c594e7a90', 'request_id': 'req-ab3a62e5-e98b-4d7e-81ca-43cc4e509d0a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:38.355570 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ab3a62e5-e98b-4d7e-81ca-43cc4e509d0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04deaa73df4c494c8672100c594e7a90', 'request_id': 'req-ab3a62e5-e98b-4d7e-81ca-43cc4e509d0a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:38.369900 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ab3a62e5-e98b-4d7e-81ca-43cc4e509d0a admin admin] The token cache is being invalidate because project 04deaa73df4c494c8672100c594e7a90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:38.370272 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ab3a62e5-e98b-4d7e-81ca-43cc4e509d0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:38.371045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ab3a62e5-e98b-4d7e-81ca-43cc4e509d0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:38.373182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1116/2218] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:38 2022] DELETE /identity/v3/projects/04deaa73df4c494c8672100c594e7a90 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:38.377980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ccc2c-f9e2-4950-b656-4e9b31979283 service nova] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:38.390205 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ccc2c-f9e2-4950-b656-4e9b31979283 service nova] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:38.516500 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d0e88-c495-4f7f-95c9-714496e38409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:38.517159 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d0e88-c495-4f7f-95c9-714496e38409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:38.517475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d0e88-c495-4f7f-95c9-714496e38409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:38.517694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d0e88-c495-4f7f-95c9-714496e38409 admin admin] PATH_INFO: `/v3/users/4a049c8370a94c138f96c4a6050e98ac` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:38.520105 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d0e88-c495-4f7f-95c9-714496e38409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a049c8370a94c138f96c4a6050e98ac)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:38.522262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d0e88-c495-4f7f-95c9-714496e38409 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:38.624776 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-4a2d0e88-c495-4f7f-95c9-714496e38409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a049c8370a94c138f96c4a6050e98ac'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:38.634462 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-4a2d0e88-c495-4f7f-95c9-714496e38409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a049c8370a94c138f96c4a6050e98ac'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:38.646018 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-4a2d0e88-c495-4f7f-95c9-714496e38409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a049c8370a94c138f96c4a6050e98ac'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:38.672180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-4a2d0e88-c495-4f7f-95c9-714496e38409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a049c8370a94c138f96c4a6050e98ac'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:38.672939 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-4a2d0e88-c495-4f7f-95c9-714496e38409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a049c8370a94c138f96c4a6050e98ac'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:38.683871 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1103/2219] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:38 2022] DELETE /identity/v3/users/4a049c8370a94c138f96c4a6050e98ac => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:18:39.272377 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a62e5-e98b-4d7e-81ca-43cc4e509d0a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:39.273980 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ab3a62e5-e98b-4d7e-81ca-43cc4e509d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:39.289639 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a62e5-e98b-4d7e-81ca-43cc4e509d0a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:39.431891 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85521cdd-475d-40c0-8406-cd61dcf28a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:39.432577 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85521cdd-475d-40c0-8406-cd61dcf28a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:39.432899 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85521cdd-475d-40c0-8406-cd61dcf28a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:39.433694 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85521cdd-475d-40c0-8406-cd61dcf28a53 admin admin] PATH_INFO: `/v3/projects/3a47fea949464e3dbda27d05ae552a75` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:39.435191 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85521cdd-475d-40c0-8406-cd61dcf28a53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a47fea949464e3dbda27d05ae552a75)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:39.438289 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85521cdd-475d-40c0-8406-cd61dcf28a53 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:39.458865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d0e88-c495-4f7f-95c9-714496e38409 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:39.460323 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-4a2d0e88-c495-4f7f-95c9-714496e38409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:39.513206 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-85521cdd-475d-40c0-8406-cd61dcf28a53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a47fea949464e3dbda27d05ae552a75', 'request_id': 'req-85521cdd-475d-40c0-8406-cd61dcf28a53'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:39.529544 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-85521cdd-475d-40c0-8406-cd61dcf28a53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a47fea949464e3dbda27d05ae552a75', 'request_id': 'req-85521cdd-475d-40c0-8406-cd61dcf28a53'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:39.560461 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-85521cdd-475d-40c0-8406-cd61dcf28a53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a47fea949464e3dbda27d05ae552a75', 'request_id': 'req-85521cdd-475d-40c0-8406-cd61dcf28a53'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:39.566864 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-85521cdd-475d-40c0-8406-cd61dcf28a53 admin admin] The token cache is being invalidate because project 3a47fea949464e3dbda27d05ae552a75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:39.567167 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-85521cdd-475d-40c0-8406-cd61dcf28a53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:39.572185 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-85521cdd-475d-40c0-8406-cd61dcf28a53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:39.573985 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1117/2220] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:39 2022] DELETE /identity/v3/projects/3a47fea949464e3dbda27d05ae552a75 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:39.580950 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af4647-772b-411e-8215-d5f4921d5421 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:39.581242 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af4647-772b-411e-8215-d5f4921d5421 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:39.581520 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af4647-772b-411e-8215-d5f4921d5421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:39.595488 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:39.600876 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:39.614823 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-38af4647-772b-411e-8215-d5f4921d5421 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:39.616861 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-38af4647-772b-411e-8215-d5f4921d5421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:39.621449 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d0e88-c495-4f7f-95c9-714496e38409 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:39.708280 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015f555-a460-4b7a-b948-f4c1e8e3c643 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b3ca8694ab4a169a3c36561290d8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:39.708825 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1118/2221] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:18:39.716910 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015f555-a460-4b7a-b948-f4c1e8e3c643 service placement] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:39.717201 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015f555-a460-4b7a-b948-f4c1e8e3c643 service placement] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:39.718307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015f555-a460-4b7a-b948-f4c1e8e3c643 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:39.720572 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-6015f555-a460-4b7a-b948-f4c1e8e3c643 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:39.721338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950e097-3a23-4642-87d5-630a76ff997b None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:39.722323 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950e097-3a23-4642-87d5-630a76ff997b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:39.723053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950e097-3a23-4642-87d5-630a76ff997b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:39.748226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-8950e097-3a23-4642-87d5-630a76ff997b None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:39.749577 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8950e097-3a23-4642-87d5-630a76ff997b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:39.760838 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1119/2222] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:39.760990 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015f555-a460-4b7a-b948-f4c1e8e3c643 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:39.760990 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015f555-a460-4b7a-b948-f4c1e8e3c643 service placement] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:39.761839 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950e097-3a23-4642-87d5-630a76ff997b None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:39.785353 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950e097-3a23-4642-87d5-630a76ff997b None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:39.788549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1104/2223] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:18:39.807466 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604be65-168d-4f51-99b4-3abf84982f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:39.808179 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604be65-168d-4f51-99b4-3abf84982f0a admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:39.808553 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604be65-168d-4f51-99b4-3abf84982f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:39.808839 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604be65-168d-4f51-99b4-3abf84982f0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:39.809516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604be65-168d-4f51-99b4-3abf84982f0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:18:39.809801 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604be65-168d-4f51-99b4-3abf84982f0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:39.811793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604be65-168d-4f51-99b4-3abf84982f0a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:39.827509 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1120/2224] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:18:39.829854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015f555-a460-4b7a-b948-f4c1e8e3c643 service placement] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:39.844683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015f555-a460-4b7a-b948-f4c1e8e3c643 service placement] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:39.850268 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1baa2b7-6374-4e81-bc1f-b4c44545ffb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:39.851129 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1baa2b7-6374-4e81-bc1f-b4c44545ffb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:39.851624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1baa2b7-6374-4e81-bc1f-b4c44545ffb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:39.852089 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1baa2b7-6374-4e81-bc1f-b4c44545ffb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:39.852816 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1baa2b7-6374-4e81-bc1f-b4c44545ffb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:39.855004 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1baa2b7-6374-4e81-bc1f-b4c44545ffb1 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:39.898985 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1105/2225] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:39 2022] POST /identity/v3/projects => generated 393 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:39.899903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604be65-168d-4f51-99b4-3abf84982f0a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:39.916171 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604be65-168d-4f51-99b4-3abf84982f0a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:40.055620 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d8a12-eb74-4cd8-82ad-c772f4d1df38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:40.056803 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d8a12-eb74-4cd8-82ad-c772f4d1df38 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:40.057178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d8a12-eb74-4cd8-82ad-c772f4d1df38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:40.057555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d8a12-eb74-4cd8-82ad-c772f4d1df38 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:40.058346 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d8a12-eb74-4cd8-82ad-c772f4d1df38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:40.060482 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d8a12-eb74-4cd8-82ad-c772f4d1df38 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:40.098225 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1121/2226] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:39 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:40.102610 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1baa2b7-6374-4e81-bc1f-b4c44545ffb1 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:40.116682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1baa2b7-6374-4e81-bc1f-b4c44545ffb1 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:40.122875 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cd353-3211-4696-9b54-74ea078172dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:40.123621 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cd353-3211-4696-9b54-74ea078172dc admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:40.124523 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cd353-3211-4696-9b54-74ea078172dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:40.124863 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cd353-3211-4696-9b54-74ea078172dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:40.125582 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280cd353-3211-4696-9b54-74ea078172dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:40.128083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280cd353-3211-4696-9b54-74ea078172dc admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:40.146333 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1106/2227] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:40.150293 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d8a12-eb74-4cd8-82ad-c772f4d1df38 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:40.171386 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d8a12-eb74-4cd8-82ad-c772f4d1df38 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:40.183084 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1829c9-6e13-4a6c-b464-220406ef0f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:40.184561 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1829c9-6e13-4a6c-b464-220406ef0f0c admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:40.186813 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1829c9-6e13-4a6c-b464-220406ef0f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:40.187974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1829c9-6e13-4a6c-b464-220406ef0f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:40.189057 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1829c9-6e13-4a6c-b464-220406ef0f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:40.193404 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1829c9-6e13-4a6c-b464-220406ef0f0c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:40.224584 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1122/2228] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:40.226283 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cd353-3211-4696-9b54-74ea078172dc admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:40.240593 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cd353-3211-4696-9b54-74ea078172dc admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:40.248325 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30d9f5-6b3e-4ac7-849d-ab526f583ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:40.250349 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30d9f5-6b3e-4ac7-849d-ab526f583ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:40.250547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30d9f5-6b3e-4ac7-849d-ab526f583ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:40.250915 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30d9f5-6b3e-4ac7-849d-ab526f583ea8 admin admin] PATH_INFO: `/v3/projects/00b1e1408e344d729bc6aedbcd4b34cd/users/400750e1420d4804a290670675057503/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:40.287686 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30d9f5-6b3e-4ac7-849d-ab526f583ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b1e1408e344d729bc6aedbcd4b34cd, user_id=400750e1420d4804a290670675057503, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:40.290667 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30d9f5-6b3e-4ac7-849d-ab526f583ea8 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:40.313474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1107/2229] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:40 2022] PUT /identity/v3/projects/00b1e1408e344d729bc6aedbcd4b34cd/users/400750e1420d4804a290670675057503/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:40.324540 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a83a94-9920-4508-971f-f66093d1057f None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:40.324992 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a83a94-9920-4508-971f-f66093d1057f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:40.325269 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a83a94-9920-4508-971f-f66093d1057f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:40.386633 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d3a83a94-9920-4508-971f-f66093d1057f None None] MFA Rules not processed for user `400750e1420d4804a290670675057503`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:40.387962 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d3a83a94-9920-4508-971f-f66093d1057f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:40.471654 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:40.491619 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1123/2230] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:40.492241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30d9f5-6b3e-4ac7-849d-ab526f583ea8 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:40.592257 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30d9f5-6b3e-4ac7-849d-ab526f583ea8 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:40.600594 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2012c90-5c08-4511-96fb-961e4be49852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:40.601212 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2012c90-5c08-4511-96fb-961e4be49852 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:40.601538 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2012c90-5c08-4511-96fb-961e4be49852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:40.601813 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2012c90-5c08-4511-96fb-961e4be49852 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:40.602571 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2012c90-5c08-4511-96fb-961e4be49852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:40.604661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2012c90-5c08-4511-96fb-961e4be49852 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:40.644402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1108/2231] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:40 2022] POST /identity/v3/projects => generated 391 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:18:40.648301 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a83a94-9920-4508-971f-f66093d1057f None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:40.665473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a83a94-9920-4508-971f-f66093d1057f None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:40.775507 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea360c12-dcb5-480f-9769-87ed928e3b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:40.776156 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea360c12-dcb5-480f-9769-87ed928e3b78 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:40.776434 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea360c12-dcb5-480f-9769-87ed928e3b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:40.776704 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea360c12-dcb5-480f-9769-87ed928e3b78 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:40.777394 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea360c12-dcb5-480f-9769-87ed928e3b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:40.779523 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea360c12-dcb5-480f-9769-87ed928e3b78 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:40.824826 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1124/2232] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:40 2022] POST /identity/v3/users => generated 302 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:40.827857 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2012c90-5c08-4511-96fb-961e4be49852 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:40.840221 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2012c90-5c08-4511-96fb-961e4be49852 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:40.845850 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea24c7-1adb-4d56-9cc3-17a86538cc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:40.846483 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea24c7-1adb-4d56-9cc3-17a86538cc78 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:40.846751 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea24c7-1adb-4d56-9cc3-17a86538cc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:40.847024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea24c7-1adb-4d56-9cc3-17a86538cc78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:40.847707 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea24c7-1adb-4d56-9cc3-17a86538cc78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:40.849320 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea24c7-1adb-4d56-9cc3-17a86538cc78 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:40.855629 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:40.871085 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1109/2233] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:40.872728 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea360c12-dcb5-480f-9769-87ed928e3b78 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:40.886057 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea360c12-dcb5-480f-9769-87ed928e3b78 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:40.891937 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c4e92-5300-4695-817e-57589b71e074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:40.892554 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c4e92-5300-4695-817e-57589b71e074 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:40.892834 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c4e92-5300-4695-817e-57589b71e074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:40.893111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c4e92-5300-4695-817e-57589b71e074 admin admin] PATH_INFO: `/v3/projects/e21fc89d78b3401cbe80cdaa682d224c/users/006ff0dc6dcd48babfa67aab620cc260/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:40.911605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c4e92-5300-4695-817e-57589b71e074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e21fc89d78b3401cbe80cdaa682d224c, user_id=006ff0dc6dcd48babfa67aab620cc260, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:40.914434 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c4e92-5300-4695-817e-57589b71e074 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:40.931401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1125/2234] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:40 2022] PUT /identity/v3/projects/e21fc89d78b3401cbe80cdaa682d224c/users/006ff0dc6dcd48babfa67aab620cc260/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:40.935280 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea24c7-1adb-4d56-9cc3-17a86538cc78 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:40.948551 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea24c7-1adb-4d56-9cc3-17a86538cc78 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:41.013681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c6cab-fdeb-4ee8-a961-f5d8d54e3f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:41.014812 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c6cab-fdeb-4ee8-a961-f5d8d54e3f1d admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:41.015246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c6cab-fdeb-4ee8-a961-f5d8d54e3f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:41.015737 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c6cab-fdeb-4ee8-a961-f5d8d54e3f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:41.016378 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c6cab-fdeb-4ee8-a961-f5d8d54e3f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:41.017982 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c6cab-fdeb-4ee8-a961-f5d8d54e3f1d admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:41.027555 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1110/2235] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:18:41.032383 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c4e92-5300-4695-817e-57589b71e074 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:41.042427 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c4e92-5300-4695-817e-57589b71e074 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:41.046972 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f0461-e1e3-4c0e-8ba8-db16445ae3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:41.047640 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f0461-e1e3-4c0e-8ba8-db16445ae3af admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:41.047915 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f0461-e1e3-4c0e-8ba8-db16445ae3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:41.048181 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f0461-e1e3-4c0e-8ba8-db16445ae3af admin admin] PATH_INFO: `/v3/projects/e21fc89d78b3401cbe80cdaa682d224c/users/006ff0dc6dcd48babfa67aab620cc260/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:41.050080 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f0461-e1e3-4c0e-8ba8-db16445ae3af admin admin] RBAC: Authorizing `identity:create_grant(project_id=e21fc89d78b3401cbe80cdaa682d224c, user_id=006ff0dc6dcd48babfa67aab620cc260, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:41.052713 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f0461-e1e3-4c0e-8ba8-db16445ae3af admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:41.063102 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1126/2236] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:41 2022] PUT /identity/v3/projects/e21fc89d78b3401cbe80cdaa682d224c/users/006ff0dc6dcd48babfa67aab620cc260/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:41.073441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccb03e-56a1-46e1-841f-7bde13aa59d0 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:41.073722 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccb03e-56a1-46e1-841f-7bde13aa59d0 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:41.073991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccb03e-56a1-46e1-841f-7bde13aa59d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:41.102581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-4cccb03e-56a1-46e1-841f-7bde13aa59d0 None None] MFA Rules not processed for user `006ff0dc6dcd48babfa67aab620cc260`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:41.103727 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-4cccb03e-56a1-46e1-841f-7bde13aa59d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:41.171720 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1111/2237] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:41 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:41.182162 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f0461-e1e3-4c0e-8ba8-db16445ae3af admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:41.183846 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f98f0461-e1e3-4c0e-8ba8-db16445ae3af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:41.252515 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f0461-e1e3-4c0e-8ba8-db16445ae3af admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:41.257152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c216e8-c9f6-4d16-80e0-74f2f7ab54b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:41.257804 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c216e8-c9f6-4d16-80e0-74f2f7ab54b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:41.258140 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c216e8-c9f6-4d16-80e0-74f2f7ab54b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:41.258469 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c216e8-c9f6-4d16-80e0-74f2f7ab54b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:41.275202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c216e8-c9f6-4d16-80e0-74f2f7ab54b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:41.276760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c216e8-c9f6-4d16-80e0-74f2f7ab54b4 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:41.301529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1127/2238] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:41 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:41.383737 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccb03e-56a1-46e1-841f-7bde13aa59d0 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:41.394115 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccb03e-56a1-46e1-841f-7bde13aa59d0 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:41.400517 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d08bf2-fb24-4b7b-b0f0-f016c4c66e46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:41.401553 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d08bf2-fb24-4b7b-b0f0-f016c4c66e46 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:41.401829 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d08bf2-fb24-4b7b-b0f0-f016c4c66e46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:41.402101 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d08bf2-fb24-4b7b-b0f0-f016c4c66e46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:41.469063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d08bf2-fb24-4b7b-b0f0-f016c4c66e46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:41.470505 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d08bf2-fb24-4b7b-b0f0-f016c4c66e46 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:41.479328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1112/2239] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:41 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:18:41.812415 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c216e8-c9f6-4d16-80e0-74f2f7ab54b4 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:41.819720 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f7c216e8-c9f6-4d16-80e0-74f2f7ab54b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:41.888198 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:41.893439 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c216e8-c9f6-4d16-80e0-74f2f7ab54b4 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:41.898354 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd1af3-b1a8-4226-829e-c178736595fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:41.899740 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd1af3-b1a8-4226-829e-c178736595fc service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:41.900002 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd1af3-b1a8-4226-829e-c178736595fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:41.900281 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd1af3-b1a8-4226-829e-c178736595fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:41.903478 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-81cd1af3-b1a8-4226-829e-c178736595fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:41.914986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd1af3-b1a8-4226-829e-c178736595fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:41.916853 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd1af3-b1a8-4226-829e-c178736595fc service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:41.926439 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1128/2240] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:44.803011 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d08bf2-fb24-4b7b-b0f0-f016c4c66e46 service cinder] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:44.826758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:44.878534 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d08bf2-fb24-4b7b-b0f0-f016c4c66e46 service cinder] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:44.884451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222f1ac-3dec-480c-91f3-fe23be7494e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:44.884877 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222f1ac-3dec-480c-91f3-fe23be7494e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:44.885305 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222f1ac-3dec-480c-91f3-fe23be7494e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:44.885638 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222f1ac-3dec-480c-91f3-fe23be7494e9 admin admin] PATH_INFO: `/v3/users/400750e1420d4804a290670675057503` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:44.887081 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222f1ac-3dec-480c-91f3-fe23be7494e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=400750e1420d4804a290670675057503)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:44.889319 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222f1ac-3dec-480c-91f3-fe23be7494e9 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:44.943881 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8222f1ac-3dec-480c-91f3-fe23be7494e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '400750e1420d4804a290670675057503'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:44.953103 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8222f1ac-3dec-480c-91f3-fe23be7494e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '400750e1420d4804a290670675057503'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:44.963168 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8222f1ac-3dec-480c-91f3-fe23be7494e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '400750e1420d4804a290670675057503'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:44.987474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8222f1ac-3dec-480c-91f3-fe23be7494e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '400750e1420d4804a290670675057503'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:44.988212 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8222f1ac-3dec-480c-91f3-fe23be7494e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '400750e1420d4804a290670675057503'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:44.994552 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1113/2241] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:44 2022] DELETE /identity/v3/users/400750e1420d4804a290670675057503 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:45.000495 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad19e1a-d5fc-4237-b06b-3af20a9e6ce2 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:45.000937 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad19e1a-d5fc-4237-b06b-3af20a9e6ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:45.001246 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad19e1a-d5fc-4237-b06b-3af20a9e6ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:45.026111 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-cad19e1a-d5fc-4237-b06b-3af20a9e6ce2 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:45.027400 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-cad19e1a-d5fc-4237-b06b-3af20a9e6ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:45.087030 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1129/2242] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:18:45.097565 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222f1ac-3dec-480c-91f3-fe23be7494e9 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:45.098949 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-8222f1ac-3dec-480c-91f3-fe23be7494e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:45.156884 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222f1ac-3dec-480c-91f3-fe23be7494e9 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:45.160478 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed6495-faf5-4574-8ec4-4d26d5ba7576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:45.161066 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed6495-faf5-4574-8ec4-4d26d5ba7576 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:45.161339 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed6495-faf5-4574-8ec4-4d26d5ba7576 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:45.161607 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed6495-faf5-4574-8ec4-4d26d5ba7576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:45.170321 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed6495-faf5-4574-8ec4-4d26d5ba7576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:45.172483 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed6495-faf5-4574-8ec4-4d26d5ba7576 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:45.181622 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1114/2243] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:45.550140 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad19e1a-d5fc-4237-b06b-3af20a9e6ce2 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:45.550140 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-cad19e1a-d5fc-4237-b06b-3af20a9e6ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:45.554236 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad19e1a-d5fc-4237-b06b-3af20a9e6ce2 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:45.559593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb3934-9818-432a-8571-e0a57f51dda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:45.560226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb3934-9818-432a-8571-e0a57f51dda7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:45.560524 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb3934-9818-432a-8571-e0a57f51dda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:45.560759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb3934-9818-432a-8571-e0a57f51dda7 admin admin] PATH_INFO: `/v3/projects/00b1e1408e344d729bc6aedbcd4b34cd` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:45.562426 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb3934-9818-432a-8571-e0a57f51dda7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00b1e1408e344d729bc6aedbcd4b34cd)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:45.565439 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb3934-9818-432a-8571-e0a57f51dda7 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:45.625185 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d5eb3934-9818-432a-8571-e0a57f51dda7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00b1e1408e344d729bc6aedbcd4b34cd', 'request_id': 'req-d5eb3934-9818-432a-8571-e0a57f51dda7'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:45.633119 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d5eb3934-9818-432a-8571-e0a57f51dda7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00b1e1408e344d729bc6aedbcd4b34cd', 'request_id': 'req-d5eb3934-9818-432a-8571-e0a57f51dda7'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:45.638843 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d5eb3934-9818-432a-8571-e0a57f51dda7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00b1e1408e344d729bc6aedbcd4b34cd', 'request_id': 'req-d5eb3934-9818-432a-8571-e0a57f51dda7'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:45.650850 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d5eb3934-9818-432a-8571-e0a57f51dda7 admin admin] The token cache is being invalidate because project 00b1e1408e344d729bc6aedbcd4b34cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:45.651138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d5eb3934-9818-432a-8571-e0a57f51dda7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:45.651793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d5eb3934-9818-432a-8571-e0a57f51dda7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:45.653505 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1130/2244] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:45 2022] DELETE /identity/v3/projects/00b1e1408e344d729bc6aedbcd4b34cd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:45.658116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed6495-faf5-4574-8ec4-4d26d5ba7576 service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:45.667433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed6495-faf5-4574-8ec4-4d26d5ba7576 service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:45.713454 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:45.734768 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500621e4-7f8b-49e4-baec-2007f9ee06d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:45.735486 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500621e4-7f8b-49e4-baec-2007f9ee06d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:45.735767 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500621e4-7f8b-49e4-baec-2007f9ee06d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:45.736036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500621e4-7f8b-49e4-baec-2007f9ee06d8 admin admin] PATH_INFO: `/v3/users/006ff0dc6dcd48babfa67aab620cc260` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:45.737325 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500621e4-7f8b-49e4-baec-2007f9ee06d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=006ff0dc6dcd48babfa67aab620cc260)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:45.739635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500621e4-7f8b-49e4-baec-2007f9ee06d8 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:45.791057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-500621e4-7f8b-49e4-baec-2007f9ee06d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '006ff0dc6dcd48babfa67aab620cc260'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:45.800562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-500621e4-7f8b-49e4-baec-2007f9ee06d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '006ff0dc6dcd48babfa67aab620cc260'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:45.808339 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-500621e4-7f8b-49e4-baec-2007f9ee06d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '006ff0dc6dcd48babfa67aab620cc260'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:45.821112 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-500621e4-7f8b-49e4-baec-2007f9ee06d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '006ff0dc6dcd48babfa67aab620cc260'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:45.821785 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-500621e4-7f8b-49e4-baec-2007f9ee06d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '006ff0dc6dcd48babfa67aab620cc260'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:45.827804 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1115/2245] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:45 2022] DELETE /identity/v3/users/006ff0dc6dcd48babfa67aab620cc260 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:46.124849 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb3934-9818-432a-8571-e0a57f51dda7 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:46.126346 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d5eb3934-9818-432a-8571-e0a57f51dda7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:46.139943 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb3934-9818-432a-8571-e0a57f51dda7 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:46.204460 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923aba3-5b60-4ef5-b8e8-c74bb39516fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:46.205091 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923aba3-5b60-4ef5-b8e8-c74bb39516fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:46.205373 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923aba3-5b60-4ef5-b8e8-c74bb39516fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:46.205643 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923aba3-5b60-4ef5-b8e8-c74bb39516fe admin admin] PATH_INFO: `/v3/projects/e21fc89d78b3401cbe80cdaa682d224c` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:46.206763 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923aba3-5b60-4ef5-b8e8-c74bb39516fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e21fc89d78b3401cbe80cdaa682d224c)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:46.208733 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923aba3-5b60-4ef5-b8e8-c74bb39516fe admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:46.225811 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:46.259990 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3923aba3-5b60-4ef5-b8e8-c74bb39516fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e21fc89d78b3401cbe80cdaa682d224c', 'request_id': 'req-3923aba3-5b60-4ef5-b8e8-c74bb39516fe'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:46.270365 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3923aba3-5b60-4ef5-b8e8-c74bb39516fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e21fc89d78b3401cbe80cdaa682d224c', 'request_id': 'req-3923aba3-5b60-4ef5-b8e8-c74bb39516fe'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:46.276974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3923aba3-5b60-4ef5-b8e8-c74bb39516fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e21fc89d78b3401cbe80cdaa682d224c', 'request_id': 'req-3923aba3-5b60-4ef5-b8e8-c74bb39516fe'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:46.289664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3923aba3-5b60-4ef5-b8e8-c74bb39516fe admin admin] The token cache is being invalidate because project e21fc89d78b3401cbe80cdaa682d224c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:46.290085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3923aba3-5b60-4ef5-b8e8-c74bb39516fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:46.290880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3923aba3-5b60-4ef5-b8e8-c74bb39516fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:46.292918 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1131/2246] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:46 2022] DELETE /identity/v3/projects/e21fc89d78b3401cbe80cdaa682d224c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:46.298264 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71f880-fb32-4795-ae2f-4487661594a8 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:46.298864 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71f880-fb32-4795-ae2f-4487661594a8 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:46.298864 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71f880-fb32-4795-ae2f-4487661594a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:46.321221 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-ed71f880-fb32-4795-ae2f-4487661594a8 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:46.322348 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-ed71f880-fb32-4795-ae2f-4487661594a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:46.398901 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1116/2247] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:46.408733 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c28048-7a22-434b-b88a-c04c333e4c4e None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:46.409159 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c28048-7a22-434b-b88a-c04c333e4c4e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:46.409459 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c28048-7a22-434b-b88a-c04c333e4c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:46.432988 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-92c28048-7a22-434b-b88a-c04c333e4c4e None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:46.434517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-92c28048-7a22-434b-b88a-c04c333e4c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:46.444302 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1132/2248] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:46.448712 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71f880-fb32-4795-ae2f-4487661594a8 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:46.459675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71f880-fb32-4795-ae2f-4487661594a8 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:46.464482 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4114fba-f0c7-4991-b1b7-707099e4e8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:46.465075 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4114fba-f0c7-4991-b1b7-707099e4e8fc admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:46.465351 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4114fba-f0c7-4991-b1b7-707099e4e8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:46.465617 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4114fba-f0c7-4991-b1b7-707099e4e8fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:46.466248 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4114fba-f0c7-4991-b1b7-707099e4e8fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:18:46.466540 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4114fba-f0c7-4991-b1b7-707099e4e8fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:46.469121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4114fba-f0c7-4991-b1b7-707099e4e8fc admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:46.480701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1117/2249] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:18:46.485847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c28048-7a22-434b-b88a-c04c333e4c4e None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:46.495160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c28048-7a22-434b-b88a-c04c333e4c4e None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:46.500733 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1b8e8-5c0e-422d-b457-cf3c4c099faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:46.501335 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1b8e8-5c0e-422d-b457-cf3c4c099faf admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:46.501613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1b8e8-5c0e-422d-b457-cf3c4c099faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:46.501883 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1b8e8-5c0e-422d-b457-cf3c4c099faf admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:46.502507 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1b8e8-5c0e-422d-b457-cf3c4c099faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:46.504463 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1b8e8-5c0e-422d-b457-cf3c4c099faf admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:46.535841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1133/2250] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:46 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:46.536957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4114fba-f0c7-4991-b1b7-707099e4e8fc admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:46.547525 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4114fba-f0c7-4991-b1b7-707099e4e8fc admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:46.579304 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1b8e8-5c0e-422d-b457-cf3c4c099faf admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:46.581903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a1a1b8e8-5c0e-422d-b457-cf3c4c099faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:46.606934 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:46.628664 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cad127-4a17-4625-82dc-d030ab5f192d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:46.629890 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cad127-4a17-4625-82dc-d030ab5f192d admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:46.631065 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cad127-4a17-4625-82dc-d030ab5f192d admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:46.631343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cad127-4a17-4625-82dc-d030ab5f192d admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:46.632030 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cad127-4a17-4625-82dc-d030ab5f192d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:46.634724 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cad127-4a17-4625-82dc-d030ab5f192d admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:46.649939 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1b8e8-5c0e-422d-b457-cf3c4c099faf admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:46.654503 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60666980-57f7-4718-84f9-a10c1f451c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:46.654622 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60666980-57f7-4718-84f9-a10c1f451c71 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:46.655466 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60666980-57f7-4718-84f9-a10c1f451c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:46.655751 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60666980-57f7-4718-84f9-a10c1f451c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:46.657650 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-60666980-57f7-4718-84f9-a10c1f451c71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:46.663094 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1118/2251] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:46 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:46.664478 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cad127-4a17-4625-82dc-d030ab5f192d admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:46.667972 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60666980-57f7-4718-84f9-a10c1f451c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:46.669423 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60666980-57f7-4718-84f9-a10c1f451c71 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:46.675649 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cad127-4a17-4625-82dc-d030ab5f192d admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:46.678907 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1134/2252] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:46.681863 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccf297-1f21-4671-ac8b-7e12e7ab8f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:46.682538 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccf297-1f21-4671-ac8b-7e12e7ab8f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:46.682725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccf297-1f21-4671-ac8b-7e12e7ab8f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:46.683074 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccf297-1f21-4671-ac8b-7e12e7ab8f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:46.683761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccf297-1f21-4671-ac8b-7e12e7ab8f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:46.685380 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccf297-1f21-4671-ac8b-7e12e7ab8f34 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:46.707997 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1119/2253] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:46.709235 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60666980-57f7-4718-84f9-a10c1f451c71 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:46.723454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60666980-57f7-4718-84f9-a10c1f451c71 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:46.729801 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674aca3e-e7fd-4be8-aee1-499a65d2e6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:46.730435 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674aca3e-e7fd-4be8-aee1-499a65d2e6dd admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:46.730669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674aca3e-e7fd-4be8-aee1-499a65d2e6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:46.730941 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674aca3e-e7fd-4be8-aee1-499a65d2e6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:46.731606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674aca3e-e7fd-4be8-aee1-499a65d2e6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:46.733250 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674aca3e-e7fd-4be8-aee1-499a65d2e6dd admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:46.748186 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1135/2254] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:46.750234 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccf297-1f21-4671-ac8b-7e12e7ab8f34 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:46.769280 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccf297-1f21-4671-ac8b-7e12e7ab8f34 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:46.774063 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa66ae4-ee09-48b8-a39d-823aee75d862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:46.774705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa66ae4-ee09-48b8-a39d-823aee75d862 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:46.774981 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa66ae4-ee09-48b8-a39d-823aee75d862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:46.775246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa66ae4-ee09-48b8-a39d-823aee75d862 admin admin] PATH_INFO: `/v3/projects/2e09c3f9736a4429bec86b9f068d6015/users/12d441f0f4204c36808a2004b3fd97c8/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:46.794382 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa66ae4-ee09-48b8-a39d-823aee75d862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e09c3f9736a4429bec86b9f068d6015, user_id=12d441f0f4204c36808a2004b3fd97c8, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:46.797705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa66ae4-ee09-48b8-a39d-823aee75d862 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:46.813758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1120/2255] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:46 2022] PUT /identity/v3/projects/2e09c3f9736a4429bec86b9f068d6015/users/12d441f0f4204c36808a2004b3fd97c8/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:18:46.816952 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4548b-dcf0-497a-ade8-1188154bad22 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:46.817298 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4548b-dcf0-497a-ade8-1188154bad22 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:46.817510 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4548b-dcf0-497a-ade8-1188154bad22 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:46.818810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1136/2256] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 24 13:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:18:46.824119 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f64cab-e5a9-46b4-b2a4-80ad47acaf2a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:46.824276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a8ee0-d0ba-438c-9316-e050575d98a0 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:46.824437 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f64cab-e5a9-46b4-b2a4-80ad47acaf2a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:46.824564 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a8ee0-d0ba-438c-9316-e050575d98a0 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:46.824660 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f64cab-e5a9-46b4-b2a4-80ad47acaf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:46.824764 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a8ee0-d0ba-438c-9316-e050575d98a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:46.846891 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-16f64cab-e5a9-46b4-b2a4-80ad47acaf2a None None] MFA Rules not processed for user `4f6b27c7d052437a949a371169fb48ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:46.848953 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-16f64cab-e5a9-46b4-b2a4-80ad47acaf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:46.859804 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-6b1a8ee0-d0ba-438c-9316-e050575d98a0 None None] MFA Rules not processed for user `12d441f0f4204c36808a2004b3fd97c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:46.861012 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-6b1a8ee0-d0ba-438c-9316-e050575d98a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:46.913074 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:46.927085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1137/2257] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 24 13:18:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:18:46.939993 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f64cab-e5a9-46b4-b2a4-80ad47acaf2a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:46.941687 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-16f64cab-e5a9-46b4-b2a4-80ad47acaf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:46.949277 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1121/2258] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:46.954354 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a8ee0-d0ba-438c-9316-e050575d98a0 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:47.006155 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f64cab-e5a9-46b4-b2a4-80ad47acaf2a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:47.010027 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6825ec-3451-4b7f-8c87-33c13d7fbabc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0866de4d4e46d5b26719faf385d7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:47.010637 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6825ec-3451-4b7f-8c87-33c13d7fbabc service glance] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:47.010916 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6825ec-3451-4b7f-8c87-33c13d7fbabc service glance] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:47.011187 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6825ec-3451-4b7f-8c87-33c13d7fbabc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:47.017599 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a8ee0-d0ba-438c-9316-e050575d98a0 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:47.022217 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dac1d4-19e0-496a-b881-af523ef219d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:47.022359 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6825ec-3451-4b7f-8c87-33c13d7fbabc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:47.022838 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dac1d4-19e0-496a-b881-af523ef219d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:47.023113 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dac1d4-19e0-496a-b881-af523ef219d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:47.023382 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dac1d4-19e0-496a-b881-af523ef219d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:47.023714 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6825ec-3451-4b7f-8c87-33c13d7fbabc service glance] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:47.024035 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dac1d4-19e0-496a-b881-af523ef219d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:47.025933 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dac1d4-19e0-496a-b881-af523ef219d7 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:47.035281 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1138/2259] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:18:47.056752 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1122/2260] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:46 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:18:47.057889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6825ec-3451-4b7f-8c87-33c13d7fbabc service glance] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:47.068725 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6825ec-3451-4b7f-8c87-33c13d7fbabc service glance] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:47.110870 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba33550-541c-45e6-b6a7-fcffd601a204 None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:47.110870 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba33550-541c-45e6-b6a7-fcffd601a204 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:47.110870 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba33550-541c-45e6-b6a7-fcffd601a204 None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:47.112321 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1123/2261] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 24 13:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:18:47.116719 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f7f6c-d239-4a69-ae9a-462d7b27e1a0 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:47.117080 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f7f6c-d239-4a69-ae9a-462d7b27e1a0 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:47.117349 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f7f6c-d239-4a69-ae9a-462d7b27e1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:47.133635 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34b494-3b3f-40f5-b8d8-a64d31375d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:47.134247 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34b494-3b3f-40f5-b8d8-a64d31375d5b admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:47.134641 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34b494-3b3f-40f5-b8d8-a64d31375d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:47.134975 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34b494-3b3f-40f5-b8d8-a64d31375d5b admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:47.135705 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34b494-3b3f-40f5-b8d8-a64d31375d5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:47.137805 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34b494-3b3f-40f5-b8d8-a64d31375d5b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:47.138843 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-178f7f6c-d239-4a69-ae9a-462d7b27e1a0 None None] MFA Rules not processed for user `0f2295659f2e467d8d798bf93f731330`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:47.140318 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-178f7f6c-d239-4a69-ae9a-462d7b27e1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:47.153789 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:47.162480 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1139/2262] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:47 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:18:47.167489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34b494-3b3f-40f5-b8d8-a64d31375d5b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:47.180281 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34b494-3b3f-40f5-b8d8-a64d31375d5b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:47.185384 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a77c76-40ff-44b8-b4fd-33efbdae372a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:47.185896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a77c76-40ff-44b8-b4fd-33efbdae372a admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:47.186190 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a77c76-40ff-44b8-b4fd-33efbdae372a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:47.187160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a77c76-40ff-44b8-b4fd-33efbdae372a admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:47.187859 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a77c76-40ff-44b8-b4fd-33efbdae372a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:47.190024 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a77c76-40ff-44b8-b4fd-33efbdae372a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:47.200654 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1124/2263] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 24 13:18:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:18:47.204073 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1140/2264] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:47.204225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f7f6c-d239-4a69-ae9a-462d7b27e1a0 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:47.213172 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a77c76-40ff-44b8-b4fd-33efbdae372a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:47.217336 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f7f6c-d239-4a69-ae9a-462d7b27e1a0 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:47.223552 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde90c2-05d9-4f15-af1b-b70dcf0349e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:47.224293 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde90c2-05d9-4f15-af1b-b70dcf0349e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:47.224584 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde90c2-05d9-4f15-af1b-b70dcf0349e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:47.225050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde90c2-05d9-4f15-af1b-b70dcf0349e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:47.225170 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a77c76-40ff-44b8-b4fd-33efbdae372a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:47.225826 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde90c2-05d9-4f15-af1b-b70dcf0349e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:47.227524 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde90c2-05d9-4f15-af1b-b70dcf0349e9 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:47.229278 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81b433-9853-4e20-9bf1-8a1e666e40c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:47.245109 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81b433-9853-4e20-9bf1-8a1e666e40c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:47.245109 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81b433-9853-4e20-9bf1-8a1e666e40c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:47.245109 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81b433-9853-4e20-9bf1-8a1e666e40c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:47.245109 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81b433-9853-4e20-9bf1-8a1e666e40c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:47.245109 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81b433-9853-4e20-9bf1-8a1e666e40c3 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:47.245567 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1125/2265] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:18:47.247694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde90c2-05d9-4f15-af1b-b70dcf0349e9 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:47.259315 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde90c2-05d9-4f15-af1b-b70dcf0349e9 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:47.262066 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1141/2266] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:47.265554 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80b456-2939-48bd-9c54-f38b23882030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:47.266312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80b456-2939-48bd-9c54-f38b23882030 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:47.266500 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80b456-2939-48bd-9c54-f38b23882030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:47.266799 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80b456-2939-48bd-9c54-f38b23882030 admin admin] PATH_INFO: `/v3/projects/a626c78db5124b46b9f39d103df9cd0b/users/6432b875dd0142038574881ae8032d88/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:47.286504 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80b456-2939-48bd-9c54-f38b23882030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a626c78db5124b46b9f39d103df9cd0b, user_id=6432b875dd0142038574881ae8032d88, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:47.289241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80b456-2939-48bd-9c54-f38b23882030 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:47.315515 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1126/2267] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:47 2022] PUT /identity/v3/projects/a626c78db5124b46b9f39d103df9cd0b/users/6432b875dd0142038574881ae8032d88/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:47.320845 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf95082-6c0a-4890-aa08-ed2595f0e33a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:47.321095 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf95082-6c0a-4890-aa08-ed2595f0e33a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:47.321331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf95082-6c0a-4890-aa08-ed2595f0e33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:47.353544 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-cbf95082-6c0a-4890-aa08-ed2595f0e33a None None] MFA Rules not processed for user `6432b875dd0142038574881ae8032d88`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:47.354776 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-cbf95082-6c0a-4890-aa08-ed2595f0e33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:47.375706 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eac37e-8ff7-422a-b378-769bb31d66ce None None] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:47.375706 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eac37e-8ff7-422a-b378-769bb31d66ce None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:47.375706 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eac37e-8ff7-422a-b378-769bb31d66ce None None] PATH_INFO: `/` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:47.377049 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1127/2268] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 24 13:18:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:18:47.382836 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c9a3a-61a1-4adc-80d0-2940ba1b667c None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:47.383333 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c9a3a-61a1-4adc-80d0-2940ba1b667c None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:47.383897 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c9a3a-61a1-4adc-80d0-2940ba1b667c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:47.408528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-546c9a3a-61a1-4adc-80d0-2940ba1b667c None None] MFA Rules not processed for user `4f6b27c7d052437a949a371169fb48ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:47.410342 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-546c9a3a-61a1-4adc-80d0-2940ba1b667c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:47.423592 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:47.434548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1142/2269] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:18:47.438477 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf95082-6c0a-4890-aa08-ed2595f0e33a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:47.496487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1128/2270] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 24 13:18:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:18:47.510251 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c9a3a-61a1-4adc-80d0-2940ba1b667c None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:47.524791 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf95082-6c0a-4890-aa08-ed2595f0e33a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:47.529655 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beeaf96-865e-4f97-a8eb-fbcc2c3e6d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:47.530642 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeaf96-865e-4f97-a8eb-fbcc2c3e6d0d admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:47.530990 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeaf96-865e-4f97-a8eb-fbcc2c3e6d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:47.531197 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeaf96-865e-4f97-a8eb-fbcc2c3e6d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:47.531963 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beeaf96-865e-4f97-a8eb-fbcc2c3e6d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:47.533877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beeaf96-865e-4f97-a8eb-fbcc2c3e6d0d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:47.576284 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c9a3a-61a1-4adc-80d0-2940ba1b667c None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:47.580941 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1143/2271] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:47 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:18:47.581111 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae4a0c-8d40-460d-a731-4930e475d8d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:47.581709 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae4a0c-8d40-460d-a731-4930e475d8d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:47.581982 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae4a0c-8d40-460d-a731-4930e475d8d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:47.582246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae4a0c-8d40-460d-a731-4930e475d8d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:47.584503 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beeaf96-865e-4f97-a8eb-fbcc2c3e6d0d admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:47.593653 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae4a0c-8d40-460d-a731-4930e475d8d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:47.595237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae4a0c-8d40-460d-a731-4930e475d8d8 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:47.607242 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1129/2272] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:47.669248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beeaf96-865e-4f97-a8eb-fbcc2c3e6d0d admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:47.675286 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8c435-fdc6-4a28-988e-b18b1bd4d55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:47.675786 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8c435-fdc6-4a28-988e-b18b1bd4d55f admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:47.676063 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8c435-fdc6-4a28-988e-b18b1bd4d55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:47.676625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8c435-fdc6-4a28-988e-b18b1bd4d55f admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:47.679492 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8c435-fdc6-4a28-988e-b18b1bd4d55f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:47.683098 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8c435-fdc6-4a28-988e-b18b1bd4d55f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:47.735199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1144/2273] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:47 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:47.736532 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae4a0c-8d40-460d-a731-4930e475d8d8 service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:47.755833 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae4a0c-8d40-460d-a731-4930e475d8d8 service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:47.762444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83890ed2-1084-4275-9e75-2970f1b285b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:47.764325 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83890ed2-1084-4275-9e75-2970f1b285b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:47.764903 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83890ed2-1084-4275-9e75-2970f1b285b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:47.765329 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83890ed2-1084-4275-9e75-2970f1b285b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:47.766263 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83890ed2-1084-4275-9e75-2970f1b285b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:47.768381 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83890ed2-1084-4275-9e75-2970f1b285b1 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:47.786978 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8c435-fdc6-4a28-988e-b18b1bd4d55f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:47.788206 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1130/2274] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:47.809614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8c435-fdc6-4a28-988e-b18b1bd4d55f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:47.835579 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577aff8-9d77-42fc-9848-e94ab5329517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:47.836375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577aff8-9d77-42fc-9848-e94ab5329517 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:47.838665 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577aff8-9d77-42fc-9848-e94ab5329517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:47.839295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577aff8-9d77-42fc-9848-e94ab5329517 admin admin] PATH_INFO: `/v3/projects/24a434440b794d44b8ed7dbedbce0e05/users/7b1f9816d8fd4c5f9b12b7149052b81f/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:47.872739 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577aff8-9d77-42fc-9848-e94ab5329517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a434440b794d44b8ed7dbedbce0e05, user_id=7b1f9816d8fd4c5f9b12b7149052b81f, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:47.878109 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577aff8-9d77-42fc-9848-e94ab5329517 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:47.899175 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1145/2275] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:47 2022] PUT /identity/v3/projects/24a434440b794d44b8ed7dbedbce0e05/users/7b1f9816d8fd4c5f9b12b7149052b81f/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:18:47.902816 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83890ed2-1084-4275-9e75-2970f1b285b1 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:47.914032 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83890ed2-1084-4275-9e75-2970f1b285b1 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:47.927362 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:48.008272 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa912b-7451-4a8e-bfd9-ff5f1ccb28e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:48.008858 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa912b-7451-4a8e-bfd9-ff5f1ccb28e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:48.009134 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa912b-7451-4a8e-bfd9-ff5f1ccb28e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:48.009493 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa912b-7451-4a8e-bfd9-ff5f1ccb28e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:48.010006 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa912b-7451-4a8e-bfd9-ff5f1ccb28e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:48.011633 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa912b-7451-4a8e-bfd9-ff5f1ccb28e8 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:48.026030 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1131/2276] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:48.027167 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577aff8-9d77-42fc-9848-e94ab5329517 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:48.038785 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577aff8-9d77-42fc-9848-e94ab5329517 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:48.043914 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb8da8-38ca-432a-a634-210335a24368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:48.044631 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb8da8-38ca-432a-a634-210335a24368 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:48.044911 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb8da8-38ca-432a-a634-210335a24368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:48.045329 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb8da8-38ca-432a-a634-210335a24368 admin admin] PATH_INFO: `/v3/projects/24a434440b794d44b8ed7dbedbce0e05/users/7b1f9816d8fd4c5f9b12b7149052b81f/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:48.060578 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb8da8-38ca-432a-a634-210335a24368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a434440b794d44b8ed7dbedbce0e05, user_id=7b1f9816d8fd4c5f9b12b7149052b81f, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:48.064440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb8da8-38ca-432a-a634-210335a24368 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:48.076261 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1146/2277] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:48 2022] PUT /identity/v3/projects/24a434440b794d44b8ed7dbedbce0e05/users/7b1f9816d8fd4c5f9b12b7149052b81f/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:18:48.144023 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11c138-22e5-4ce4-a51d-15913a8f8143 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:48.144303 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11c138-22e5-4ce4-a51d-15913a8f8143 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:48.144569 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11c138-22e5-4ce4-a51d-15913a8f8143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:48.175468 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-8e11c138-22e5-4ce4-a51d-15913a8f8143 None None] MFA Rules not processed for user `7b1f9816d8fd4c5f9b12b7149052b81f`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:48.176776 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-8e11c138-22e5-4ce4-a51d-15913a8f8143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:48.244261 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1132/2278] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:48.255372 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb8da8-38ca-432a-a634-210335a24368 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:48.257245 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-65eb8da8-38ca-432a-a634-210335a24368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:48.297538 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:48.315739 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb8da8-38ca-432a-a634-210335a24368 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:48.319319 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2df171-9f44-4cc2-a830-d177b871df6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:48.319940 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2df171-9f44-4cc2-a830-d177b871df6c service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:48.320224 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2df171-9f44-4cc2-a830-d177b871df6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:48.320497 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2df171-9f44-4cc2-a830-d177b871df6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:48.383391 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2df171-9f44-4cc2-a830-d177b871df6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:48.384972 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2df171-9f44-4cc2-a830-d177b871df6c service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:48.395375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1147/2279] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:49.947114 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11c138-22e5-4ce4-a51d-15913a8f8143 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:49.948518 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-8e11c138-22e5-4ce4-a51d-15913a8f8143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:49.960360 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11c138-22e5-4ce4-a51d-15913a8f8143 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:49.964165 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761619c-1e98-424a-97b0-6822d149a5b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:49.964752 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761619c-1e98-424a-97b0-6822d149a5b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:49.965029 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761619c-1e98-424a-97b0-6822d149a5b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:49.965295 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761619c-1e98-424a-97b0-6822d149a5b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:50.022076 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761619c-1e98-424a-97b0-6822d149a5b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:50.023562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761619c-1e98-424a-97b0-6822d149a5b5 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:50.033215 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1133/2280] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:50.659945 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69601c-b293-4dde-a526-6fd180c22378 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:50.660420 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69601c-b293-4dde-a526-6fd180c22378 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:50.660506 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69601c-b293-4dde-a526-6fd180c22378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:50.681039 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-4b69601c-b293-4dde-a526-6fd180c22378 None None] MFA Rules not processed for user `f3254b4fddaa4f099c6c44f4c139ee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:50.682257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4b69601c-b293-4dde-a526-6fd180c22378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:50.702598 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761619c-1e98-424a-97b0-6822d149a5b5 service cinder] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:50.711136 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761619c-1e98-424a-97b0-6822d149a5b5 service cinder] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:50.716230 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da845526-216f-44ef-921e-c71c0668638a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:50.716832 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da845526-216f-44ef-921e-c71c0668638a service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:50.717112 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da845526-216f-44ef-921e-c71c0668638a service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:50.717426 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da845526-216f-44ef-921e-c71c0668638a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:50.741875 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da845526-216f-44ef-921e-c71c0668638a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:50.743337 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da845526-216f-44ef-921e-c71c0668638a service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:50.763962 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1148/2281] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 24 13:18:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:50.767219 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1134/2282] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:50.779840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69601c-b293-4dde-a526-6fd180c22378 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:50.781735 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4b69601c-b293-4dde-a526-6fd180c22378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:50.880182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69601c-b293-4dde-a526-6fd180c22378 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:50.885432 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88a6b2-30e9-4eb3-8c49-220b033b1367 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '768c71ab4ab241e4bfed9f7561ae3d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:50.886192 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88a6b2-30e9-4eb3-8c49-220b033b1367 service swift] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:50.886473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88a6b2-30e9-4eb3-8c49-220b033b1367 service swift] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:50.886814 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88a6b2-30e9-4eb3-8c49-220b033b1367 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:50.906616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88a6b2-30e9-4eb3-8c49-220b033b1367 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:50.908283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88a6b2-30e9-4eb3-8c49-220b033b1367 service swift] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:50.917750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1149/2283] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 24 13:18:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:18:54.831347 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da845526-216f-44ef-921e-c71c0668638a service cinder] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:54.857928 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:54.902629 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da845526-216f-44ef-921e-c71c0668638a service cinder] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:54.908189 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384eb1a0-9e87-46ba-9c93-76e796adcb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:54.908812 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eb1a0-9e87-46ba-9c93-76e796adcb6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:54.909245 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eb1a0-9e87-46ba-9c93-76e796adcb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:54.909519 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eb1a0-9e87-46ba-9c93-76e796adcb6b admin admin] PATH_INFO: `/v3/users/12d441f0f4204c36808a2004b3fd97c8` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:54.910710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384eb1a0-9e87-46ba-9c93-76e796adcb6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=12d441f0f4204c36808a2004b3fd97c8)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:54.912718 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384eb1a0-9e87-46ba-9c93-76e796adcb6b admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:54.966912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-384eb1a0-9e87-46ba-9c93-76e796adcb6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12d441f0f4204c36808a2004b3fd97c8'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:54.975370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-384eb1a0-9e87-46ba-9c93-76e796adcb6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12d441f0f4204c36808a2004b3fd97c8'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:54.985469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-384eb1a0-9e87-46ba-9c93-76e796adcb6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12d441f0f4204c36808a2004b3fd97c8'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:55.002632 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-384eb1a0-9e87-46ba-9c93-76e796adcb6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12d441f0f4204c36808a2004b3fd97c8'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:55.003479 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-384eb1a0-9e87-46ba-9c93-76e796adcb6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12d441f0f4204c36808a2004b3fd97c8'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:55.009750 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1135/2284] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:54 2022] DELETE /identity/v3/users/12d441f0f4204c36808a2004b3fd97c8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:55.014038 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b49d4c-0861-4702-8cf5-8ca7d7062ece None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:55.014528 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b49d4c-0861-4702-8cf5-8ca7d7062ece None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:55.014712 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b49d4c-0861-4702-8cf5-8ca7d7062ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:55.035380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-c1b49d4c-0861-4702-8cf5-8ca7d7062ece None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:55.036604 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c1b49d4c-0861-4702-8cf5-8ca7d7062ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:55.055771 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:55.099452 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1150/2285] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:55.109113 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384eb1a0-9e87-46ba-9c93-76e796adcb6b admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:55.110690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-384eb1a0-9e87-46ba-9c93-76e796adcb6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:55.184475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384eb1a0-9e87-46ba-9c93-76e796adcb6b admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:55.189621 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3d5eb-d956-4b33-b500-7bc153b06497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:55.190246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3d5eb-d956-4b33-b500-7bc153b06497 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:55.190524 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3d5eb-d956-4b33-b500-7bc153b06497 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:55.190797 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3d5eb-d956-4b33-b500-7bc153b06497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:55.200686 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3d5eb-d956-4b33-b500-7bc153b06497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:55.202149 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3d5eb-d956-4b33-b500-7bc153b06497 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:55.213238 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1136/2286] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:55.574395 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b49d4c-0861-4702-8cf5-8ca7d7062ece None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:55.576084 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c1b49d4c-0861-4702-8cf5-8ca7d7062ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:55.597106 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b49d4c-0861-4702-8cf5-8ca7d7062ece None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:55.602082 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e3088-c7e0-4cc6-9d64-0f5a4d4791bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:55.603327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e3088-c7e0-4cc6-9d64-0f5a4d4791bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:55.603327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e3088-c7e0-4cc6-9d64-0f5a4d4791bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:55.603327 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e3088-c7e0-4cc6-9d64-0f5a4d4791bd admin admin] PATH_INFO: `/v3/projects/2e09c3f9736a4429bec86b9f068d6015` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:55.604606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e3088-c7e0-4cc6-9d64-0f5a4d4791bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e09c3f9736a4429bec86b9f068d6015)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:55.606513 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e3088-c7e0-4cc6-9d64-0f5a4d4791bd admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:55.692054 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0e7e3088-c7e0-4cc6-9d64-0f5a4d4791bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e09c3f9736a4429bec86b9f068d6015', 'request_id': 'req-0e7e3088-c7e0-4cc6-9d64-0f5a4d4791bd'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:55.705989 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0e7e3088-c7e0-4cc6-9d64-0f5a4d4791bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e09c3f9736a4429bec86b9f068d6015', 'request_id': 'req-0e7e3088-c7e0-4cc6-9d64-0f5a4d4791bd'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:55.719570 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0e7e3088-c7e0-4cc6-9d64-0f5a4d4791bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e09c3f9736a4429bec86b9f068d6015', 'request_id': 'req-0e7e3088-c7e0-4cc6-9d64-0f5a4d4791bd'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:55.732509 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0e7e3088-c7e0-4cc6-9d64-0f5a4d4791bd admin admin] The token cache is being invalidate because project 2e09c3f9736a4429bec86b9f068d6015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:55.732832 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0e7e3088-c7e0-4cc6-9d64-0f5a4d4791bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:55.733541 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0e7e3088-c7e0-4cc6-9d64-0f5a4d4791bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:55.735980 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1151/2287] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:55 2022] DELETE /identity/v3/projects/2e09c3f9736a4429bec86b9f068d6015 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:55.739910 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3d5eb-d956-4b33-b500-7bc153b06497 service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:55.754212 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3d5eb-d956-4b33-b500-7bc153b06497 service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:55.833974 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:55.855376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12354e-0730-4129-bd96-505815a7d8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:55.856045 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12354e-0730-4129-bd96-505815a7d8f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:55.856330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12354e-0730-4129-bd96-505815a7d8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:55.856656 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12354e-0730-4129-bd96-505815a7d8f8 admin admin] PATH_INFO: `/v3/users/6432b875dd0142038574881ae8032d88` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:55.857741 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12354e-0730-4129-bd96-505815a7d8f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6432b875dd0142038574881ae8032d88)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:55.859852 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12354e-0730-4129-bd96-505815a7d8f8 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:55.940693 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2a12354e-0730-4129-bd96-505815a7d8f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6432b875dd0142038574881ae8032d88'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:55.948465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2a12354e-0730-4129-bd96-505815a7d8f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6432b875dd0142038574881ae8032d88'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:55.956538 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2a12354e-0730-4129-bd96-505815a7d8f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6432b875dd0142038574881ae8032d88'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:55.971168 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2a12354e-0730-4129-bd96-505815a7d8f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6432b875dd0142038574881ae8032d88'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:55.972081 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2a12354e-0730-4129-bd96-505815a7d8f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6432b875dd0142038574881ae8032d88'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:55.978494 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1137/2288] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:55 2022] DELETE /identity/v3/users/6432b875dd0142038574881ae8032d88 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:56.551912 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e3088-c7e0-4cc6-9d64-0f5a4d4791bd admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:56.553475 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0e7e3088-c7e0-4cc6-9d64-0f5a4d4791bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:56.572153 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e3088-c7e0-4cc6-9d64-0f5a4d4791bd admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:56.666384 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463e632-d855-4d1b-adbe-f8249b2c5927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:56.667152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463e632-d855-4d1b-adbe-f8249b2c5927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:56.668041 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463e632-d855-4d1b-adbe-f8249b2c5927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:56.668041 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463e632-d855-4d1b-adbe-f8249b2c5927 admin admin] PATH_INFO: `/v3/projects/a626c78db5124b46b9f39d103df9cd0b` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:56.672391 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463e632-d855-4d1b-adbe-f8249b2c5927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a626c78db5124b46b9f39d103df9cd0b)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:56.674587 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463e632-d855-4d1b-adbe-f8249b2c5927 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:56.741489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1463e632-d855-4d1b-adbe-f8249b2c5927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a626c78db5124b46b9f39d103df9cd0b', 'request_id': 'req-1463e632-d855-4d1b-adbe-f8249b2c5927'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:56.743732 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:56.751784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1463e632-d855-4d1b-adbe-f8249b2c5927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a626c78db5124b46b9f39d103df9cd0b', 'request_id': 'req-1463e632-d855-4d1b-adbe-f8249b2c5927'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:56.759169 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1463e632-d855-4d1b-adbe-f8249b2c5927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a626c78db5124b46b9f39d103df9cd0b', 'request_id': 'req-1463e632-d855-4d1b-adbe-f8249b2c5927'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:56.771930 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1463e632-d855-4d1b-adbe-f8249b2c5927 admin admin] The token cache is being invalidate because project a626c78db5124b46b9f39d103df9cd0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:56.772227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1463e632-d855-4d1b-adbe-f8249b2c5927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:56.772884 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1463e632-d855-4d1b-adbe-f8249b2c5927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:56.774387 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1152/2289] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:56 2022] DELETE /identity/v3/projects/a626c78db5124b46b9f39d103df9cd0b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:56.778636 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12354e-0730-4129-bd96-505815a7d8f8 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:56.780150 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-2a12354e-0730-4129-bd96-505815a7d8f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:56.794974 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12354e-0730-4129-bd96-505815a7d8f8 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:56.861345 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d8cc4-1eb4-4990-900a-5302d0824632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:56.862079 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d8cc4-1eb4-4990-900a-5302d0824632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:56.862295 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d8cc4-1eb4-4990-900a-5302d0824632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:56.862555 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d8cc4-1eb4-4990-900a-5302d0824632 admin admin] PATH_INFO: `/v3/users/7b1f9816d8fd4c5f9b12b7149052b81f` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:56.863716 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d8cc4-1eb4-4990-900a-5302d0824632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b1f9816d8fd4c5f9b12b7149052b81f)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:56.865648 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d8cc4-1eb4-4990-900a-5302d0824632 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:56.925530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8e2d8cc4-1eb4-4990-900a-5302d0824632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b1f9816d8fd4c5f9b12b7149052b81f'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:56.933713 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8e2d8cc4-1eb4-4990-900a-5302d0824632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b1f9816d8fd4c5f9b12b7149052b81f'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:56.956890 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8e2d8cc4-1eb4-4990-900a-5302d0824632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b1f9816d8fd4c5f9b12b7149052b81f'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:56.960296 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:56.974945 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8e2d8cc4-1eb4-4990-900a-5302d0824632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b1f9816d8fd4c5f9b12b7149052b81f'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:56.976471 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8e2d8cc4-1eb4-4990-900a-5302d0824632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b1f9816d8fd4c5f9b12b7149052b81f'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:56.984183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1138/2290] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:56 2022] DELETE /identity/v3/users/7b1f9816d8fd4c5f9b12b7149052b81f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:57.376417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463e632-d855-4d1b-adbe-f8249b2c5927 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:57.378121 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1463e632-d855-4d1b-adbe-f8249b2c5927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:57.401055 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463e632-d855-4d1b-adbe-f8249b2c5927 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:57.486364 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ddf94-b62e-4c6c-9eae-6c3fa562cee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:57.487005 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ddf94-b62e-4c6c-9eae-6c3fa562cee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:57.487283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ddf94-b62e-4c6c-9eae-6c3fa562cee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:57.487583 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ddf94-b62e-4c6c-9eae-6c3fa562cee8 admin admin] PATH_INFO: `/v3/projects/24a434440b794d44b8ed7dbedbce0e05` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:57.488722 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ddf94-b62e-4c6c-9eae-6c3fa562cee8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24a434440b794d44b8ed7dbedbce0e05)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:57.490650 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ddf94-b62e-4c6c-9eae-6c3fa562cee8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:57.557228 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8f2ddf94-b62e-4c6c-9eae-6c3fa562cee8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24a434440b794d44b8ed7dbedbce0e05', 'request_id': 'req-8f2ddf94-b62e-4c6c-9eae-6c3fa562cee8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:57.564739 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8f2ddf94-b62e-4c6c-9eae-6c3fa562cee8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24a434440b794d44b8ed7dbedbce0e05', 'request_id': 'req-8f2ddf94-b62e-4c6c-9eae-6c3fa562cee8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:57.570461 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8f2ddf94-b62e-4c6c-9eae-6c3fa562cee8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24a434440b794d44b8ed7dbedbce0e05', 'request_id': 'req-8f2ddf94-b62e-4c6c-9eae-6c3fa562cee8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:57.584141 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8f2ddf94-b62e-4c6c-9eae-6c3fa562cee8 admin admin] The token cache is being invalidate because project 24a434440b794d44b8ed7dbedbce0e05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:57.584438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8f2ddf94-b62e-4c6c-9eae-6c3fa562cee8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:57.585257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8f2ddf94-b62e-4c6c-9eae-6c3fa562cee8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:57.588702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1153/2291] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:57 2022] DELETE /identity/v3/projects/24a434440b794d44b8ed7dbedbce0e05 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:57.595308 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9b290-e72a-4438-ba3f-39ee0353274e None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:57.595624 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9b290-e72a-4438-ba3f-39ee0353274e None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:57.595892 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9b290-e72a-4438-ba3f-39ee0353274e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:57.617070 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-d9b9b290-e72a-4438-ba3f-39ee0353274e None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:57.618258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-d9b9b290-e72a-4438-ba3f-39ee0353274e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:57.695743 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1139/2292] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:18:57.700285 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde390b1-0a30-40d2-afc3-e44763b6ef04 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:57.701278 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde390b1-0a30-40d2-afc3-e44763b6ef04 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:57.702053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde390b1-0a30-40d2-afc3-e44763b6ef04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:57.724827 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-bde390b1-0a30-40d2-afc3-e44763b6ef04 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:57.726028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-bde390b1-0a30-40d2-afc3-e44763b6ef04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:57.736213 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1154/2293] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:57.740330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9b290-e72a-4438-ba3f-39ee0353274e None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:57.756582 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9b290-e72a-4438-ba3f-39ee0353274e None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:57.761290 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001598e3-0d96-428a-9f1b-77c86209f5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:57.761906 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001598e3-0d96-428a-9f1b-77c86209f5bc admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:57.762179 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001598e3-0d96-428a-9f1b-77c86209f5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:57.762446 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001598e3-0d96-428a-9f1b-77c86209f5bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:57.763085 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001598e3-0d96-428a-9f1b-77c86209f5bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:18:57.763388 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001598e3-0d96-428a-9f1b-77c86209f5bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:57.765017 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001598e3-0d96-428a-9f1b-77c86209f5bc admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:57.780832 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1140/2294] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:18:57.785658 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde390b1-0a30-40d2-afc3-e44763b6ef04 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:57.795830 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde390b1-0a30-40d2-afc3-e44763b6ef04 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:57.804361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ad3b9-5870-4ae8-bdb3-bfcd82c34e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:57.804982 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ad3b9-5870-4ae8-bdb3-bfcd82c34e49 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:57.805256 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ad3b9-5870-4ae8-bdb3-bfcd82c34e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:57.805522 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ad3b9-5870-4ae8-bdb3-bfcd82c34e49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:57.806160 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ad3b9-5870-4ae8-bdb3-bfcd82c34e49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:57.808109 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ad3b9-5870-4ae8-bdb3-bfcd82c34e49 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:57.848857 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1155/2295] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:57 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:57.853440 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001598e3-0d96-428a-9f1b-77c86209f5bc admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:57.867746 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001598e3-0d96-428a-9f1b-77c86209f5bc admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:57.953841 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e995e-d7d5-4e58-829b-32b18458c92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:57.954643 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e995e-d7d5-4e58-829b-32b18458c92f admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:57.954987 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e995e-d7d5-4e58-829b-32b18458c92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:57.955395 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e995e-d7d5-4e58-829b-32b18458c92f admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:57.956584 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e995e-d7d5-4e58-829b-32b18458c92f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:57.959168 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e995e-d7d5-4e58-829b-32b18458c92f admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:57.989621 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1141/2296] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:57 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:57.993789 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ad3b9-5870-4ae8-bdb3-bfcd82c34e49 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:58.006061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ad3b9-5870-4ae8-bdb3-bfcd82c34e49 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:58.012279 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca37f79-4044-4ba4-8c6d-1d2614e0f6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:58.012962 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca37f79-4044-4ba4-8c6d-1d2614e0f6da admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:58.013234 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca37f79-4044-4ba4-8c6d-1d2614e0f6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:58.013586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca37f79-4044-4ba4-8c6d-1d2614e0f6da admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:58.014371 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca37f79-4044-4ba4-8c6d-1d2614e0f6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:58.016903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca37f79-4044-4ba4-8c6d-1d2614e0f6da admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:58.027674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1156/2297] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:58.031941 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e995e-d7d5-4e58-829b-32b18458c92f admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:58.043034 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e995e-d7d5-4e58-829b-32b18458c92f admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:58.048707 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7101a0-fc54-4ee5-b66f-208b2dfe88b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:58.049248 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7101a0-fc54-4ee5-b66f-208b2dfe88b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:58.049529 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7101a0-fc54-4ee5-b66f-208b2dfe88b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:58.049817 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7101a0-fc54-4ee5-b66f-208b2dfe88b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:58.050435 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7101a0-fc54-4ee5-b66f-208b2dfe88b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:58.052091 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7101a0-fc54-4ee5-b66f-208b2dfe88b2 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:58.065346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1142/2298] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:58.069678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca37f79-4044-4ba4-8c6d-1d2614e0f6da admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:58.079984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca37f79-4044-4ba4-8c6d-1d2614e0f6da admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:58.086218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109a2f8-112f-42b7-99d4-fc5fe71f1ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:58.086919 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109a2f8-112f-42b7-99d4-fc5fe71f1ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:58.087195 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109a2f8-112f-42b7-99d4-fc5fe71f1ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:58.087505 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109a2f8-112f-42b7-99d4-fc5fe71f1ca7 admin admin] PATH_INFO: `/v3/projects/f6d8cd467b5a40059ee4058cadc54330/users/3900381226f5403da509d89d4a3cd681/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:58.105052 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109a2f8-112f-42b7-99d4-fc5fe71f1ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d8cd467b5a40059ee4058cadc54330, user_id=3900381226f5403da509d89d4a3cd681, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:58.108139 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109a2f8-112f-42b7-99d4-fc5fe71f1ca7 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:58.124764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1157/2299] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:58 2022] PUT /identity/v3/projects/f6d8cd467b5a40059ee4058cadc54330/users/3900381226f5403da509d89d4a3cd681/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:58.137216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a29372-4030-4cd5-aed8-680ee0f09bb5 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:58.137334 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a29372-4030-4cd5-aed8-680ee0f09bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:58.137557 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a29372-4030-4cd5-aed8-680ee0f09bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:58.176704 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-f0a29372-4030-4cd5-aed8-680ee0f09bb5 None None] MFA Rules not processed for user `3900381226f5403da509d89d4a3cd681`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:58.177943 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f0a29372-4030-4cd5-aed8-680ee0f09bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:58.244665 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:58.280823 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1143/2300] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:18:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:58.292766 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109a2f8-112f-42b7-99d4-fc5fe71f1ca7 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:58.294900 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0109a2f8-112f-42b7-99d4-fc5fe71f1ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:58.302596 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:58.373083 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109a2f8-112f-42b7-99d4-fc5fe71f1ca7 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:58.377308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83eed98-ebe6-4224-8ddf-caec35ca4ab7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:58.377915 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83eed98-ebe6-4224-8ddf-caec35ca4ab7 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:58.378611 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83eed98-ebe6-4224-8ddf-caec35ca4ab7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:58.378897 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83eed98-ebe6-4224-8ddf-caec35ca4ab7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:58.389973 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83eed98-ebe6-4224-8ddf-caec35ca4ab7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:58.392453 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83eed98-ebe6-4224-8ddf-caec35ca4ab7 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:58.406715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1158/2301] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:19:00.989218 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a29372-4030-4cd5-aed8-680ee0f09bb5 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:01.051724 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a29372-4030-4cd5-aed8-680ee0f09bb5 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:01.056143 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c9a21-fdad-443e-b7b3-24efa1be998a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:01.056757 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c9a21-fdad-443e-b7b3-24efa1be998a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:01.057034 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c9a21-fdad-443e-b7b3-24efa1be998a admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:01.057303 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c9a21-fdad-443e-b7b3-24efa1be998a admin admin] PATH_INFO: `/v3/users/3900381226f5403da509d89d4a3cd681` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:01.058394 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c9a21-fdad-443e-b7b3-24efa1be998a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3900381226f5403da509d89d4a3cd681)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:01.060395 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c9a21-fdad-443e-b7b3-24efa1be998a admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:01.105901 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-765c9a21-fdad-443e-b7b3-24efa1be998a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3900381226f5403da509d89d4a3cd681'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.113427 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-765c9a21-fdad-443e-b7b3-24efa1be998a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3900381226f5403da509d89d4a3cd681'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.120559 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-765c9a21-fdad-443e-b7b3-24efa1be998a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3900381226f5403da509d89d4a3cd681'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.133309 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-765c9a21-fdad-443e-b7b3-24efa1be998a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3900381226f5403da509d89d4a3cd681'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.133940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-765c9a21-fdad-443e-b7b3-24efa1be998a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3900381226f5403da509d89d4a3cd681'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.139866 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1144/2302] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:19:00 2022] DELETE /identity/v3/users/3900381226f5403da509d89d4a3cd681 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:01.144451 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21ff20-ca9d-4940-b348-881c5c64673a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:01.144953 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21ff20-ca9d-4940-b348-881c5c64673a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:01.145060 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21ff20-ca9d-4940-b348-881c5c64673a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:01.163714 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-2e21ff20-ca9d-4940-b348-881c5c64673a None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:01.164889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2e21ff20-ca9d-4940-b348-881c5c64673a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:01.222029 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1159/2303] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:01.231701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c9a21-fdad-443e-b7b3-24efa1be998a admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:01.233087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-765c9a21-fdad-443e-b7b3-24efa1be998a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:01.290648 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c9a21-fdad-443e-b7b3-24efa1be998a admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:01.294286 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ea268-2140-411f-bffe-bbbafccb45ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:01.294912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ea268-2140-411f-bffe-bbbafccb45ac service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:01.295190 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ea268-2140-411f-bffe-bbbafccb45ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:01.295486 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ea268-2140-411f-bffe-bbbafccb45ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:01.305699 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ea268-2140-411f-bffe-bbbafccb45ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:01.307174 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ea268-2140-411f-bffe-bbbafccb45ac service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:01.312953 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:01.318376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1145/2304] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:01.606931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21ff20-ca9d-4940-b348-881c5c64673a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:01.607544 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2e21ff20-ca9d-4940-b348-881c5c64673a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:01.621107 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21ff20-ca9d-4940-b348-881c5c64673a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:01.627547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8da5a-3bb4-4e30-a64e-58cfbe0db85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:01.628307 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8da5a-3bb4-4e30-a64e-58cfbe0db85f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:01.628509 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8da5a-3bb4-4e30-a64e-58cfbe0db85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:01.628767 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8da5a-3bb4-4e30-a64e-58cfbe0db85f admin admin] PATH_INFO: `/v3/projects/f6d8cd467b5a40059ee4058cadc54330` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:01.630451 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8da5a-3bb4-4e30-a64e-58cfbe0db85f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6d8cd467b5a40059ee4058cadc54330)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:01.632734 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8da5a-3bb4-4e30-a64e-58cfbe0db85f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:01.682047 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-f7f8da5a-3bb4-4e30-a64e-58cfbe0db85f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6d8cd467b5a40059ee4058cadc54330', 'request_id': 'req-f7f8da5a-3bb4-4e30-a64e-58cfbe0db85f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.690659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-f7f8da5a-3bb4-4e30-a64e-58cfbe0db85f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6d8cd467b5a40059ee4058cadc54330', 'request_id': 'req-f7f8da5a-3bb4-4e30-a64e-58cfbe0db85f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.696337 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-f7f8da5a-3bb4-4e30-a64e-58cfbe0db85f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6d8cd467b5a40059ee4058cadc54330', 'request_id': 'req-f7f8da5a-3bb4-4e30-a64e-58cfbe0db85f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.708080 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-f7f8da5a-3bb4-4e30-a64e-58cfbe0db85f admin admin] The token cache is being invalidate because project f6d8cd467b5a40059ee4058cadc54330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:19:01.708364 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-f7f8da5a-3bb4-4e30-a64e-58cfbe0db85f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.709000 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-f7f8da5a-3bb4-4e30-a64e-58cfbe0db85f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.710476 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1160/2305] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:19:01 2022] DELETE /identity/v3/projects/f6d8cd467b5a40059ee4058cadc54330 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:02.357864 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ea268-2140-411f-bffe-bbbafccb45ac service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:02.361586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-857ea268-2140-411f-bffe-bbbafccb45ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:02.453884 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ea268-2140-411f-bffe-bbbafccb45ac service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:02.556597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04e3cf-5171-4a6a-99a5-340494e171a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:02.557211 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04e3cf-5171-4a6a-99a5-340494e171a7 service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:02.557801 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04e3cf-5171-4a6a-99a5-340494e171a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:02.558166 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04e3cf-5171-4a6a-99a5-340494e171a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:02.559973 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-5d04e3cf-5171-4a6a-99a5-340494e171a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:02.626805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04e3cf-5171-4a6a-99a5-340494e171a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:02.633603 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04e3cf-5171-4a6a-99a5-340494e171a7 service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:02.649797 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1146/2306] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:05.409543 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8da5a-3bb4-4e30-a64e-58cfbe0db85f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:05.410975 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f7f8da5a-3bb4-4e30-a64e-58cfbe0db85f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:05.428615 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8da5a-3bb4-4e30-a64e-58cfbe0db85f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:05.434294 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b596fb8-b59e-4038-9dfb-109d494999ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:05.434896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b596fb8-b59e-4038-9dfb-109d494999ad service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:05.435329 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b596fb8-b59e-4038-9dfb-109d494999ad service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:05.435635 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b596fb8-b59e-4038-9dfb-109d494999ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:05.437888 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0b596fb8-b59e-4038-9dfb-109d494999ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:05.450254 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b596fb8-b59e-4038-9dfb-109d494999ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:05.451931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b596fb8-b59e-4038-9dfb-109d494999ad service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:05.463489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1161/2307] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:06.788682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f21a18-3854-4daf-b103-5b7b9767abd8 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:06.789144 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f21a18-3854-4daf-b103-5b7b9767abd8 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:06.789244 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f21a18-3854-4daf-b103-5b7b9767abd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:06.808793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-f0f21a18-3854-4daf-b103-5b7b9767abd8 None None] MFA Rules not processed for user `f3254b4fddaa4f099c6c44f4c139ee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:06.809973 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f0f21a18-3854-4daf-b103-5b7b9767abd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:06.863353 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1147/2308] 10.222.0.18 () {58 vars in 967 bytes} [Mon Oct 24 13:19:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:06.875518 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b596fb8-b59e-4038-9dfb-109d494999ad service nova] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:06.876923 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0b596fb8-b59e-4038-9dfb-109d494999ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:06.896742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:06.946937 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b596fb8-b59e-4038-9dfb-109d494999ad service nova] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:06.951901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a535da5-8068-4f14-8894-db6a10893e30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '768c71ab4ab241e4bfed9f7561ae3d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:06.952496 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a535da5-8068-4f14-8894-db6a10893e30 service swift] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:06.952781 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a535da5-8068-4f14-8894-db6a10893e30 service swift] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:06.953626 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a535da5-8068-4f14-8894-db6a10893e30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:06.961720 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a535da5-8068-4f14-8894-db6a10893e30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:06.963304 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a535da5-8068-4f14-8894-db6a10893e30 service swift] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:06.972249 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1162/2309] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 24 13:19:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:19:07.407342 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f21a18-3854-4daf-b103-5b7b9767abd8 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:07.408790 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f0f21a18-3854-4daf-b103-5b7b9767abd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:07.442594 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:07.471301 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f21a18-3854-4daf-b103-5b7b9767abd8 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:07.475341 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97655ee0-86b0-4c4f-92b3-121ec7af9e12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:07.475648 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97655ee0-86b0-4c4f-92b3-121ec7af9e12 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:07.475947 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97655ee0-86b0-4c4f-92b3-121ec7af9e12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:07.476343 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97655ee0-86b0-4c4f-92b3-121ec7af9e12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:07.478086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-97655ee0-86b0-4c4f-92b3-121ec7af9e12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:07.548806 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97655ee0-86b0-4c4f-92b3-121ec7af9e12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:07.550300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97655ee0-86b0-4c4f-92b3-121ec7af9e12 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:07.560296 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1148/2310] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:10.757502 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a535da5-8068-4f14-8894-db6a10893e30 service swift] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:10.760060 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6a535da5-8068-4f14-8894-db6a10893e30 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:10.829251 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97655ee0-86b0-4c4f-92b3-121ec7af9e12 service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:10.830743 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-97655ee0-86b0-4c4f-92b3-121ec7af9e12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:10.844955 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97655ee0-86b0-4c4f-92b3-121ec7af9e12 service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:10.850658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f45833-856d-4aa1-9dae-19eecba93323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:10.851369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f45833-856d-4aa1-9dae-19eecba93323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:10.851731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f45833-856d-4aa1-9dae-19eecba93323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:10.852061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f45833-856d-4aa1-9dae-19eecba93323 admin admin] PATH_INFO: `/v3/users/3b52c3ae1fff462899aa156fe978b03b` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:10.853521 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f45833-856d-4aa1-9dae-19eecba93323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b52c3ae1fff462899aa156fe978b03b)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:10.855704 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f45833-856d-4aa1-9dae-19eecba93323 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:10.860399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a535da5-8068-4f14-8894-db6a10893e30 service swift] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:10.867156 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4d84c-8ccf-4441-85bf-698af5c86a31 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b3ca8694ab4a169a3c36561290d8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:10.868290 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4d84c-8ccf-4441-85bf-698af5c86a31 service placement] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:10.868638 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4d84c-8ccf-4441-85bf-698af5c86a31 service placement] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:10.869043 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4d84c-8ccf-4441-85bf-698af5c86a31 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:10.871280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c8d4d84c-8ccf-4441-85bf-698af5c86a31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:10.887064 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4d84c-8ccf-4441-85bf-698af5c86a31 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:10.888830 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4d84c-8ccf-4441-85bf-698af5c86a31 service placement] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:10.901379 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1163/2311] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:19:10.921403 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-87f45833-856d-4aa1-9dae-19eecba93323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b52c3ae1fff462899aa156fe978b03b'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:10.929820 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-87f45833-856d-4aa1-9dae-19eecba93323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b52c3ae1fff462899aa156fe978b03b'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:10.938162 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-87f45833-856d-4aa1-9dae-19eecba93323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b52c3ae1fff462899aa156fe978b03b'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:10.950657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-87f45833-856d-4aa1-9dae-19eecba93323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b52c3ae1fff462899aa156fe978b03b'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:10.951328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-87f45833-856d-4aa1-9dae-19eecba93323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b52c3ae1fff462899aa156fe978b03b'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:10.957341 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1149/2312] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:19:10 2022] DELETE /identity/v3/users/3b52c3ae1fff462899aa156fe978b03b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:19:11.135141 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4d84c-8ccf-4441-85bf-698af5c86a31 service placement] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:11.146644 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4d84c-8ccf-4441-85bf-698af5c86a31 service placement] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:11.204767 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a41f4e-e3ec-45eb-8023-49a9effb668a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:11.205398 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a41f4e-e3ec-45eb-8023-49a9effb668a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:11.205679 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a41f4e-e3ec-45eb-8023-49a9effb668a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:11.205952 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a41f4e-e3ec-45eb-8023-49a9effb668a admin admin] PATH_INFO: `/v3/projects/22c3f6f010f949409d1767ac551eefec` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:11.207056 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a41f4e-e3ec-45eb-8023-49a9effb668a admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c3f6f010f949409d1767ac551eefec)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:11.209013 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a41f4e-e3ec-45eb-8023-49a9effb668a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:11.247152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:11.256079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-54a41f4e-e3ec-45eb-8023-49a9effb668a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c3f6f010f949409d1767ac551eefec', 'request_id': 'req-54a41f4e-e3ec-45eb-8023-49a9effb668a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:11.263302 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-54a41f4e-e3ec-45eb-8023-49a9effb668a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c3f6f010f949409d1767ac551eefec', 'request_id': 'req-54a41f4e-e3ec-45eb-8023-49a9effb668a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:11.269546 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-54a41f4e-e3ec-45eb-8023-49a9effb668a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c3f6f010f949409d1767ac551eefec', 'request_id': 'req-54a41f4e-e3ec-45eb-8023-49a9effb668a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:11.280270 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-54a41f4e-e3ec-45eb-8023-49a9effb668a admin admin] The token cache is being invalidate because project 22c3f6f010f949409d1767ac551eefec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:19:11.280556 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-54a41f4e-e3ec-45eb-8023-49a9effb668a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:11.281714 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-54a41f4e-e3ec-45eb-8023-49a9effb668a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:11.283349 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1164/2313] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:19:11 2022] DELETE /identity/v3/projects/22c3f6f010f949409d1767ac551eefec => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:19:11.288566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb0e7f-c3d3-4b07-9b2d-7214e66723a4 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:11.288856 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb0e7f-c3d3-4b07-9b2d-7214e66723a4 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:11.289131 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb0e7f-c3d3-4b07-9b2d-7214e66723a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:11.309183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-89cb0e7f-c3d3-4b07-9b2d-7214e66723a4 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:11.310378 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-89cb0e7f-c3d3-4b07-9b2d-7214e66723a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:11.354134 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:11.371251 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1150/2314] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:11.379076 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ceb4f0-9848-43cd-adf9-b240ced498a8 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:11.379358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ceb4f0-9848-43cd-adf9-b240ced498a8 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:11.379656 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ceb4f0-9848-43cd-adf9-b240ced498a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:11.398913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-36ceb4f0-9848-43cd-adf9-b240ced498a8 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:11.400154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-36ceb4f0-9848-43cd-adf9-b240ced498a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:11.408582 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1165/2315] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:11.412857 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb0e7f-c3d3-4b07-9b2d-7214e66723a4 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:11.423280 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb0e7f-c3d3-4b07-9b2d-7214e66723a4 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:11.427846 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0c865-e430-421b-86c5-c997822b69b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:11.428435 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0c865-e430-421b-86c5-c997822b69b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:11.428715 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0c865-e430-421b-86c5-c997822b69b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:11.428988 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0c865-e430-421b-86c5-c997822b69b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:11.429625 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0c865-e430-421b-86c5-c997822b69b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:19:11.429927 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0c865-e430-421b-86c5-c997822b69b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:11.431549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0c865-e430-421b-86c5-c997822b69b2 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:11.447145 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1151/2316] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:19:11.450077 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ceb4f0-9848-43cd-adf9-b240ced498a8 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:11.459462 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ceb4f0-9848-43cd-adf9-b240ced498a8 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:11.464024 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b66ce-ade1-4d86-a8e6-c2d5feb8c65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:11.464880 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b66ce-ade1-4d86-a8e6-c2d5feb8c65c admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:11.465152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b66ce-ade1-4d86-a8e6-c2d5feb8c65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:11.465415 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b66ce-ade1-4d86-a8e6-c2d5feb8c65c admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:11.466039 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b66ce-ade1-4d86-a8e6-c2d5feb8c65c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:11.467968 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b66ce-ade1-4d86-a8e6-c2d5feb8c65c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:11.495292 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1166/2317] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:19:11 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:19:11.499451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0c865-e430-421b-86c5-c997822b69b2 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:11.509447 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0c865-e430-421b-86c5-c997822b69b2 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:11.566355 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713c846-f128-469b-918c-66c4922bfd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:11.566954 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713c846-f128-469b-918c-66c4922bfd87 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:11.567227 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713c846-f128-469b-918c-66c4922bfd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:11.567527 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713c846-f128-469b-918c-66c4922bfd87 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:11.568155 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713c846-f128-469b-918c-66c4922bfd87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:11.570074 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713c846-f128-469b-918c-66c4922bfd87 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:11.592475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1152/2318] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:19:11 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:11.597618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b66ce-ade1-4d86-a8e6-c2d5feb8c65c admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:11.607681 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b66ce-ade1-4d86-a8e6-c2d5feb8c65c admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:11.612305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527f73e-bf0d-4093-8307-0c865e57b45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:11.612889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527f73e-bf0d-4093-8307-0c865e57b45a admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:11.613163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527f73e-bf0d-4093-8307-0c865e57b45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:11.613424 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527f73e-bf0d-4093-8307-0c865e57b45a admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:11.614048 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527f73e-bf0d-4093-8307-0c865e57b45a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:11.615657 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527f73e-bf0d-4093-8307-0c865e57b45a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:11.625193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1167/2319] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:11.628984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713c846-f128-469b-918c-66c4922bfd87 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:11.638615 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713c846-f128-469b-918c-66c4922bfd87 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:11.643763 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d79d2c-1a22-488b-bdef-055a49727f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:11.644338 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d79d2c-1a22-488b-bdef-055a49727f58 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:11.644629 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d79d2c-1a22-488b-bdef-055a49727f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:11.644874 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d79d2c-1a22-488b-bdef-055a49727f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:11.645492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d79d2c-1a22-488b-bdef-055a49727f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:11.647070 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d79d2c-1a22-488b-bdef-055a49727f58 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:11.658163 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1153/2320] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:11.662114 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527f73e-bf0d-4093-8307-0c865e57b45a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:11.672303 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527f73e-bf0d-4093-8307-0c865e57b45a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:11.677044 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033ecee-340d-440a-89c2-96fe2b9a7209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:11.677678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033ecee-340d-440a-89c2-96fe2b9a7209 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:11.677952 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033ecee-340d-440a-89c2-96fe2b9a7209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:11.678219 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033ecee-340d-440a-89c2-96fe2b9a7209 admin admin] PATH_INFO: `/v3/projects/efaae22424434860bdb911f07cc96f6f/users/448eb7f5ed5c46dea4be4628ffd0df51/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:11.693193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033ecee-340d-440a-89c2-96fe2b9a7209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efaae22424434860bdb911f07cc96f6f, user_id=448eb7f5ed5c46dea4be4628ffd0df51, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:11.695879 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033ecee-340d-440a-89c2-96fe2b9a7209 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:11.708799 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1168/2321] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:19:11 2022] PUT /identity/v3/projects/efaae22424434860bdb911f07cc96f6f/users/448eb7f5ed5c46dea4be4628ffd0df51/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:11.713904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bc8eb-e905-450c-9599-beeddaa5c60d None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:11.714164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bc8eb-e905-450c-9599-beeddaa5c60d None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:11.714436 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bc8eb-e905-450c-9599-beeddaa5c60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:11.733438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-878bc8eb-e905-450c-9599-beeddaa5c60d None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:11.735443 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-878bc8eb-e905-450c-9599-beeddaa5c60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:11.794492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1154/2322] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:11.805255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033ecee-340d-440a-89c2-96fe2b9a7209 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:11.807122 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f033ecee-340d-440a-89c2-96fe2b9a7209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:11.864846 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033ecee-340d-440a-89c2-96fe2b9a7209 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:11.868482 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea42a53-d735-4566-ad7b-e9e479892c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:11.869071 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea42a53-d735-4566-ad7b-e9e479892c75 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:11.869349 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea42a53-d735-4566-ad7b-e9e479892c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:11.869619 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea42a53-d735-4566-ad7b-e9e479892c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:11.878915 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea42a53-d735-4566-ad7b-e9e479892c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:11.880368 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea42a53-d735-4566-ad7b-e9e479892c75 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:11.889673 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1169/2323] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:15.901939 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bee3f-3589-4719-a6a7-98364950079d None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:15.902411 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bee3f-3589-4719-a6a7-98364950079d None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:15.902540 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bee3f-3589-4719-a6a7-98364950079d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:15.951279 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-f35bee3f-3589-4719-a6a7-98364950079d None None] MFA Rules not processed for user `448eb7f5ed5c46dea4be4628ffd0df51`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:15.952669 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f35bee3f-3589-4719-a6a7-98364950079d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:16.004225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:16.032995 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1155/2324] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:19:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:16.048648 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea42a53-d735-4566-ad7b-e9e479892c75 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:16.050161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6ea42a53-d735-4566-ad7b-e9e479892c75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:16.125995 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:16.130971 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea42a53-d735-4566-ad7b-e9e479892c75 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:16.138685 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00834b4f-0454-49f2-b8f7-67d3e84f7f02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:16.139306 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00834b4f-0454-49f2-b8f7-67d3e84f7f02 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:16.139616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00834b4f-0454-49f2-b8f7-67d3e84f7f02 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:16.139891 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00834b4f-0454-49f2-b8f7-67d3e84f7f02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:16.149213 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00834b4f-0454-49f2-b8f7-67d3e84f7f02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:16.150827 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00834b4f-0454-49f2-b8f7-67d3e84f7f02 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:16.161003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1170/2325] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:17.475576 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ecd45-6245-41e9-9566-97bcad8fe06d None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:17.476140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ecd45-6245-41e9-9566-97bcad8fe06d None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:17.476140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ecd45-6245-41e9-9566-97bcad8fe06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:17.495994 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-2d8ecd45-6245-41e9-9566-97bcad8fe06d None None] MFA Rules not processed for user `448eb7f5ed5c46dea4be4628ffd0df51`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:17.497294 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-2d8ecd45-6245-41e9-9566-97bcad8fe06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:17.504836 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1156/2326] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:19:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:26.156159 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:27.490386 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=9 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:28.706520 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00834b4f-0454-49f2-b8f7-67d3e84f7f02 service nova] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:28.718015 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00834b4f-0454-49f2-b8f7-67d3e84f7f02 service nova] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:28.723584 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d39ee8-0615-444c-bcca-5b19fb421962 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:28.724286 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d39ee8-0615-444c-bcca-5b19fb421962 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:28.724566 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d39ee8-0615-444c-bcca-5b19fb421962 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:28.724835 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d39ee8-0615-444c-bcca-5b19fb421962 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:28.726520 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-96d39ee8-0615-444c-bcca-5b19fb421962 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:28.739677 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d39ee8-0615-444c-bcca-5b19fb421962 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:28.741243 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d39ee8-0615-444c-bcca-5b19fb421962 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:28.753325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1171/2327] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:38.747249 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=6 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:48.032578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ecd45-6245-41e9-9566-97bcad8fe06d None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:48.034008 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-2d8ecd45-6245-41e9-9566-97bcad8fe06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:48.046427 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ecd45-6245-41e9-9566-97bcad8fe06d None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:48.050052 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b089b1-7a5d-4495-8968-7bf2aafe7649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:48.050639 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b089b1-7a5d-4495-8968-7bf2aafe7649 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:48.050912 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b089b1-7a5d-4495-8968-7bf2aafe7649 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:48.051181 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b089b1-7a5d-4495-8968-7bf2aafe7649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:48.052857 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f5b089b1-7a5d-4495-8968-7bf2aafe7649 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:48.064210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b089b1-7a5d-4495-8968-7bf2aafe7649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:48.065670 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b089b1-7a5d-4495-8968-7bf2aafe7649 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:48.075009 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1157/2328] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:51.183587 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d39ee8-0615-444c-bcca-5b19fb421962 service nova] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:51.185087 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-96d39ee8-0615-444c-bcca-5b19fb421962 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:51.238593 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b089b1-7a5d-4495-8968-7bf2aafe7649 service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:51.240151 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f5b089b1-7a5d-4495-8968-7bf2aafe7649 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:51.253773 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b089b1-7a5d-4495-8968-7bf2aafe7649 service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:51.258559 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cfb68-94c7-4642-8d05-9b372670175c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:51.259180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cfb68-94c7-4642-8d05-9b372670175c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:51.259484 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cfb68-94c7-4642-8d05-9b372670175c admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:51.259753 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cfb68-94c7-4642-8d05-9b372670175c admin admin] PATH_INFO: `/v3/users/2716cf78afb84caf866acd4d5526168c` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:51.261094 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087cfb68-94c7-4642-8d05-9b372670175c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2716cf78afb84caf866acd4d5526168c)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:51.263784 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087cfb68-94c7-4642-8d05-9b372670175c admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:51.266131 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d39ee8-0615-444c-bcca-5b19fb421962 service nova] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:51.271806 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db65b8-a657-4fea-9e69-bd2e981e67ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b3ca8694ab4a169a3c36561290d8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:51.272419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db65b8-a657-4fea-9e69-bd2e981e67ee service placement] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:51.272699 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db65b8-a657-4fea-9e69-bd2e981e67ee service placement] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:51.272969 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db65b8-a657-4fea-9e69-bd2e981e67ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:51.274689 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a7db65b8-a657-4fea-9e69-bd2e981e67ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:51.286662 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db65b8-a657-4fea-9e69-bd2e981e67ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:51.288323 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db65b8-a657-4fea-9e69-bd2e981e67ee service placement] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:51.298526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1172/2329] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:51.311883 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-087cfb68-94c7-4642-8d05-9b372670175c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2716cf78afb84caf866acd4d5526168c'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:51.320106 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-087cfb68-94c7-4642-8d05-9b372670175c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2716cf78afb84caf866acd4d5526168c'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:51.327932 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-087cfb68-94c7-4642-8d05-9b372670175c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2716cf78afb84caf866acd4d5526168c'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:51.341152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-087cfb68-94c7-4642-8d05-9b372670175c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2716cf78afb84caf866acd4d5526168c'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:51.341805 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-087cfb68-94c7-4642-8d05-9b372670175c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2716cf78afb84caf866acd4d5526168c'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:51.347580 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1158/2330] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:19:51 2022] DELETE /identity/v3/users/2716cf78afb84caf866acd4d5526168c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:51.527216 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db65b8-a657-4fea-9e69-bd2e981e67ee service placement] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:51.539908 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db65b8-a657-4fea-9e69-bd2e981e67ee service placement] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:51.598577 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d955a-e3b1-4537-b7c2-9ab707bd7838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:51.599205 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d955a-e3b1-4537-b7c2-9ab707bd7838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:51.599520 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d955a-e3b1-4537-b7c2-9ab707bd7838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:51.599798 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d955a-e3b1-4537-b7c2-9ab707bd7838 admin admin] PATH_INFO: `/v3/projects/ca3452d8e9034671b17c2bc15e4acb4d` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:51.600907 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d955a-e3b1-4537-b7c2-9ab707bd7838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca3452d8e9034671b17c2bc15e4acb4d)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:51.602814 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d955a-e3b1-4537-b7c2-9ab707bd7838 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:51.649999 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9a5d955a-e3b1-4537-b7c2-9ab707bd7838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca3452d8e9034671b17c2bc15e4acb4d', 'request_id': 'req-9a5d955a-e3b1-4537-b7c2-9ab707bd7838'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:51.657167 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9a5d955a-e3b1-4537-b7c2-9ab707bd7838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca3452d8e9034671b17c2bc15e4acb4d', 'request_id': 'req-9a5d955a-e3b1-4537-b7c2-9ab707bd7838'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:51.662706 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9a5d955a-e3b1-4537-b7c2-9ab707bd7838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca3452d8e9034671b17c2bc15e4acb4d', 'request_id': 'req-9a5d955a-e3b1-4537-b7c2-9ab707bd7838'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:51.673541 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9a5d955a-e3b1-4537-b7c2-9ab707bd7838 admin admin] The token cache is being invalidate because project ca3452d8e9034671b17c2bc15e4acb4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:19:51.673831 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9a5d955a-e3b1-4537-b7c2-9ab707bd7838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:51.674465 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9a5d955a-e3b1-4537-b7c2-9ab707bd7838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:51.676530 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1173/2331] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:19:51 2022] DELETE /identity/v3/projects/ca3452d8e9034671b17c2bc15e4acb4d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:51.681453 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1528fd9-b62e-49ea-a93f-edac202789b5 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:51.681743 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1528fd9-b62e-49ea-a93f-edac202789b5 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:51.682019 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1528fd9-b62e-49ea-a93f-edac202789b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:51.701891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-f1528fd9-b62e-49ea-a93f-edac202789b5 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:51.703082 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f1528fd9-b62e-49ea-a93f-edac202789b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:51.762187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1159/2332] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:51.770339 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0568dfe-b0ce-4647-8eae-9b7ad9a4f1e6 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:51.770567 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0568dfe-b0ce-4647-8eae-9b7ad9a4f1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:51.770843 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0568dfe-b0ce-4647-8eae-9b7ad9a4f1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:51.790080 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b0568dfe-b0ce-4647-8eae-9b7ad9a4f1e6 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:51.791265 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b0568dfe-b0ce-4647-8eae-9b7ad9a4f1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:51.798924 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1174/2333] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:51.803565 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1528fd9-b62e-49ea-a93f-edac202789b5 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:51.813155 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1528fd9-b62e-49ea-a93f-edac202789b5 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:51.818635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88512e-4c29-43ca-9f86-1926eebeebd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:51.819225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88512e-4c29-43ca-9f86-1926eebeebd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:51.819536 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88512e-4c29-43ca-9f86-1926eebeebd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:51.819811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88512e-4c29-43ca-9f86-1926eebeebd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:51.820451 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88512e-4c29-43ca-9f86-1926eebeebd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:19:51.820753 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88512e-4c29-43ca-9f86-1926eebeebd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:51.822357 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88512e-4c29-43ca-9f86-1926eebeebd9 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:51.833908 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1160/2334] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:19:51.838005 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0568dfe-b0ce-4647-8eae-9b7ad9a4f1e6 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:51.847487 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0568dfe-b0ce-4647-8eae-9b7ad9a4f1e6 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:51.852065 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d7a52-7ecf-4892-8eae-943c3d2fb25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:51.852647 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d7a52-7ecf-4892-8eae-943c3d2fb25e admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:51.852923 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d7a52-7ecf-4892-8eae-943c3d2fb25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:51.853192 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d7a52-7ecf-4892-8eae-943c3d2fb25e admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:51.853806 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d7a52-7ecf-4892-8eae-943c3d2fb25e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:51.855734 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d7a52-7ecf-4892-8eae-943c3d2fb25e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:51.867133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:51.885641 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1175/2335] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:19:51 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:51.889864 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88512e-4c29-43ca-9f86-1926eebeebd9 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:51.900572 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88512e-4c29-43ca-9f86-1926eebeebd9 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:51.944059 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:51.957431 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d6bdd-cd66-4526-8da9-5f8707f74adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:51.958017 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d6bdd-cd66-4526-8da9-5f8707f74adb admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:51.958292 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d6bdd-cd66-4526-8da9-5f8707f74adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:51.958563 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d6bdd-cd66-4526-8da9-5f8707f74adb admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:51.959171 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d6bdd-cd66-4526-8da9-5f8707f74adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:51.961190 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d6bdd-cd66-4526-8da9-5f8707f74adb admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:51.983724 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1161/2336] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:19:51 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:19:51.988461 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d7a52-7ecf-4892-8eae-943c3d2fb25e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:51.998506 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d7a52-7ecf-4892-8eae-943c3d2fb25e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:52.003167 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0d778-c8cf-44ed-a2b7-5b3d52376ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:52.003877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0d778-c8cf-44ed-a2b7-5b3d52376ecd admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:52.004155 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0d778-c8cf-44ed-a2b7-5b3d52376ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:52.004421 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0d778-c8cf-44ed-a2b7-5b3d52376ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:52.005108 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0d778-c8cf-44ed-a2b7-5b3d52376ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:52.006725 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0d778-c8cf-44ed-a2b7-5b3d52376ecd admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:52.016483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1176/2337] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:52.020440 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d6bdd-cd66-4526-8da9-5f8707f74adb admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:52.030205 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d6bdd-cd66-4526-8da9-5f8707f74adb admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:52.035526 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac142b-2a8b-4cf7-b4ae-7903424e09df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:52.036112 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac142b-2a8b-4cf7-b4ae-7903424e09df admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:52.036393 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac142b-2a8b-4cf7-b4ae-7903424e09df admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:52.036665 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac142b-2a8b-4cf7-b4ae-7903424e09df admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:52.037297 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac142b-2a8b-4cf7-b4ae-7903424e09df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:52.038884 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac142b-2a8b-4cf7-b4ae-7903424e09df admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:52.049301 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1162/2338] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:19:52.053900 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0d778-c8cf-44ed-a2b7-5b3d52376ecd admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:52.064058 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0d778-c8cf-44ed-a2b7-5b3d52376ecd admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:52.068864 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191fb40-481d-46a1-b658-c31b43891a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:52.069502 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191fb40-481d-46a1-b658-c31b43891a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:52.069788 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191fb40-481d-46a1-b658-c31b43891a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:52.070059 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191fb40-481d-46a1-b658-c31b43891a97 admin admin] PATH_INFO: `/v3/projects/b04f57457d204314bbee0129de7bed74/users/8eba04e056794b70881298f96a834a80/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:52.084308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191fb40-481d-46a1-b658-c31b43891a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b04f57457d204314bbee0129de7bed74, user_id=8eba04e056794b70881298f96a834a80, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:52.086967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191fb40-481d-46a1-b658-c31b43891a97 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:52.100572 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1177/2339] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:19:52 2022] PUT /identity/v3/projects/b04f57457d204314bbee0129de7bed74/users/8eba04e056794b70881298f96a834a80/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:52.110847 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ba9bc-1302-4339-afc2-2e44c3ed8355 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:52.111132 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ba9bc-1302-4339-afc2-2e44c3ed8355 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:52.111437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ba9bc-1302-4339-afc2-2e44c3ed8355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:52.139465 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-442ba9bc-1302-4339-afc2-2e44c3ed8355 None None] MFA Rules not processed for user `8eba04e056794b70881298f96a834a80`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:52.140701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-442ba9bc-1302-4339-afc2-2e44c3ed8355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:52.203975 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1163/2340] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:19:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:52.214625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191fb40-481d-46a1-b658-c31b43891a97 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:52.216599 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4191fb40-481d-46a1-b658-c31b43891a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:52.273480 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191fb40-481d-46a1-b658-c31b43891a97 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:52.277034 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300518b6-f548-4280-aed5-df1211a98d75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:52.277627 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300518b6-f548-4280-aed5-df1211a98d75 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:52.277903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300518b6-f548-4280-aed5-df1211a98d75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:52.278173 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300518b6-f548-4280-aed5-df1211a98d75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:52.286982 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300518b6-f548-4280-aed5-df1211a98d75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:52.288433 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300518b6-f548-4280-aed5-df1211a98d75 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:52.296920 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1178/2341] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:00.678474 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ba9bc-1302-4339-afc2-2e44c3ed8355 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:00.739823 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ba9bc-1302-4339-afc2-2e44c3ed8355 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:00.744982 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f94cdb-d24f-4896-a8c2-383ba4974bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:00.745799 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f94cdb-d24f-4896-a8c2-383ba4974bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:00.746080 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f94cdb-d24f-4896-a8c2-383ba4974bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:00.746349 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f94cdb-d24f-4896-a8c2-383ba4974bc6 admin admin] PATH_INFO: `/v3/users/8eba04e056794b70881298f96a834a80` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:00.747490 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f94cdb-d24f-4896-a8c2-383ba4974bc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eba04e056794b70881298f96a834a80)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:00.749414 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f94cdb-d24f-4896-a8c2-383ba4974bc6 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:00.797638 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e3f94cdb-d24f-4896-a8c2-383ba4974bc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eba04e056794b70881298f96a834a80'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:00.804881 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e3f94cdb-d24f-4896-a8c2-383ba4974bc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eba04e056794b70881298f96a834a80'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:00.806472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:00.813385 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e3f94cdb-d24f-4896-a8c2-383ba4974bc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eba04e056794b70881298f96a834a80'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:00.826732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e3f94cdb-d24f-4896-a8c2-383ba4974bc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eba04e056794b70881298f96a834a80'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:00.827360 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e3f94cdb-d24f-4896-a8c2-383ba4974bc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eba04e056794b70881298f96a834a80'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:00.833801 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1164/2342] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:20:00 2022] DELETE /identity/v3/users/8eba04e056794b70881298f96a834a80 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:00.837993 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb79792-905a-4b0a-85bd-5d461ddaed75 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:00.838500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb79792-905a-4b0a-85bd-5d461ddaed75 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:00.838605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb79792-905a-4b0a-85bd-5d461ddaed75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:00.858390 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-acb79792-905a-4b0a-85bd-5d461ddaed75 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:00.859605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-acb79792-905a-4b0a-85bd-5d461ddaed75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:00.916436 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1179/2343] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:00.926888 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f94cdb-d24f-4896-a8c2-383ba4974bc6 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:00.928340 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-e3f94cdb-d24f-4896-a8c2-383ba4974bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:00.988479 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f94cdb-d24f-4896-a8c2-383ba4974bc6 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:00.992249 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30afea-92cf-4a5a-a026-96d6a060a6ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:00.992852 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30afea-92cf-4a5a-a026-96d6a060a6ed service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:00.993157 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30afea-92cf-4a5a-a026-96d6a060a6ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:00.993430 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30afea-92cf-4a5a-a026-96d6a060a6ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:01.002393 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30afea-92cf-4a5a-a026-96d6a060a6ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:01.004537 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30afea-92cf-4a5a-a026-96d6a060a6ed service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:01.013747 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1165/2344] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:01.283662 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb79792-905a-4b0a-85bd-5d461ddaed75 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:01.285321 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-acb79792-905a-4b0a-85bd-5d461ddaed75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:01.297028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb79792-905a-4b0a-85bd-5d461ddaed75 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:01.301780 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd92cc7-2127-4aee-8204-da3940039c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:01.302410 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd92cc7-2127-4aee-8204-da3940039c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:01.302688 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd92cc7-2127-4aee-8204-da3940039c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:01.302961 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd92cc7-2127-4aee-8204-da3940039c3e admin admin] PATH_INFO: `/v3/projects/b04f57457d204314bbee0129de7bed74` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:01.304075 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd92cc7-2127-4aee-8204-da3940039c3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b04f57457d204314bbee0129de7bed74)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:01.305980 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd92cc7-2127-4aee-8204-da3940039c3e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:01.353531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8dd92cc7-2127-4aee-8204-da3940039c3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b04f57457d204314bbee0129de7bed74', 'request_id': 'req-8dd92cc7-2127-4aee-8204-da3940039c3e'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:01.357027 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:01.361054 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8dd92cc7-2127-4aee-8204-da3940039c3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b04f57457d204314bbee0129de7bed74', 'request_id': 'req-8dd92cc7-2127-4aee-8204-da3940039c3e'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:01.368699 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8dd92cc7-2127-4aee-8204-da3940039c3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b04f57457d204314bbee0129de7bed74', 'request_id': 'req-8dd92cc7-2127-4aee-8204-da3940039c3e'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:01.381475 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8dd92cc7-2127-4aee-8204-da3940039c3e admin admin] The token cache is being invalidate because project b04f57457d204314bbee0129de7bed74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:20:01.381767 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8dd92cc7-2127-4aee-8204-da3940039c3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:01.382420 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8dd92cc7-2127-4aee-8204-da3940039c3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:01.383948 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1180/2345] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:20:01 2022] DELETE /identity/v3/projects/b04f57457d204314bbee0129de7bed74 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:01.388814 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2eccc3-d895-46da-b371-74cacfc1374c None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:01.389098 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2eccc3-d895-46da-b371-74cacfc1374c None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:01.389365 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2eccc3-d895-46da-b371-74cacfc1374c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:01.408562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-5c2eccc3-d895-46da-b371-74cacfc1374c None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:01.409902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-5c2eccc3-d895-46da-b371-74cacfc1374c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:01.470352 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1166/2346] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:01.479660 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec42fd-bc0d-4ee7-aa61-6c47309f172b None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:01.479949 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec42fd-bc0d-4ee7-aa61-6c47309f172b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:01.480215 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec42fd-bc0d-4ee7-aa61-6c47309f172b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:01.500034 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d9ec42fd-bc0d-4ee7-aa61-6c47309f172b None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:01.501214 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d9ec42fd-bc0d-4ee7-aa61-6c47309f172b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:01.509621 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1181/2347] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:01.513758 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2eccc3-d895-46da-b371-74cacfc1374c None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:01.523635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2eccc3-d895-46da-b371-74cacfc1374c None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:01.528412 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552371f-86e5-472b-93f7-b5142bf04047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:01.528998 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552371f-86e5-472b-93f7-b5142bf04047 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:01.529271 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552371f-86e5-472b-93f7-b5142bf04047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:01.529537 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552371f-86e5-472b-93f7-b5142bf04047 admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:01.530168 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552371f-86e5-472b-93f7-b5142bf04047 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:20:01.530467 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552371f-86e5-472b-93f7-b5142bf04047 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:01.532101 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552371f-86e5-472b-93f7-b5142bf04047 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:01.543961 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1167/2348] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:20:01.548247 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec42fd-bc0d-4ee7-aa61-6c47309f172b None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:01.557797 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec42fd-bc0d-4ee7-aa61-6c47309f172b None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:01.562645 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83803d9c-043d-42b4-8ed3-0c4a79f14f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:01.563305 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83803d9c-043d-42b4-8ed3-0c4a79f14f2d admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:01.563632 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83803d9c-043d-42b4-8ed3-0c4a79f14f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:01.563924 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83803d9c-043d-42b4-8ed3-0c4a79f14f2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:01.564581 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83803d9c-043d-42b4-8ed3-0c4a79f14f2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:01.567267 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83803d9c-043d-42b4-8ed3-0c4a79f14f2d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:01.594734 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1182/2349] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:20:01 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:20:01.599158 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552371f-86e5-472b-93f7-b5142bf04047 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:01.609132 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552371f-86e5-472b-93f7-b5142bf04047 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:01.665400 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d79f8-dd5d-4fd9-8db8-04a416a92d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:01.665995 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d79f8-dd5d-4fd9-8db8-04a416a92d69 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:01.666273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d79f8-dd5d-4fd9-8db8-04a416a92d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:01.666540 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d79f8-dd5d-4fd9-8db8-04a416a92d69 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:01.667169 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d79f8-dd5d-4fd9-8db8-04a416a92d69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:01.669164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d79f8-dd5d-4fd9-8db8-04a416a92d69 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:01.679938 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:01.696778 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1168/2350] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:20:01 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:01.697919 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83803d9c-043d-42b4-8ed3-0c4a79f14f2d admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:01.708366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83803d9c-043d-42b4-8ed3-0c4a79f14f2d admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:01.712970 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bf7d1-9b54-4da6-89c4-c7ea0ef1a90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:01.713558 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bf7d1-9b54-4da6-89c4-c7ea0ef1a90f admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:01.713835 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bf7d1-9b54-4da6-89c4-c7ea0ef1a90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:01.714103 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bf7d1-9b54-4da6-89c4-c7ea0ef1a90f admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:01.714730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bf7d1-9b54-4da6-89c4-c7ea0ef1a90f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:01.716612 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bf7d1-9b54-4da6-89c4-c7ea0ef1a90f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:01.727197 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1183/2351] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:20:01.731108 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d79f8-dd5d-4fd9-8db8-04a416a92d69 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:01.741523 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d79f8-dd5d-4fd9-8db8-04a416a92d69 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:01.746116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f2a15-53e5-4409-884d-b2bf56988c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:01.746680 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f2a15-53e5-4409-884d-b2bf56988c97 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:01.746955 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f2a15-53e5-4409-884d-b2bf56988c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:01.747224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f2a15-53e5-4409-884d-b2bf56988c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:01.747889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f2a15-53e5-4409-884d-b2bf56988c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:01.749515 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f2a15-53e5-4409-884d-b2bf56988c97 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:01.760112 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1169/2352] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:20:01.764047 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bf7d1-9b54-4da6-89c4-c7ea0ef1a90f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:01.774674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bf7d1-9b54-4da6-89c4-c7ea0ef1a90f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:01.779248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28614de6-7b3c-4fba-9fd7-5f3ec7b76e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:01.779921 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28614de6-7b3c-4fba-9fd7-5f3ec7b76e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:01.780198 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28614de6-7b3c-4fba-9fd7-5f3ec7b76e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:01.780474 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28614de6-7b3c-4fba-9fd7-5f3ec7b76e50 admin admin] PATH_INFO: `/v3/projects/ccf14e6d4fc94bf28d78b968d9adcdf3/users/eeea150c7c2c43ddb4c737e02e63d2e1/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:01.795452 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28614de6-7b3c-4fba-9fd7-5f3ec7b76e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf14e6d4fc94bf28d78b968d9adcdf3, user_id=eeea150c7c2c43ddb4c737e02e63d2e1, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:01.798112 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28614de6-7b3c-4fba-9fd7-5f3ec7b76e50 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:01.811798 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1184/2353] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:20:01 2022] PUT /identity/v3/projects/ccf14e6d4fc94bf28d78b968d9adcdf3/users/eeea150c7c2c43ddb4c737e02e63d2e1/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:20:01.822333 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c67cc7-ee18-4bff-ad29-02dfaa3b7bbc None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:01.822615 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c67cc7-ee18-4bff-ad29-02dfaa3b7bbc None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:01.822885 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c67cc7-ee18-4bff-ad29-02dfaa3b7bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:01.850981 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-25c67cc7-ee18-4bff-ad29-02dfaa3b7bbc None None] MFA Rules not processed for user `eeea150c7c2c43ddb4c737e02e63d2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:01.852205 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-25c67cc7-ee18-4bff-ad29-02dfaa3b7bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:01.914249 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1170/2354] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:01.918718 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28614de6-7b3c-4fba-9fd7-5f3ec7b76e50 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:01.978868 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28614de6-7b3c-4fba-9fd7-5f3ec7b76e50 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:01.983438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c45685-4094-433d-9b26-49c8c4d0f056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:01.984041 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c45685-4094-433d-9b26-49c8c4d0f056 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:01.984317 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c45685-4094-433d-9b26-49c8c4d0f056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:01.984578 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c45685-4094-433d-9b26-49c8c4d0f056 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:01.985185 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c45685-4094-433d-9b26-49c8c4d0f056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:01.987072 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c45685-4094-433d-9b26-49c8c4d0f056 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:02.012887 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1185/2355] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:20:01 2022] POST /identity/v3/projects => generated 363 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:02.017104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c67cc7-ee18-4bff-ad29-02dfaa3b7bbc None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:02.027973 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c67cc7-ee18-4bff-ad29-02dfaa3b7bbc None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:02.083893 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe4022-e15e-41f7-bcd2-b71535c80852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:02.084491 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe4022-e15e-41f7-bcd2-b71535c80852 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:02.084766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe4022-e15e-41f7-bcd2-b71535c80852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:02.085033 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe4022-e15e-41f7-bcd2-b71535c80852 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:02.085646 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe4022-e15e-41f7-bcd2-b71535c80852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:02.087616 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe4022-e15e-41f7-bcd2-b71535c80852 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:02.108713 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1171/2356] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:20:02 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:02.113268 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c45685-4094-433d-9b26-49c8c4d0f056 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:02.123653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c45685-4094-433d-9b26-49c8c4d0f056 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:02.128379 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b33689-ec8e-431f-810e-d76b3b601dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:02.128994 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b33689-ec8e-431f-810e-d76b3b601dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:02.129256 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b33689-ec8e-431f-810e-d76b3b601dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:02.129529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b33689-ec8e-431f-810e-d76b3b601dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:02.130158 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b33689-ec8e-431f-810e-d76b3b601dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:02.131861 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b33689-ec8e-431f-810e-d76b3b601dc6 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:02.142277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1186/2357] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:02.146921 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe4022-e15e-41f7-bcd2-b71535c80852 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:02.156725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe4022-e15e-41f7-bcd2-b71535c80852 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:02.161876 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd97a1-e81f-49f1-948e-3c0fc10d1993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:02.162527 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd97a1-e81f-49f1-948e-3c0fc10d1993 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:02.162784 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd97a1-e81f-49f1-948e-3c0fc10d1993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:02.163051 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd97a1-e81f-49f1-948e-3c0fc10d1993 admin admin] PATH_INFO: `/v3/projects/9614d4d50767409699307383f4c5583a/users/db5d3a1579b74cd3ad0f99b86841ea1a/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:02.177380 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd97a1-e81f-49f1-948e-3c0fc10d1993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9614d4d50767409699307383f4c5583a, user_id=db5d3a1579b74cd3ad0f99b86841ea1a, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:02.180036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd97a1-e81f-49f1-948e-3c0fc10d1993 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:02.192261 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1172/2358] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:20:02 2022] PUT /identity/v3/projects/9614d4d50767409699307383f4c5583a/users/db5d3a1579b74cd3ad0f99b86841ea1a/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:02.196205 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b33689-ec8e-431f-810e-d76b3b601dc6 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:02.205943 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b33689-ec8e-431f-810e-d76b3b601dc6 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:02.253258 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:02.263445 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703efd06-ce04-43cd-8b25-4a98b57f9baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:02.264052 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703efd06-ce04-43cd-8b25-4a98b57f9baf admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:02.264330 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703efd06-ce04-43cd-8b25-4a98b57f9baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:02.264599 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703efd06-ce04-43cd-8b25-4a98b57f9baf admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:02.265230 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703efd06-ce04-43cd-8b25-4a98b57f9baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:02.266816 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703efd06-ce04-43cd-8b25-4a98b57f9baf admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:02.276802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1187/2359] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:02.280967 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd97a1-e81f-49f1-948e-3c0fc10d1993 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:02.292047 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd97a1-e81f-49f1-948e-3c0fc10d1993 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:02.296562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3bca8-0893-47f3-a5b7-6d946dfc4f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:02.297200 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3bca8-0893-47f3-a5b7-6d946dfc4f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:02.297476 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3bca8-0893-47f3-a5b7-6d946dfc4f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:02.297746 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3bca8-0893-47f3-a5b7-6d946dfc4f93 admin admin] PATH_INFO: `/v3/projects/9614d4d50767409699307383f4c5583a/users/db5d3a1579b74cd3ad0f99b86841ea1a/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:02.299650 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3bca8-0893-47f3-a5b7-6d946dfc4f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9614d4d50767409699307383f4c5583a, user_id=db5d3a1579b74cd3ad0f99b86841ea1a, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:02.302710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3bca8-0893-47f3-a5b7-6d946dfc4f93 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:02.312732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1173/2360] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:20:02 2022] PUT /identity/v3/projects/9614d4d50767409699307383f4c5583a/users/db5d3a1579b74cd3ad0f99b86841ea1a/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:02.323311 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9110dbf-b572-42cc-8818-77c8ea1d7aa2 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:02.323638 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9110dbf-b572-42cc-8818-77c8ea1d7aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:02.323941 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9110dbf-b572-42cc-8818-77c8ea1d7aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:02.353861 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b9110dbf-b572-42cc-8818-77c8ea1d7aa2 None None] MFA Rules not processed for user `db5d3a1579b74cd3ad0f99b86841ea1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:02.355058 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b9110dbf-b572-42cc-8818-77c8ea1d7aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:02.422021 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1188/2361] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:20:02.433384 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3bca8-0893-47f3-a5b7-6d946dfc4f93 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:02.435071 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-97d3bca8-0893-47f3-a5b7-6d946dfc4f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:02.463502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:02.494415 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3bca8-0893-47f3-a5b7-6d946dfc4f93 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:02.498051 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e088b-1a45-45ac-8be7-82ff2ee7b36e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:02.498652 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e088b-1a45-45ac-8be7-82ff2ee7b36e service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:02.498927 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e088b-1a45-45ac-8be7-82ff2ee7b36e service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:02.499186 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e088b-1a45-45ac-8be7-82ff2ee7b36e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:02.509196 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e088b-1a45-45ac-8be7-82ff2ee7b36e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:02.510663 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e088b-1a45-45ac-8be7-82ff2ee7b36e service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:02.521399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1174/2362] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:02.936453 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9110dbf-b572-42cc-8818-77c8ea1d7aa2 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:02.997927 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9110dbf-b572-42cc-8818-77c8ea1d7aa2 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:03.002435 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b55ba-da7f-4b9a-82cb-9713d427e705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:03.003133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b55ba-da7f-4b9a-82cb-9713d427e705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:03.003454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b55ba-da7f-4b9a-82cb-9713d427e705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:03.003743 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b55ba-da7f-4b9a-82cb-9713d427e705 admin admin] PATH_INFO: `/v3/users/eeea150c7c2c43ddb4c737e02e63d2e1` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:03.004852 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b55ba-da7f-4b9a-82cb-9713d427e705 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeea150c7c2c43ddb4c737e02e63d2e1)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:03.006775 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b55ba-da7f-4b9a-82cb-9713d427e705 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:03.053006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-640b55ba-da7f-4b9a-82cb-9713d427e705 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeea150c7c2c43ddb4c737e02e63d2e1'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:03.060075 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-640b55ba-da7f-4b9a-82cb-9713d427e705 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeea150c7c2c43ddb4c737e02e63d2e1'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:03.071742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-640b55ba-da7f-4b9a-82cb-9713d427e705 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeea150c7c2c43ddb4c737e02e63d2e1'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:03.074139 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:03.079978 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-640b55ba-da7f-4b9a-82cb-9713d427e705 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeea150c7c2c43ddb4c737e02e63d2e1'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:03.080797 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-640b55ba-da7f-4b9a-82cb-9713d427e705 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeea150c7c2c43ddb4c737e02e63d2e1'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:03.087989 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1189/2363] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:20:02 2022] DELETE /identity/v3/users/eeea150c7c2c43ddb4c737e02e63d2e1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:03.092817 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a30b2c-9ef6-43d8-8fba-ca586b3dc158 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:03.093298 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a30b2c-9ef6-43d8-8fba-ca586b3dc158 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:03.093411 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a30b2c-9ef6-43d8-8fba-ca586b3dc158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:03.114042 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-42a30b2c-9ef6-43d8-8fba-ca586b3dc158 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:03.115233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-42a30b2c-9ef6-43d8-8fba-ca586b3dc158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:03.172612 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1175/2364] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:03.182790 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b55ba-da7f-4b9a-82cb-9713d427e705 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:03.184164 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-640b55ba-da7f-4b9a-82cb-9713d427e705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:03.240420 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b55ba-da7f-4b9a-82cb-9713d427e705 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:03.244069 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c227d4e-e00a-4d20-aece-4694f9d8a403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:03.244852 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c227d4e-e00a-4d20-aece-4694f9d8a403 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:03.245116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c227d4e-e00a-4d20-aece-4694f9d8a403 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:03.245383 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c227d4e-e00a-4d20-aece-4694f9d8a403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:03.255295 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c227d4e-e00a-4d20-aece-4694f9d8a403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:03.256958 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c227d4e-e00a-4d20-aece-4694f9d8a403 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:03.266158 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1190/2365] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:20:03.528165 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a30b2c-9ef6-43d8-8fba-ca586b3dc158 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:03.529626 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-42a30b2c-9ef6-43d8-8fba-ca586b3dc158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:03.545354 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a30b2c-9ef6-43d8-8fba-ca586b3dc158 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:03.550131 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c1429-5aaa-4ac8-926c-eb8cb2723abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:03.550676 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c1429-5aaa-4ac8-926c-eb8cb2723abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:03.550950 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c1429-5aaa-4ac8-926c-eb8cb2723abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:03.551216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c1429-5aaa-4ac8-926c-eb8cb2723abd admin admin] PATH_INFO: `/v3/projects/ccf14e6d4fc94bf28d78b968d9adcdf3` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:03.552377 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c1429-5aaa-4ac8-926c-eb8cb2723abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf14e6d4fc94bf28d78b968d9adcdf3)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:03.554299 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c1429-5aaa-4ac8-926c-eb8cb2723abd admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:03.602816 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-941c1429-5aaa-4ac8-926c-eb8cb2723abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf14e6d4fc94bf28d78b968d9adcdf3', 'request_id': 'req-941c1429-5aaa-4ac8-926c-eb8cb2723abd'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:03.610079 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-941c1429-5aaa-4ac8-926c-eb8cb2723abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf14e6d4fc94bf28d78b968d9adcdf3', 'request_id': 'req-941c1429-5aaa-4ac8-926c-eb8cb2723abd'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:03.616354 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-941c1429-5aaa-4ac8-926c-eb8cb2723abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf14e6d4fc94bf28d78b968d9adcdf3', 'request_id': 'req-941c1429-5aaa-4ac8-926c-eb8cb2723abd'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:03.627282 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-941c1429-5aaa-4ac8-926c-eb8cb2723abd admin admin] The token cache is being invalidate because project ccf14e6d4fc94bf28d78b968d9adcdf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:20:03.627597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-941c1429-5aaa-4ac8-926c-eb8cb2723abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:03.628786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-941c1429-5aaa-4ac8-926c-eb8cb2723abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:03.630270 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1176/2366] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:20:03 2022] DELETE /identity/v3/projects/ccf14e6d4fc94bf28d78b968d9adcdf3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:03.634396 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c227d4e-e00a-4d20-aece-4694f9d8a403 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:03.643974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c227d4e-e00a-4d20-aece-4694f9d8a403 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:03.698888 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42b416-c9af-414c-828b-d4d55ed089b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:03.699541 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42b416-c9af-414c-828b-d4d55ed089b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:03.699820 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42b416-c9af-414c-828b-d4d55ed089b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:03.700088 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42b416-c9af-414c-828b-d4d55ed089b1 admin admin] PATH_INFO: `/v3/users/db5d3a1579b74cd3ad0f99b86841ea1a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:03.701171 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42b416-c9af-414c-828b-d4d55ed089b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db5d3a1579b74cd3ad0f99b86841ea1a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:03.703163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42b416-c9af-414c-828b-d4d55ed089b1 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:03.747154 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7b42b416-c9af-414c-828b-d4d55ed089b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db5d3a1579b74cd3ad0f99b86841ea1a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:03.754724 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7b42b416-c9af-414c-828b-d4d55ed089b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db5d3a1579b74cd3ad0f99b86841ea1a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:03.766263 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7b42b416-c9af-414c-828b-d4d55ed089b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db5d3a1579b74cd3ad0f99b86841ea1a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:03.773048 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7b42b416-c9af-414c-828b-d4d55ed089b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db5d3a1579b74cd3ad0f99b86841ea1a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:03.773742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7b42b416-c9af-414c-828b-d4d55ed089b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db5d3a1579b74cd3ad0f99b86841ea1a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:03.779705 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1191/2367] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:20:03 2022] DELETE /identity/v3/users/db5d3a1579b74cd3ad0f99b86841ea1a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:04.048554 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c1429-5aaa-4ac8-926c-eb8cb2723abd admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:04.050653 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-941c1429-5aaa-4ac8-926c-eb8cb2723abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:04.063838 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c1429-5aaa-4ac8-926c-eb8cb2723abd admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:04.110625 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:04.122420 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4a5f2-62f8-4a68-94c6-e8365fcb36b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:04.123041 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4a5f2-62f8-4a68-94c6-e8365fcb36b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:04.123316 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4a5f2-62f8-4a68-94c6-e8365fcb36b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:04.123609 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4a5f2-62f8-4a68-94c6-e8365fcb36b4 admin admin] PATH_INFO: `/v3/projects/9614d4d50767409699307383f4c5583a` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:04.124702 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4a5f2-62f8-4a68-94c6-e8365fcb36b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9614d4d50767409699307383f4c5583a)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:04.126596 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4a5f2-62f8-4a68-94c6-e8365fcb36b4 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:04.172557 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1aa4a5f2-62f8-4a68-94c6-e8365fcb36b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9614d4d50767409699307383f4c5583a', 'request_id': 'req-1aa4a5f2-62f8-4a68-94c6-e8365fcb36b4'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:04.180489 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1aa4a5f2-62f8-4a68-94c6-e8365fcb36b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9614d4d50767409699307383f4c5583a', 'request_id': 'req-1aa4a5f2-62f8-4a68-94c6-e8365fcb36b4'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:04.186163 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1aa4a5f2-62f8-4a68-94c6-e8365fcb36b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9614d4d50767409699307383f4c5583a', 'request_id': 'req-1aa4a5f2-62f8-4a68-94c6-e8365fcb36b4'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:04.197305 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1aa4a5f2-62f8-4a68-94c6-e8365fcb36b4 admin admin] The token cache is being invalidate because project 9614d4d50767409699307383f4c5583a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:20:04.197588 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1aa4a5f2-62f8-4a68-94c6-e8365fcb36b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:04.198216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1aa4a5f2-62f8-4a68-94c6-e8365fcb36b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:04.199942 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1177/2368] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:20:04 2022] DELETE /identity/v3/projects/9614d4d50767409699307383f4c5583a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:20:04.204504 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe18ea-c6a6-436c-9039-ba90bc079282 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:04.204969 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe18ea-c6a6-436c-9039-ba90bc079282 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:04.205079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe18ea-c6a6-436c-9039-ba90bc079282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:04.225312 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-42fe18ea-c6a6-436c-9039-ba90bc079282 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:04.226554 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-42fe18ea-c6a6-436c-9039-ba90bc079282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:04.235724 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:04.288372 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1192/2369] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:04.295969 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba645159-589f-4cd7-ad65-9f2aaf885bfd None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:04.296250 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba645159-589f-4cd7-ad65-9f2aaf885bfd None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:04.296518 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba645159-589f-4cd7-ad65-9f2aaf885bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:04.316562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-ba645159-589f-4cd7-ad65-9f2aaf885bfd None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:04.317732 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-ba645159-589f-4cd7-ad65-9f2aaf885bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:04.325376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1178/2370] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:04.329525 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe18ea-c6a6-436c-9039-ba90bc079282 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:04.339372 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe18ea-c6a6-436c-9039-ba90bc079282 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:04.344249 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516e799-5900-4b0a-b787-fb16e1da6b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:04.344839 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516e799-5900-4b0a-b787-fb16e1da6b73 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:04.345119 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516e799-5900-4b0a-b787-fb16e1da6b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:04.345393 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516e799-5900-4b0a-b787-fb16e1da6b73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:04.346036 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516e799-5900-4b0a-b787-fb16e1da6b73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:20:04.346339 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516e799-5900-4b0a-b787-fb16e1da6b73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:04.348582 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516e799-5900-4b0a-b787-fb16e1da6b73 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:04.360019 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1193/2371] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:20:04.365162 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba645159-589f-4cd7-ad65-9f2aaf885bfd None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:04.376514 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba645159-589f-4cd7-ad65-9f2aaf885bfd None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:04.381158 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc65f1-479b-4737-8ea1-1ee4fec6c245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:04.381753 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc65f1-479b-4737-8ea1-1ee4fec6c245 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:04.382022 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc65f1-479b-4737-8ea1-1ee4fec6c245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:04.382289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc65f1-479b-4737-8ea1-1ee4fec6c245 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:04.382898 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc65f1-479b-4737-8ea1-1ee4fec6c245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:04.384841 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc65f1-479b-4737-8ea1-1ee4fec6c245 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:04.411971 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1179/2372] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:20:04 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:04.416072 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516e799-5900-4b0a-b787-fb16e1da6b73 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:04.426254 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516e799-5900-4b0a-b787-fb16e1da6b73 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:04.481818 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71907b2a-df7a-4297-b181-c446c7e0a69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:04.482322 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71907b2a-df7a-4297-b181-c446c7e0a69d admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:04.482601 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71907b2a-df7a-4297-b181-c446c7e0a69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:04.482875 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71907b2a-df7a-4297-b181-c446c7e0a69d admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:04.483547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71907b2a-df7a-4297-b181-c446c7e0a69d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:04.485466 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71907b2a-df7a-4297-b181-c446c7e0a69d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:04.505550 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1194/2373] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:20:04 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:04.509646 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc65f1-479b-4737-8ea1-1ee4fec6c245 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:04.520466 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc65f1-479b-4737-8ea1-1ee4fec6c245 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:04.525056 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511793f0-347d-4cc2-b0de-04327ece366a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:04.525648 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511793f0-347d-4cc2-b0de-04327ece366a admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:04.525927 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511793f0-347d-4cc2-b0de-04327ece366a admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:04.526196 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511793f0-347d-4cc2-b0de-04327ece366a admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:04.526852 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511793f0-347d-4cc2-b0de-04327ece366a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:04.528485 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511793f0-347d-4cc2-b0de-04327ece366a admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:04.539095 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1180/2374] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:04.543033 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71907b2a-df7a-4297-b181-c446c7e0a69d admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:04.553098 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71907b2a-df7a-4297-b181-c446c7e0a69d admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:04.557690 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27d011-67cb-41e7-b0fc-b6e364b2cc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:04.558286 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27d011-67cb-41e7-b0fc-b6e364b2cc18 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:04.558566 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27d011-67cb-41e7-b0fc-b6e364b2cc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:04.558848 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27d011-67cb-41e7-b0fc-b6e364b2cc18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:04.559505 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27d011-67cb-41e7-b0fc-b6e364b2cc18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:04.561105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27d011-67cb-41e7-b0fc-b6e364b2cc18 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:04.571649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1195/2375] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:04.575693 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511793f0-347d-4cc2-b0de-04327ece366a admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:04.586485 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511793f0-347d-4cc2-b0de-04327ece366a admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:04.591068 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0ee7b-d2c6-4e01-a79d-d7ec0d827f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:04.591988 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0ee7b-d2c6-4e01-a79d-d7ec0d827f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:04.592262 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0ee7b-d2c6-4e01-a79d-d7ec0d827f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:04.592532 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0ee7b-d2c6-4e01-a79d-d7ec0d827f56 admin admin] PATH_INFO: `/v3/projects/12aade7f949e4f728cbc5bcfea4cc19e/users/7826e24570c94f989f942c1498ef87a7/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:04.607846 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0ee7b-d2c6-4e01-a79d-d7ec0d827f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12aade7f949e4f728cbc5bcfea4cc19e, user_id=7826e24570c94f989f942c1498ef87a7, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:04.610510 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0ee7b-d2c6-4e01-a79d-d7ec0d827f56 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:04.624179 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1181/2376] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:20:04 2022] PUT /identity/v3/projects/12aade7f949e4f728cbc5bcfea4cc19e/users/7826e24570c94f989f942c1498ef87a7/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:04.634746 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc1149-a1f4-4661-893e-6b8589f35525 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:04.635029 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc1149-a1f4-4661-893e-6b8589f35525 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:04.635296 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc1149-a1f4-4661-893e-6b8589f35525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:04.662917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-94fc1149-a1f4-4661-893e-6b8589f35525 None None] MFA Rules not processed for user `7826e24570c94f989f942c1498ef87a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:04.664161 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-94fc1149-a1f4-4661-893e-6b8589f35525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:04.729542 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1196/2377] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:04.734097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0ee7b-d2c6-4e01-a79d-d7ec0d827f56 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:04.795705 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0ee7b-d2c6-4e01-a79d-d7ec0d827f56 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:04.800399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf6e97-940c-44b1-a9d7-c5dce62a0178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:04.800996 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf6e97-940c-44b1-a9d7-c5dce62a0178 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:04.801276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf6e97-940c-44b1-a9d7-c5dce62a0178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:04.801565 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf6e97-940c-44b1-a9d7-c5dce62a0178 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:04.802165 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf6e97-940c-44b1-a9d7-c5dce62a0178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:04.804123 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf6e97-940c-44b1-a9d7-c5dce62a0178 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:04.834003 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1182/2378] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:20:04 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:04.838477 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc1149-a1f4-4661-893e-6b8589f35525 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:04.854248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc1149-a1f4-4661-893e-6b8589f35525 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:04.863396 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:04.913977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1f431-42ce-4807-a72f-04f2a61b0172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:04.914581 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1f431-42ce-4807-a72f-04f2a61b0172 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:04.914859 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1f431-42ce-4807-a72f-04f2a61b0172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:04.915285 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1f431-42ce-4807-a72f-04f2a61b0172 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:04.915943 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1f431-42ce-4807-a72f-04f2a61b0172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:04.918202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1f431-42ce-4807-a72f-04f2a61b0172 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:04.943590 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1197/2379] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:20:04 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:20:04.944786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf6e97-940c-44b1-a9d7-c5dce62a0178 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:04.950300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:04.957661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf6e97-940c-44b1-a9d7-c5dce62a0178 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:04.963380 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050c7e0-bea5-478b-af7f-67895134fae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:04.964033 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050c7e0-bea5-478b-af7f-67895134fae4 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:04.964309 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050c7e0-bea5-478b-af7f-67895134fae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:04.964578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050c7e0-bea5-478b-af7f-67895134fae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:04.965484 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050c7e0-bea5-478b-af7f-67895134fae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:04.967056 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050c7e0-bea5-478b-af7f-67895134fae4 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:04.977937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1183/2380] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:04.981948 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1f431-42ce-4807-a72f-04f2a61b0172 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:04.991966 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1f431-42ce-4807-a72f-04f2a61b0172 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:04.997005 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3effe5d-054e-4ce4-9544-b53f58b6ddb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:04.997681 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3effe5d-054e-4ce4-9544-b53f58b6ddb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:04.997962 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3effe5d-054e-4ce4-9544-b53f58b6ddb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:04.998240 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3effe5d-054e-4ce4-9544-b53f58b6ddb7 admin admin] PATH_INFO: `/v3/projects/f371e5385fbf46e2b77633ea5049f97b/users/fea37696f4eb4d43840056837b609d28/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:05.015180 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3effe5d-054e-4ce4-9544-b53f58b6ddb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f371e5385fbf46e2b77633ea5049f97b, user_id=fea37696f4eb4d43840056837b609d28, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:05.018556 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3effe5d-054e-4ce4-9544-b53f58b6ddb7 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:05.033215 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1198/2381] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:20:04 2022] PUT /identity/v3/projects/f371e5385fbf46e2b77633ea5049f97b/users/fea37696f4eb4d43840056837b609d28/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:20:05.038139 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050c7e0-bea5-478b-af7f-67895134fae4 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:05.049246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050c7e0-bea5-478b-af7f-67895134fae4 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:05.109628 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee9f7f-2525-40c9-9b2f-c95e8846a6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:05.110230 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee9f7f-2525-40c9-9b2f-c95e8846a6ba admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:05.110506 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee9f7f-2525-40c9-9b2f-c95e8846a6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:05.110909 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee9f7f-2525-40c9-9b2f-c95e8846a6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:05.111571 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee9f7f-2525-40c9-9b2f-c95e8846a6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:05.113891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee9f7f-2525-40c9-9b2f-c95e8846a6ba admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:05.128970 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1184/2382] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:05.130306 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3effe5d-054e-4ce4-9544-b53f58b6ddb7 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:05.143584 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3effe5d-054e-4ce4-9544-b53f58b6ddb7 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:05.148894 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde7ce4-730c-4391-a62b-5d052444617d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:05.149558 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde7ce4-730c-4391-a62b-5d052444617d admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:05.149833 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde7ce4-730c-4391-a62b-5d052444617d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:05.150104 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde7ce4-730c-4391-a62b-5d052444617d admin admin] PATH_INFO: `/v3/projects/f371e5385fbf46e2b77633ea5049f97b/users/fea37696f4eb4d43840056837b609d28/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:05.152134 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde7ce4-730c-4391-a62b-5d052444617d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f371e5385fbf46e2b77633ea5049f97b, user_id=fea37696f4eb4d43840056837b609d28, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:05.154834 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde7ce4-730c-4391-a62b-5d052444617d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:05.165885 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1199/2383] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:20:05 2022] PUT /identity/v3/projects/f371e5385fbf46e2b77633ea5049f97b/users/fea37696f4eb4d43840056837b609d28/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:05.177754 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5466499-749a-453f-a6d2-8d58546c3707 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:05.178042 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5466499-749a-453f-a6d2-8d58546c3707 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:05.178331 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5466499-749a-453f-a6d2-8d58546c3707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:05.209342 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-f5466499-749a-453f-a6d2-8d58546c3707 None None] MFA Rules not processed for user `fea37696f4eb4d43840056837b609d28`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:05.210561 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f5466499-749a-453f-a6d2-8d58546c3707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:05.281416 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1185/2384] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:05.293338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde7ce4-730c-4391-a62b-5d052444617d admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:05.295176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ccde7ce4-730c-4391-a62b-5d052444617d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:05.353713 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde7ce4-730c-4391-a62b-5d052444617d admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:05.357313 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc648e72-b088-4a53-99b8-a44ff33df78b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:05.357903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc648e72-b088-4a53-99b8-a44ff33df78b service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:05.358179 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc648e72-b088-4a53-99b8-a44ff33df78b service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:05.358449 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc648e72-b088-4a53-99b8-a44ff33df78b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:05.370040 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc648e72-b088-4a53-99b8-a44ff33df78b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:05.372042 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc648e72-b088-4a53-99b8-a44ff33df78b service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:05.383482 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1200/2385] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:05.465399 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5466499-749a-453f-a6d2-8d58546c3707 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:05.476225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5466499-749a-453f-a6d2-8d58546c3707 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:05.479883 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b5af7-9cf4-4769-aebb-5647328dfe23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:05.480512 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b5af7-9cf4-4769-aebb-5647328dfe23 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:05.480787 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b5af7-9cf4-4769-aebb-5647328dfe23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:05.481058 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b5af7-9cf4-4769-aebb-5647328dfe23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:05.539934 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b5af7-9cf4-4769-aebb-5647328dfe23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:05.541347 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b5af7-9cf4-4769-aebb-5647328dfe23 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:05.551714 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1186/2386] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:20:10.257189 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857f4e4-4f1d-4c92-97c9-c8bc6498a8bf None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:10.257670 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857f4e4-4f1d-4c92-97c9-c8bc6498a8bf None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:10.257767 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857f4e4-4f1d-4c92-97c9-c8bc6498a8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:10.277036 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b857f4e4-4f1d-4c92-97c9-c8bc6498a8bf None None] MFA Rules not processed for user `448eb7f5ed5c46dea4be4628ffd0df51`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:10.278233 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b857f4e4-4f1d-4c92-97c9-c8bc6498a8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:10.333386 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1201/2387] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:10.501736 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b5af7-9cf4-4769-aebb-5647328dfe23 service cinder] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:10.516512 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:10.584777 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b5af7-9cf4-4769-aebb-5647328dfe23 service cinder] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:10.590057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f5d35-78a2-4faa-a942-38194de595d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:10.591180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f5d35-78a2-4faa-a942-38194de595d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:10.591752 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f5d35-78a2-4faa-a942-38194de595d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:10.592026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f5d35-78a2-4faa-a942-38194de595d6 admin admin] PATH_INFO: `/v3/users/7826e24570c94f989f942c1498ef87a7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:10.593139 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f5d35-78a2-4faa-a942-38194de595d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7826e24570c94f989f942c1498ef87a7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:10.595234 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f5d35-78a2-4faa-a942-38194de595d6 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:10.665083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c25f5d35-78a2-4faa-a942-38194de595d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7826e24570c94f989f942c1498ef87a7'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:10.685626 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c25f5d35-78a2-4faa-a942-38194de595d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7826e24570c94f989f942c1498ef87a7'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:10.697480 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857f4e4-4f1d-4c92-97c9-c8bc6498a8bf None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:10.698562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c25f5d35-78a2-4faa-a942-38194de595d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7826e24570c94f989f942c1498ef87a7'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:10.699188 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b857f4e4-4f1d-4c92-97c9-c8bc6498a8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:10.712309 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c25f5d35-78a2-4faa-a942-38194de595d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7826e24570c94f989f942c1498ef87a7'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:10.712564 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:10.713229 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c25f5d35-78a2-4faa-a942-38194de595d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7826e24570c94f989f942c1498ef87a7'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:10.720092 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1187/2388] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:20:10 2022] DELETE /identity/v3/users/7826e24570c94f989f942c1498ef87a7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:10.720966 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f5d35-78a2-4faa-a942-38194de595d6 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:10.722868 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-c25f5d35-78a2-4faa-a942-38194de595d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:10.760628 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857f4e4-4f1d-4c92-97c9-c8bc6498a8bf None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:10.779824 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f5d35-78a2-4faa-a942-38194de595d6 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:10.783375 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895bfaa-bea0-4c1f-a0fc-89dc10f52374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:10.784000 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895bfaa-bea0-4c1f-a0fc-89dc10f52374 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:10.784817 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895bfaa-bea0-4c1f-a0fc-89dc10f52374 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:10.785091 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895bfaa-bea0-4c1f-a0fc-89dc10f52374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:10.787057 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b895bfaa-bea0-4c1f-a0fc-89dc10f52374 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:10.810752 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a0501-6806-494c-933e-6e8a5ce8f993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:10.811343 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a0501-6806-494c-933e-6e8a5ce8f993 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:10.811648 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a0501-6806-494c-933e-6e8a5ce8f993 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:10.811919 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a0501-6806-494c-933e-6e8a5ce8f993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:10.813613 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-bf4a0501-6806-494c-933e-6e8a5ce8f993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:10.822912 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a0501-6806-494c-933e-6e8a5ce8f993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:10.824358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a0501-6806-494c-933e-6e8a5ce8f993 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:10.832245 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:10.832507 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1202/2389] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:10.833698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa29842-d5e3-416a-8893-c79a33c149bd None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:10.833979 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa29842-d5e3-416a-8893-c79a33c149bd None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:10.834311 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa29842-d5e3-416a-8893-c79a33c149bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:10.855557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-afa29842-d5e3-416a-8893-c79a33c149bd None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:10.856747 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-afa29842-d5e3-416a-8893-c79a33c149bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:10.857348 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895bfaa-bea0-4c1f-a0fc-89dc10f52374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:10.858846 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895bfaa-bea0-4c1f-a0fc-89dc10f52374 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:10.868685 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1203/2390] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:10.869417 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1188/2391] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:10.883906 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa29842-d5e3-416a-8893-c79a33c149bd None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:10.895255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa29842-d5e3-416a-8893-c79a33c149bd None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:10.900991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad21ee-5ad0-4d37-8403-cf564e94f95c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:10.901224 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad21ee-5ad0-4d37-8403-cf564e94f95c service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:10.901577 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad21ee-5ad0-4d37-8403-cf564e94f95c service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:10.901923 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad21ee-5ad0-4d37-8403-cf564e94f95c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:10.914239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad21ee-5ad0-4d37-8403-cf564e94f95c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:10.915882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad21ee-5ad0-4d37-8403-cf564e94f95c service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:10.928149 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1204/2392] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:20:11.725125 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895bfaa-bea0-4c1f-a0fc-89dc10f52374 service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:11.727186 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b895bfaa-bea0-4c1f-a0fc-89dc10f52374 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:11.741107 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895bfaa-bea0-4c1f-a0fc-89dc10f52374 service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:11.749096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e60e4b-20b7-4352-afb2-439e3a76fab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:11.749750 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e60e4b-20b7-4352-afb2-439e3a76fab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:11.750031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e60e4b-20b7-4352-afb2-439e3a76fab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:11.750440 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e60e4b-20b7-4352-afb2-439e3a76fab5 admin admin] PATH_INFO: `/v3/projects/12aade7f949e4f728cbc5bcfea4cc19e` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:11.751679 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e60e4b-20b7-4352-afb2-439e3a76fab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12aade7f949e4f728cbc5bcfea4cc19e)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:11.756530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e60e4b-20b7-4352-afb2-439e3a76fab5 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:11.824027 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c2e60e4b-20b7-4352-afb2-439e3a76fab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12aade7f949e4f728cbc5bcfea4cc19e', 'request_id': 'req-c2e60e4b-20b7-4352-afb2-439e3a76fab5'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:11.833468 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c2e60e4b-20b7-4352-afb2-439e3a76fab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12aade7f949e4f728cbc5bcfea4cc19e', 'request_id': 'req-c2e60e4b-20b7-4352-afb2-439e3a76fab5'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:11.839885 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c2e60e4b-20b7-4352-afb2-439e3a76fab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12aade7f949e4f728cbc5bcfea4cc19e', 'request_id': 'req-c2e60e4b-20b7-4352-afb2-439e3a76fab5'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:11.852581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c2e60e4b-20b7-4352-afb2-439e3a76fab5 admin admin] The token cache is being invalidate because project 12aade7f949e4f728cbc5bcfea4cc19e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:20:11.852871 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c2e60e4b-20b7-4352-afb2-439e3a76fab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:11.853535 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c2e60e4b-20b7-4352-afb2-439e3a76fab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:11.855298 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1189/2393] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:20:11 2022] DELETE /identity/v3/projects/12aade7f949e4f728cbc5bcfea4cc19e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:11.859059 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad21ee-5ad0-4d37-8403-cf564e94f95c service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:11.870524 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad21ee-5ad0-4d37-8403-cf564e94f95c service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:11.933369 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e50a6-dc31-427e-9be0-a32035cbfbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:11.934203 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e50a6-dc31-427e-9be0-a32035cbfbde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:11.934489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e50a6-dc31-427e-9be0-a32035cbfbde admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:11.934759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e50a6-dc31-427e-9be0-a32035cbfbde admin admin] PATH_INFO: `/v3/users/fea37696f4eb4d43840056837b609d28` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:11.935910 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e50a6-dc31-427e-9be0-a32035cbfbde admin admin] RBAC: Authorizing `identity:delete_user(user_id=fea37696f4eb4d43840056837b609d28)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:11.937821 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e50a6-dc31-427e-9be0-a32035cbfbde admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:11.986323 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-dd1e50a6-dc31-427e-9be0-a32035cbfbde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fea37696f4eb4d43840056837b609d28'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:11.991283 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:11.994246 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-dd1e50a6-dc31-427e-9be0-a32035cbfbde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fea37696f4eb4d43840056837b609d28'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:12.008354 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-dd1e50a6-dc31-427e-9be0-a32035cbfbde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fea37696f4eb4d43840056837b609d28'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:12.015964 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-dd1e50a6-dc31-427e-9be0-a32035cbfbde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fea37696f4eb4d43840056837b609d28'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:12.016676 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-dd1e50a6-dc31-427e-9be0-a32035cbfbde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fea37696f4eb4d43840056837b609d28'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:12.023594 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1205/2394] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:20:11 2022] DELETE /identity/v3/users/fea37696f4eb4d43840056837b609d28 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:12.529146 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e60e4b-20b7-4352-afb2-439e3a76fab5 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:12.531216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-c2e60e4b-20b7-4352-afb2-439e3a76fab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:12.553140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e60e4b-20b7-4352-afb2-439e3a76fab5 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:12.637340 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f8ff6-0dbd-4c04-811e-44c36a9f7810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:12.639055 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f8ff6-0dbd-4c04-811e-44c36a9f7810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:12.639505 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f8ff6-0dbd-4c04-811e-44c36a9f7810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:12.640654 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f8ff6-0dbd-4c04-811e-44c36a9f7810 admin admin] PATH_INFO: `/v3/projects/f371e5385fbf46e2b77633ea5049f97b` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:12.642230 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f8ff6-0dbd-4c04-811e-44c36a9f7810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f371e5385fbf46e2b77633ea5049f97b)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:12.645161 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f8ff6-0dbd-4c04-811e-44c36a9f7810 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:12.717929 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-de5f8ff6-0dbd-4c04-811e-44c36a9f7810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f371e5385fbf46e2b77633ea5049f97b', 'request_id': 'req-de5f8ff6-0dbd-4c04-811e-44c36a9f7810'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:12.728118 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-de5f8ff6-0dbd-4c04-811e-44c36a9f7810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f371e5385fbf46e2b77633ea5049f97b', 'request_id': 'req-de5f8ff6-0dbd-4c04-811e-44c36a9f7810'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:12.738140 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-de5f8ff6-0dbd-4c04-811e-44c36a9f7810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f371e5385fbf46e2b77633ea5049f97b', 'request_id': 'req-de5f8ff6-0dbd-4c04-811e-44c36a9f7810'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:12.739482 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:12.752558 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-de5f8ff6-0dbd-4c04-811e-44c36a9f7810 admin admin] The token cache is being invalidate because project f371e5385fbf46e2b77633ea5049f97b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:20:12.753713 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-de5f8ff6-0dbd-4c04-811e-44c36a9f7810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:12.754836 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-de5f8ff6-0dbd-4c04-811e-44c36a9f7810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:12.756784 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1190/2395] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:20:12 2022] DELETE /identity/v3/projects/f371e5385fbf46e2b77633ea5049f97b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:12.761696 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e1518-faca-42de-b6e1-b70e44779864 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:12.761986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e1518-faca-42de-b6e1-b70e44779864 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:12.762264 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e1518-faca-42de-b6e1-b70e44779864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:12.787039 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-328e1518-faca-42de-b6e1-b70e44779864 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:12.788337 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-328e1518-faca-42de-b6e1-b70e44779864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:12.867332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1206/2396] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:12.874993 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db44806-59ff-4bf9-95d4-24353d5e3001 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:12.875279 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db44806-59ff-4bf9-95d4-24353d5e3001 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:12.875650 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db44806-59ff-4bf9-95d4-24353d5e3001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:12.897534 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-7db44806-59ff-4bf9-95d4-24353d5e3001 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:12.898862 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-7db44806-59ff-4bf9-95d4-24353d5e3001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:12.906787 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1191/2397] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:12.911721 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e1518-faca-42de-b6e1-b70e44779864 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:12.922380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e1518-faca-42de-b6e1-b70e44779864 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:12.927202 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bae548-e996-468d-a5dd-5f0e32f0ffa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:12.927911 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bae548-e996-468d-a5dd-5f0e32f0ffa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:12.928882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bae548-e996-468d-a5dd-5f0e32f0ffa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:12.928882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bae548-e996-468d-a5dd-5f0e32f0ffa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:12.929109 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bae548-e996-468d-a5dd-5f0e32f0ffa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:20:12.929378 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bae548-e996-468d-a5dd-5f0e32f0ffa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:12.931097 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bae548-e996-468d-a5dd-5f0e32f0ffa3 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:12.943946 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1207/2398] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:20:12.948111 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db44806-59ff-4bf9-95d4-24353d5e3001 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:12.958426 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db44806-59ff-4bf9-95d4-24353d5e3001 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:12.974093 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e48337-0723-4cd1-bac9-43aef65c19ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:12.974832 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e48337-0723-4cd1-bac9-43aef65c19ba admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:12.976126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e48337-0723-4cd1-bac9-43aef65c19ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:12.976126 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e48337-0723-4cd1-bac9-43aef65c19ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:12.976410 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e48337-0723-4cd1-bac9-43aef65c19ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:12.978786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e48337-0723-4cd1-bac9-43aef65c19ba admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:13.011291 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1192/2399] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:20:12 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:20:13.015725 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bae548-e996-468d-a5dd-5f0e32f0ffa3 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:13.030171 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bae548-e996-468d-a5dd-5f0e32f0ffa3 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:13.093937 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196cac8-078c-4ddb-ab81-b2a7235cf110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:13.097960 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196cac8-078c-4ddb-ab81-b2a7235cf110 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:13.098371 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196cac8-078c-4ddb-ab81-b2a7235cf110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:13.098651 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196cac8-078c-4ddb-ab81-b2a7235cf110 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:13.099324 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196cac8-078c-4ddb-ab81-b2a7235cf110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:13.101311 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196cac8-078c-4ddb-ab81-b2a7235cf110 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:13.126099 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1208/2400] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:20:13 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:13.132254 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e48337-0723-4cd1-bac9-43aef65c19ba admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:13.145998 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e48337-0723-4cd1-bac9-43aef65c19ba admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:13.150982 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b30f3-5dc8-4100-89de-9460affd7a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:13.151620 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b30f3-5dc8-4100-89de-9460affd7a6d admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:13.151895 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b30f3-5dc8-4100-89de-9460affd7a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:13.152161 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b30f3-5dc8-4100-89de-9460affd7a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:13.152796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b30f3-5dc8-4100-89de-9460affd7a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:13.154394 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b30f3-5dc8-4100-89de-9460affd7a6d admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:13.166151 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1193/2401] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:13.169920 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196cac8-078c-4ddb-ab81-b2a7235cf110 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:13.180870 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196cac8-078c-4ddb-ab81-b2a7235cf110 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:13.186424 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd8c2a-db0a-4e7c-b297-d1633eda74ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:13.187448 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd8c2a-db0a-4e7c-b297-d1633eda74ce admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:13.187791 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd8c2a-db0a-4e7c-b297-d1633eda74ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:13.188703 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd8c2a-db0a-4e7c-b297-d1633eda74ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:13.189367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd8c2a-db0a-4e7c-b297-d1633eda74ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:13.191699 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd8c2a-db0a-4e7c-b297-d1633eda74ce admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:13.219479 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1209/2402] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:13.222549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b30f3-5dc8-4100-89de-9460affd7a6d admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:13.237697 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b30f3-5dc8-4100-89de-9460affd7a6d admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:13.247475 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113a938-2063-4a54-bd18-6126e36c5547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:13.248149 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113a938-2063-4a54-bd18-6126e36c5547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:13.248426 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113a938-2063-4a54-bd18-6126e36c5547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:13.248693 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113a938-2063-4a54-bd18-6126e36c5547 admin admin] PATH_INFO: `/v3/projects/185c4606880645b98346b588a0be05ef/users/9118771f2db24b28b242729b18d7c9c8/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:13.266575 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113a938-2063-4a54-bd18-6126e36c5547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=185c4606880645b98346b588a0be05ef, user_id=9118771f2db24b28b242729b18d7c9c8, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:13.270139 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113a938-2063-4a54-bd18-6126e36c5547 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:13.296914 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1194/2403] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:20:13 2022] PUT /identity/v3/projects/185c4606880645b98346b588a0be05ef/users/9118771f2db24b28b242729b18d7c9c8/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:20:13.308379 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d3bd2-001a-486f-864b-aded9feab1f4 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:13.308683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d3bd2-001a-486f-864b-aded9feab1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:13.308927 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d3bd2-001a-486f-864b-aded9feab1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:13.349974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-1c8d3bd2-001a-486f-864b-aded9feab1f4 None None] MFA Rules not processed for user `9118771f2db24b28b242729b18d7c9c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:13.351232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1c8d3bd2-001a-486f-864b-aded9feab1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:13.400432 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:13.490767 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1210/2404] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:13.495472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113a938-2063-4a54-bd18-6126e36c5547 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:13.606761 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113a938-2063-4a54-bd18-6126e36c5547 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:13.615617 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4f95d-d36b-430b-b8ea-f912826cd7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:13.616243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4f95d-d36b-430b-b8ea-f912826cd7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:13.616517 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4f95d-d36b-430b-b8ea-f912826cd7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:13.619606 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4f95d-d36b-430b-b8ea-f912826cd7a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:13.620299 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4f95d-d36b-430b-b8ea-f912826cd7a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:13.622279 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4f95d-d36b-430b-b8ea-f912826cd7a3 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:13.679502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1195/2405] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:20:13 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:13.682779 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d3bd2-001a-486f-864b-aded9feab1f4 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:13.697593 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d3bd2-001a-486f-864b-aded9feab1f4 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:13.808391 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88678d89-8d3c-4d80-9dc7-6a0734f3e5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:13.809358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88678d89-8d3c-4d80-9dc7-6a0734f3e5cf admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:13.809929 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88678d89-8d3c-4d80-9dc7-6a0734f3e5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:13.810801 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88678d89-8d3c-4d80-9dc7-6a0734f3e5cf admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:13.812761 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88678d89-8d3c-4d80-9dc7-6a0734f3e5cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:13.814954 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88678d89-8d3c-4d80-9dc7-6a0734f3e5cf admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:13.849632 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1211/2406] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:20:13 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:20:13.853192 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4f95d-d36b-430b-b8ea-f912826cd7a3 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:13.869090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4f95d-d36b-430b-b8ea-f912826cd7a3 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:13.885738 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ee184-8fc0-45df-bcf3-7bcaebb61cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:13.886376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ee184-8fc0-45df-bcf3-7bcaebb61cdf admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:13.886715 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ee184-8fc0-45df-bcf3-7bcaebb61cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:13.886993 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ee184-8fc0-45df-bcf3-7bcaebb61cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:13.888151 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ee184-8fc0-45df-bcf3-7bcaebb61cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:13.890327 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ee184-8fc0-45df-bcf3-7bcaebb61cdf admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:13.910300 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88678d89-8d3c-4d80-9dc7-6a0734f3e5cf admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:13.911181 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1196/2407] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:13.928763 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88678d89-8d3c-4d80-9dc7-6a0734f3e5cf admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:13.934670 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381ad6a-9d3a-4147-b7d8-9f03c2ec6a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:13.935660 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381ad6a-9d3a-4147-b7d8-9f03c2ec6a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:13.936140 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381ad6a-9d3a-4147-b7d8-9f03c2ec6a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:13.936412 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381ad6a-9d3a-4147-b7d8-9f03c2ec6a23 admin admin] PATH_INFO: `/v3/projects/a1b9e37601074eb0b80ec25a8bf7a402/users/fedd0082335748fda37f80602c7db976/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:13.954707 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381ad6a-9d3a-4147-b7d8-9f03c2ec6a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b9e37601074eb0b80ec25a8bf7a402, user_id=fedd0082335748fda37f80602c7db976, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:13.959022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381ad6a-9d3a-4147-b7d8-9f03c2ec6a23 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:13.983256 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1212/2408] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:20:13 2022] PUT /identity/v3/projects/a1b9e37601074eb0b80ec25a8bf7a402/users/fedd0082335748fda37f80602c7db976/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:20:13.987676 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ee184-8fc0-45df-bcf3-7bcaebb61cdf admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:14.010453 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ee184-8fc0-45df-bcf3-7bcaebb61cdf admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:14.108652 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bc13e-80af-4bad-b422-4c0e98dc5ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:14.109441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bc13e-80af-4bad-b422-4c0e98dc5ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:14.109820 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bc13e-80af-4bad-b422-4c0e98dc5ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:14.110352 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bc13e-80af-4bad-b422-4c0e98dc5ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:14.111114 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6bc13e-80af-4bad-b422-4c0e98dc5ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:14.114195 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6bc13e-80af-4bad-b422-4c0e98dc5ba7 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:14.122141 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:14.134811 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1197/2409] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:14.135406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381ad6a-9d3a-4147-b7d8-9f03c2ec6a23 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:14.153409 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381ad6a-9d3a-4147-b7d8-9f03c2ec6a23 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:14.160620 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203b710-ce2d-481d-b9e6-c7a0b30fa56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:14.161730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203b710-ce2d-481d-b9e6-c7a0b30fa56d admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:14.162184 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203b710-ce2d-481d-b9e6-c7a0b30fa56d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:14.162614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203b710-ce2d-481d-b9e6-c7a0b30fa56d admin admin] PATH_INFO: `/v3/projects/a1b9e37601074eb0b80ec25a8bf7a402/users/fedd0082335748fda37f80602c7db976/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:14.166438 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203b710-ce2d-481d-b9e6-c7a0b30fa56d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b9e37601074eb0b80ec25a8bf7a402, user_id=fedd0082335748fda37f80602c7db976, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:14.171029 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203b710-ce2d-481d-b9e6-c7a0b30fa56d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:14.186418 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1213/2410] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:20:14 2022] PUT /identity/v3/projects/a1b9e37601074eb0b80ec25a8bf7a402/users/fedd0082335748fda37f80602c7db976/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:14.199480 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217f83f-6843-4c48-bb0b-a0c10f7e6d1f None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:14.200052 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217f83f-6843-4c48-bb0b-a0c10f7e6d1f None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:14.200612 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217f83f-6843-4c48-bb0b-a0c10f7e6d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:14.245849 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-8217f83f-6843-4c48-bb0b-a0c10f7e6d1f None None] MFA Rules not processed for user `fedd0082335748fda37f80602c7db976`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:14.247384 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-8217f83f-6843-4c48-bb0b-a0c10f7e6d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:14.332330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1198/2411] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:14.344127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203b710-ce2d-481d-b9e6-c7a0b30fa56d admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:14.346074 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a203b710-ce2d-481d-b9e6-c7a0b30fa56d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:14.426614 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203b710-ce2d-481d-b9e6-c7a0b30fa56d admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:14.431027 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09fd11-301e-41ee-a2ad-fdb80906362b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:14.432127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09fd11-301e-41ee-a2ad-fdb80906362b service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:14.432547 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09fd11-301e-41ee-a2ad-fdb80906362b service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:14.432956 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09fd11-301e-41ee-a2ad-fdb80906362b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:14.471141 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:14.507602 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09fd11-301e-41ee-a2ad-fdb80906362b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:14.509819 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09fd11-301e-41ee-a2ad-fdb80906362b service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:14.521866 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1214/2412] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:19.263629 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217f83f-6843-4c48-bb0b-a0c10f7e6d1f None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:19.265167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-8217f83f-6843-4c48-bb0b-a0c10f7e6d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:19.280027 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217f83f-6843-4c48-bb0b-a0c10f7e6d1f None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:19.283559 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f277f-a340-4d40-ac34-55c73bc7accb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:19.284179 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f277f-a340-4d40-ac34-55c73bc7accb service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:19.284991 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f277f-a340-4d40-ac34-55c73bc7accb service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:19.286131 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f277f-a340-4d40-ac34-55c73bc7accb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:19.296980 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f277f-a340-4d40-ac34-55c73bc7accb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:19.298552 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f277f-a340-4d40-ac34-55c73bc7accb service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:19.311485 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1199/2413] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:19.440096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09fd11-301e-41ee-a2ad-fdb80906362b service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:19.442585 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-bd09fd11-301e-41ee-a2ad-fdb80906362b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:19.525298 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09fd11-301e-41ee-a2ad-fdb80906362b service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:19.531057 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93815d55-f0df-4941-b38f-cf4bd15340b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:19.531722 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93815d55-f0df-4941-b38f-cf4bd15340b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:19.532003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93815d55-f0df-4941-b38f-cf4bd15340b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:19.532282 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93815d55-f0df-4941-b38f-cf4bd15340b5 admin admin] PATH_INFO: `/v3/users/a8c709728b714d0ca585d982ed536134` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:19.533407 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93815d55-f0df-4941-b38f-cf4bd15340b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8c709728b714d0ca585d982ed536134)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:19.540830 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93815d55-f0df-4941-b38f-cf4bd15340b5 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:19.594445 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-93815d55-f0df-4941-b38f-cf4bd15340b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8c709728b714d0ca585d982ed536134'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:19.603360 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-93815d55-f0df-4941-b38f-cf4bd15340b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8c709728b714d0ca585d982ed536134'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:19.617831 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-93815d55-f0df-4941-b38f-cf4bd15340b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8c709728b714d0ca585d982ed536134'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:19.626734 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-93815d55-f0df-4941-b38f-cf4bd15340b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8c709728b714d0ca585d982ed536134'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:19.627442 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-93815d55-f0df-4941-b38f-cf4bd15340b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8c709728b714d0ca585d982ed536134'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:19.633930 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1215/2414] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:20:19 2022] DELETE /identity/v3/users/a8c709728b714d0ca585d982ed536134 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:19.820401 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f277f-a340-4d40-ac34-55c73bc7accb service cinder] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:19.831923 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f277f-a340-4d40-ac34-55c73bc7accb service cinder] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:19.893726 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8deb08-be75-45ea-a464-0efa8f1a0422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:19.894711 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8deb08-be75-45ea-a464-0efa8f1a0422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:19.894983 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8deb08-be75-45ea-a464-0efa8f1a0422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:19.895132 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8deb08-be75-45ea-a464-0efa8f1a0422 admin admin] PATH_INFO: `/v3/projects/3493366e32404f0e9860120dd6027de1` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:19.896387 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8deb08-be75-45ea-a464-0efa8f1a0422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3493366e32404f0e9860120dd6027de1)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:19.898235 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8deb08-be75-45ea-a464-0efa8f1a0422 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:19.978612 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-ef8deb08-be75-45ea-a464-0efa8f1a0422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3493366e32404f0e9860120dd6027de1', 'request_id': 'req-ef8deb08-be75-45ea-a464-0efa8f1a0422'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:19.986437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-ef8deb08-be75-45ea-a464-0efa8f1a0422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3493366e32404f0e9860120dd6027de1', 'request_id': 'req-ef8deb08-be75-45ea-a464-0efa8f1a0422'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:19.994081 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-ef8deb08-be75-45ea-a464-0efa8f1a0422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3493366e32404f0e9860120dd6027de1', 'request_id': 'req-ef8deb08-be75-45ea-a464-0efa8f1a0422'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:20.006554 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-ef8deb08-be75-45ea-a464-0efa8f1a0422 admin admin] The token cache is being invalidate because project 3493366e32404f0e9860120dd6027de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:20:20.006843 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-ef8deb08-be75-45ea-a464-0efa8f1a0422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:20.007525 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-ef8deb08-be75-45ea-a464-0efa8f1a0422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:20.009221 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1200/2415] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:20:19 2022] DELETE /identity/v3/projects/3493366e32404f0e9860120dd6027de1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:20.012976 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93815d55-f0df-4941-b38f-cf4bd15340b5 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:20.014453 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-93815d55-f0df-4941-b38f-cf4bd15340b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:20.031068 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93815d55-f0df-4941-b38f-cf4bd15340b5 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:20.087148 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:20.104210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61ec70-f415-465d-a44e-459fe71e5a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:20.104995 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61ec70-f415-465d-a44e-459fe71e5a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:20.105280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61ec70-f415-465d-a44e-459fe71e5a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:20.106013 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61ec70-f415-465d-a44e-459fe71e5a4f admin admin] PATH_INFO: `/v3/users/03da186cd3b24e87890611623115a7b6` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:20.107650 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61ec70-f415-465d-a44e-459fe71e5a4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=03da186cd3b24e87890611623115a7b6)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:20.109588 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61ec70-f415-465d-a44e-459fe71e5a4f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:20.169205 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1c61ec70-f415-465d-a44e-459fe71e5a4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03da186cd3b24e87890611623115a7b6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:20.177449 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1c61ec70-f415-465d-a44e-459fe71e5a4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03da186cd3b24e87890611623115a7b6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:20.189242 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1c61ec70-f415-465d-a44e-459fe71e5a4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03da186cd3b24e87890611623115a7b6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:20.196991 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1c61ec70-f415-465d-a44e-459fe71e5a4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03da186cd3b24e87890611623115a7b6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:20.197596 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1c61ec70-f415-465d-a44e-459fe71e5a4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03da186cd3b24e87890611623115a7b6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:20.203328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1216/2416] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:20:20 2022] DELETE /identity/v3/users/03da186cd3b24e87890611623115a7b6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:20.371356 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8deb08-be75-45ea-a464-0efa8f1a0422 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:20.372889 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-ef8deb08-be75-45ea-a464-0efa8f1a0422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:20.381286 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:20.387823 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8deb08-be75-45ea-a464-0efa8f1a0422 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:20.448436 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f6fac-62cc-48e5-8c31-228a9016a433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:20.449077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f6fac-62cc-48e5-8c31-228a9016a433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:20.449351 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f6fac-62cc-48e5-8c31-228a9016a433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:20.449655 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f6fac-62cc-48e5-8c31-228a9016a433 admin admin] PATH_INFO: `/v3/projects/fbe73dad231e4609beae571499d8d358` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:20.450789 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f6fac-62cc-48e5-8c31-228a9016a433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe73dad231e4609beae571499d8d358)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:20.452764 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f6fac-62cc-48e5-8c31-228a9016a433 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:20.499997 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f41f6fac-62cc-48e5-8c31-228a9016a433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe73dad231e4609beae571499d8d358', 'request_id': 'req-f41f6fac-62cc-48e5-8c31-228a9016a433'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:20.507104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f41f6fac-62cc-48e5-8c31-228a9016a433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe73dad231e4609beae571499d8d358', 'request_id': 'req-f41f6fac-62cc-48e5-8c31-228a9016a433'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:20.512631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f41f6fac-62cc-48e5-8c31-228a9016a433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe73dad231e4609beae571499d8d358', 'request_id': 'req-f41f6fac-62cc-48e5-8c31-228a9016a433'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:20.524297 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f41f6fac-62cc-48e5-8c31-228a9016a433 admin admin] The token cache is being invalidate because project fbe73dad231e4609beae571499d8d358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:20:20.524582 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f41f6fac-62cc-48e5-8c31-228a9016a433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:20.525208 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f41f6fac-62cc-48e5-8c31-228a9016a433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:20.526657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1201/2417] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:20:20 2022] DELETE /identity/v3/projects/fbe73dad231e4609beae571499d8d358 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:20:24.309175 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61ec70-f415-465d-a44e-459fe71e5a4f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:24.311324 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1c61ec70-f415-465d-a44e-459fe71e5a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:24.324889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61ec70-f415-465d-a44e-459fe71e5a4f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:24.388999 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051695bf-4d98-431b-aa72-1dda85284c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:24.390180 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051695bf-4d98-431b-aa72-1dda85284c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:24.390458 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051695bf-4d98-431b-aa72-1dda85284c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:24.390726 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051695bf-4d98-431b-aa72-1dda85284c77 admin admin] PATH_INFO: `/v3/users/9118771f2db24b28b242729b18d7c9c8` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:24.391883 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051695bf-4d98-431b-aa72-1dda85284c77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9118771f2db24b28b242729b18d7c9c8)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:24.393808 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051695bf-4d98-431b-aa72-1dda85284c77 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:24.443666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-051695bf-4d98-431b-aa72-1dda85284c77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9118771f2db24b28b242729b18d7c9c8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:24.451680 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-051695bf-4d98-431b-aa72-1dda85284c77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9118771f2db24b28b242729b18d7c9c8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:24.462912 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:24.464788 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-051695bf-4d98-431b-aa72-1dda85284c77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9118771f2db24b28b242729b18d7c9c8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:24.474954 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-051695bf-4d98-431b-aa72-1dda85284c77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9118771f2db24b28b242729b18d7c9c8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:24.475649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-051695bf-4d98-431b-aa72-1dda85284c77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9118771f2db24b28b242729b18d7c9c8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:24.482868 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1217/2418] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:20:24 2022] DELETE /identity/v3/users/9118771f2db24b28b242729b18d7c9c8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:24.487721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc8c96-53d4-4c43-9817-e15f515c45dd None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:24.488257 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc8c96-53d4-4c43-9817-e15f515c45dd None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:24.488257 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc8c96-53d4-4c43-9817-e15f515c45dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:24.510660 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-87cc8c96-53d4-4c43-9817-e15f515c45dd None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:24.511950 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-87cc8c96-53d4-4c43-9817-e15f515c45dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:24.580592 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1202/2419] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:24.591393 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051695bf-4d98-431b-aa72-1dda85284c77 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:24.593287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-051695bf-4d98-431b-aa72-1dda85284c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:24.654468 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051695bf-4d98-431b-aa72-1dda85284c77 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:24.658509 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87979a28-1b22-4e04-aab5-4fec0784f5ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:24.659121 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87979a28-1b22-4e04-aab5-4fec0784f5ca service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:24.659396 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87979a28-1b22-4e04-aab5-4fec0784f5ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:24.659693 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87979a28-1b22-4e04-aab5-4fec0784f5ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:24.669369 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87979a28-1b22-4e04-aab5-4fec0784f5ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:24.670798 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87979a28-1b22-4e04-aab5-4fec0784f5ca service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:24.681367 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1218/2420] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:24.955367 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc8c96-53d4-4c43-9817-e15f515c45dd None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:24.956830 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-87cc8c96-53d4-4c43-9817-e15f515c45dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:24.969990 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc8c96-53d4-4c43-9817-e15f515c45dd None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:24.976420 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e63923-84a2-4966-a9d7-c44525d7b288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:24.977086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e63923-84a2-4966-a9d7-c44525d7b288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:24.977282 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e63923-84a2-4966-a9d7-c44525d7b288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:24.977533 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e63923-84a2-4966-a9d7-c44525d7b288 admin admin] PATH_INFO: `/v3/projects/185c4606880645b98346b588a0be05ef` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:24.978679 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e63923-84a2-4966-a9d7-c44525d7b288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=185c4606880645b98346b588a0be05ef)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:24.982549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e63923-84a2-4966-a9d7-c44525d7b288 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:25.021955 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:25.038690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-45e63923-84a2-4966-a9d7-c44525d7b288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '185c4606880645b98346b588a0be05ef', 'request_id': 'req-45e63923-84a2-4966-a9d7-c44525d7b288'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:25.046726 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-45e63923-84a2-4966-a9d7-c44525d7b288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '185c4606880645b98346b588a0be05ef', 'request_id': 'req-45e63923-84a2-4966-a9d7-c44525d7b288'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:25.052636 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-45e63923-84a2-4966-a9d7-c44525d7b288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '185c4606880645b98346b588a0be05ef', 'request_id': 'req-45e63923-84a2-4966-a9d7-c44525d7b288'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:25.063710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-45e63923-84a2-4966-a9d7-c44525d7b288 admin admin] The token cache is being invalidate because project 185c4606880645b98346b588a0be05ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:20:25.063997 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-45e63923-84a2-4966-a9d7-c44525d7b288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:25.064623 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-45e63923-84a2-4966-a9d7-c44525d7b288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:25.066097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1203/2421] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:20:24 2022] DELETE /identity/v3/projects/185c4606880645b98346b588a0be05ef => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:25.070625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87979a28-1b22-4e04-aab5-4fec0784f5ca service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:25.080118 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87979a28-1b22-4e04-aab5-4fec0784f5ca service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:25.135540 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb38ae-7148-4cab-bd23-31898ff845c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:25.136165 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb38ae-7148-4cab-bd23-31898ff845c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:25.136440 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb38ae-7148-4cab-bd23-31898ff845c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:25.136712 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb38ae-7148-4cab-bd23-31898ff845c3 admin admin] PATH_INFO: `/v3/users/fedd0082335748fda37f80602c7db976` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:25.137807 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb38ae-7148-4cab-bd23-31898ff845c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fedd0082335748fda37f80602c7db976)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:25.139763 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb38ae-7148-4cab-bd23-31898ff845c3 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:25.184334 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-eebb38ae-7148-4cab-bd23-31898ff845c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fedd0082335748fda37f80602c7db976'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:25.190977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-eebb38ae-7148-4cab-bd23-31898ff845c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fedd0082335748fda37f80602c7db976'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:25.203102 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-eebb38ae-7148-4cab-bd23-31898ff845c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fedd0082335748fda37f80602c7db976'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:25.211223 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-eebb38ae-7148-4cab-bd23-31898ff845c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fedd0082335748fda37f80602c7db976'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:25.211855 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-eebb38ae-7148-4cab-bd23-31898ff845c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fedd0082335748fda37f80602c7db976'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:25.217855 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1219/2422] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:20:25 2022] DELETE /identity/v3/users/fedd0082335748fda37f80602c7db976 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:25.487144 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e63923-84a2-4966-a9d7-c44525d7b288 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:25.489297 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-45e63923-84a2-4966-a9d7-c44525d7b288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:25.502281 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e63923-84a2-4966-a9d7-c44525d7b288 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:25.560971 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ad9a3-8a92-4130-b801-821f56468abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:25.561600 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ad9a3-8a92-4130-b801-821f56468abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:25.561870 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ad9a3-8a92-4130-b801-821f56468abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:25.562133 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ad9a3-8a92-4130-b801-821f56468abc admin admin] PATH_INFO: `/v3/projects/a1b9e37601074eb0b80ec25a8bf7a402` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:25.563216 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ad9a3-8a92-4130-b801-821f56468abc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1b9e37601074eb0b80ec25a8bf7a402)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:25.565206 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ad9a3-8a92-4130-b801-821f56468abc admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:25.611365 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e33ad9a3-8a92-4130-b801-821f56468abc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1b9e37601074eb0b80ec25a8bf7a402', 'request_id': 'req-e33ad9a3-8a92-4130-b801-821f56468abc'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:25.619353 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e33ad9a3-8a92-4130-b801-821f56468abc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1b9e37601074eb0b80ec25a8bf7a402', 'request_id': 'req-e33ad9a3-8a92-4130-b801-821f56468abc'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:25.625384 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e33ad9a3-8a92-4130-b801-821f56468abc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1b9e37601074eb0b80ec25a8bf7a402', 'request_id': 'req-e33ad9a3-8a92-4130-b801-821f56468abc'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:25.637673 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e33ad9a3-8a92-4130-b801-821f56468abc admin admin] The token cache is being invalidate because project a1b9e37601074eb0b80ec25a8bf7a402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:20:25.637961 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e33ad9a3-8a92-4130-b801-821f56468abc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:25.638609 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e33ad9a3-8a92-4130-b801-821f56468abc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:25.640191 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1204/2423] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:20:25 2022] DELETE /identity/v3/projects/a1b9e37601074eb0b80ec25a8bf7a402 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:25.646165 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d65495-0f00-45ab-a9e0-5d22527d4d2f None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:25.646622 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d65495-0f00-45ab-a9e0-5d22527d4d2f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:25.646732 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d65495-0f00-45ab-a9e0-5d22527d4d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:25.666546 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-06d65495-0f00-45ab-a9e0-5d22527d4d2f None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:25.667757 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-06d65495-0f00-45ab-a9e0-5d22527d4d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:25.672743 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:25.726591 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1220/2424] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:20:25.734943 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee05020-ca25-48ec-8125-1bd416f08046 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:25.735226 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee05020-ca25-48ec-8125-1bd416f08046 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:25.735527 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee05020-ca25-48ec-8125-1bd416f08046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:25.756153 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-9ee05020-ca25-48ec-8125-1bd416f08046 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:25.757360 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-9ee05020-ca25-48ec-8125-1bd416f08046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:25.765305 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1205/2425] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:25.769447 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d65495-0f00-45ab-a9e0-5d22527d4d2f None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:25.779259 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d65495-0f00-45ab-a9e0-5d22527d4d2f None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:25.783882 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cc39d-0c7a-471f-910f-0c5c418f631f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:25.784477 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cc39d-0c7a-471f-910f-0c5c418f631f admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:25.784757 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cc39d-0c7a-471f-910f-0c5c418f631f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:25.785032 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cc39d-0c7a-471f-910f-0c5c418f631f admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:25.786197 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cc39d-0c7a-471f-910f-0c5c418f631f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:20:25.786494 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cc39d-0c7a-471f-910f-0c5c418f631f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:25.788119 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cc39d-0c7a-471f-910f-0c5c418f631f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:25.799401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1221/2426] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:20:25.804803 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee05020-ca25-48ec-8125-1bd416f08046 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:25.813793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee05020-ca25-48ec-8125-1bd416f08046 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:25.818580 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd7fe8-f12d-4c9b-93f9-4406dd746ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:25.819099 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd7fe8-f12d-4c9b-93f9-4406dd746ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:25.819373 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd7fe8-f12d-4c9b-93f9-4406dd746ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:25.819673 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd7fe8-f12d-4c9b-93f9-4406dd746ea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:25.820287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd7fe8-f12d-4c9b-93f9-4406dd746ea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:25.822179 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd7fe8-f12d-4c9b-93f9-4406dd746ea2 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:25.852756 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1206/2427] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:20:25 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:25.853847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cc39d-0c7a-471f-910f-0c5c418f631f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:25.864653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cc39d-0c7a-471f-910f-0c5c418f631f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:25.920308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f6347-0209-4898-af6c-3971a3105a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:25.920906 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f6347-0209-4898-af6c-3971a3105a5e admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:25.921182 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f6347-0209-4898-af6c-3971a3105a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:25.921450 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f6347-0209-4898-af6c-3971a3105a5e admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:25.922065 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f6347-0209-4898-af6c-3971a3105a5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:25.924003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f6347-0209-4898-af6c-3971a3105a5e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:25.945171 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1222/2428] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:20:25 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:20:25.952647 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd7fe8-f12d-4c9b-93f9-4406dd746ea2 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:25.963543 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd7fe8-f12d-4c9b-93f9-4406dd746ea2 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:25.968427 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e496fea-2bd2-40c3-95b0-bfecdca63691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:25.969015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e496fea-2bd2-40c3-95b0-bfecdca63691 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:25.969295 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e496fea-2bd2-40c3-95b0-bfecdca63691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:25.969567 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e496fea-2bd2-40c3-95b0-bfecdca63691 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:25.970198 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e496fea-2bd2-40c3-95b0-bfecdca63691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:25.971907 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e496fea-2bd2-40c3-95b0-bfecdca63691 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:25.982820 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1207/2429] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:25.986841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f6347-0209-4898-af6c-3971a3105a5e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:25.997308 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f6347-0209-4898-af6c-3971a3105a5e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:26.002153 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed926fc-2c65-40a0-bd8c-f6b124dcf3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:26.002780 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed926fc-2c65-40a0-bd8c-f6b124dcf3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:26.003059 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed926fc-2c65-40a0-bd8c-f6b124dcf3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:26.003333 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed926fc-2c65-40a0-bd8c-f6b124dcf3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:26.004075 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed926fc-2c65-40a0-bd8c-f6b124dcf3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:26.005649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed926fc-2c65-40a0-bd8c-f6b124dcf3e9 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:26.016176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1223/2430] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:26.020287 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e496fea-2bd2-40c3-95b0-bfecdca63691 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:26.030004 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e496fea-2bd2-40c3-95b0-bfecdca63691 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:26.034562 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93cbe0-e499-4942-a3d0-73d4b6695571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:26.035964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93cbe0-e499-4942-a3d0-73d4b6695571 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:26.036243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93cbe0-e499-4942-a3d0-73d4b6695571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:26.036513 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93cbe0-e499-4942-a3d0-73d4b6695571 admin admin] PATH_INFO: `/v3/projects/52c4bd8c44e6416f8d0996e0ce0e97a5/users/06d50682f1a446b28acb08cf5c256844/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:26.038697 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:26.053690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93cbe0-e499-4942-a3d0-73d4b6695571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c4bd8c44e6416f8d0996e0ce0e97a5, user_id=06d50682f1a446b28acb08cf5c256844, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:26.056406 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93cbe0-e499-4942-a3d0-73d4b6695571 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:26.069891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1208/2431] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:20:26 2022] PUT /identity/v3/projects/52c4bd8c44e6416f8d0996e0ce0e97a5/users/06d50682f1a446b28acb08cf5c256844/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:26.082461 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef71101-5876-4fdb-ba6d-b4fd6c001cc6 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:26.082754 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef71101-5876-4fdb-ba6d-b4fd6c001cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:26.083017 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef71101-5876-4fdb-ba6d-b4fd6c001cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:26.112019 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-7ef71101-5876-4fdb-ba6d-b4fd6c001cc6 None None] MFA Rules not processed for user `06d50682f1a446b28acb08cf5c256844`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:26.113193 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7ef71101-5876-4fdb-ba6d-b4fd6c001cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:26.177416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1224/2432] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:26.188793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93cbe0-e499-4942-a3d0-73d4b6695571 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:26.190446 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-7f93cbe0-e499-4942-a3d0-73d4b6695571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:26.247368 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93cbe0-e499-4942-a3d0-73d4b6695571 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:26.251022 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c85b9-080e-44b8-bc14-26a31c0f2bde service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0866de4d4e46d5b26719faf385d7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:26.251647 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c85b9-080e-44b8-bc14-26a31c0f2bde service glance] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:26.251929 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c85b9-080e-44b8-bc14-26a31c0f2bde service glance] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:26.252199 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c85b9-080e-44b8-bc14-26a31c0f2bde service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:26.260435 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c85b9-080e-44b8-bc14-26a31c0f2bde service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:26.261871 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c85b9-080e-44b8-bc14-26a31c0f2bde service glance] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:26.271280 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1209/2433] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:36.174460 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=94,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:36.266580 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:39.710368 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef71101-5876-4fdb-ba6d-b4fd6c001cc6 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:39.771258 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef71101-5876-4fdb-ba6d-b4fd6c001cc6 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:39.776498 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053da2a-21e3-4872-8805-2c2f76deda42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:39.777113 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053da2a-21e3-4872-8805-2c2f76deda42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:39.777386 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053da2a-21e3-4872-8805-2c2f76deda42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:39.777650 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053da2a-21e3-4872-8805-2c2f76deda42 admin admin] PATH_INFO: `/v3/users/06d50682f1a446b28acb08cf5c256844` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:39.778733 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053da2a-21e3-4872-8805-2c2f76deda42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d50682f1a446b28acb08cf5c256844)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:39.780662 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053da2a-21e3-4872-8805-2c2f76deda42 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:39.825546 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7053da2a-21e3-4872-8805-2c2f76deda42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d50682f1a446b28acb08cf5c256844'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:39.832094 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7053da2a-21e3-4872-8805-2c2f76deda42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d50682f1a446b28acb08cf5c256844'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:39.844445 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7053da2a-21e3-4872-8805-2c2f76deda42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d50682f1a446b28acb08cf5c256844'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:39.851287 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7053da2a-21e3-4872-8805-2c2f76deda42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d50682f1a446b28acb08cf5c256844'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:39.851913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7053da2a-21e3-4872-8805-2c2f76deda42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d50682f1a446b28acb08cf5c256844'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:39.857728 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1225/2434] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:20:39 2022] DELETE /identity/v3/users/06d50682f1a446b28acb08cf5c256844 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:39.862183 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecdc04-6e39-440a-8a04-ef3388b1544c None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:39.862682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecdc04-6e39-440a-8a04-ef3388b1544c None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:39.862791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecdc04-6e39-440a-8a04-ef3388b1544c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:39.881918 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-0fecdc04-6e39-440a-8a04-ef3388b1544c None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:39.883093 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-0fecdc04-6e39-440a-8a04-ef3388b1544c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:39.942547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1210/2435] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:39.953008 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053da2a-21e3-4872-8805-2c2f76deda42 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:39.954375 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7053da2a-21e3-4872-8805-2c2f76deda42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:40.010510 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053da2a-21e3-4872-8805-2c2f76deda42 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:40.014073 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088c201-780c-4f56-9033-3259a9991505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:40.014663 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088c201-780c-4f56-9033-3259a9991505 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:40.014934 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088c201-780c-4f56-9033-3259a9991505 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:40.015200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088c201-780c-4f56-9033-3259a9991505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:40.023896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088c201-780c-4f56-9033-3259a9991505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:40.025862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088c201-780c-4f56-9033-3259a9991505 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:40.035137 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1226/2436] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:40.303788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecdc04-6e39-440a-8a04-ef3388b1544c None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:40.305199 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-0fecdc04-6e39-440a-8a04-ef3388b1544c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:40.318000 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecdc04-6e39-440a-8a04-ef3388b1544c None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:40.323250 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32626d8e-7b11-4e25-828a-f664eb94c774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:40.323950 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32626d8e-7b11-4e25-828a-f664eb94c774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:40.324223 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32626d8e-7b11-4e25-828a-f664eb94c774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:40.324492 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32626d8e-7b11-4e25-828a-f664eb94c774 admin admin] PATH_INFO: `/v3/projects/52c4bd8c44e6416f8d0996e0ce0e97a5` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:40.326243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32626d8e-7b11-4e25-828a-f664eb94c774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52c4bd8c44e6416f8d0996e0ce0e97a5)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:40.328433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32626d8e-7b11-4e25-828a-f664eb94c774 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:40.376199 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-32626d8e-7b11-4e25-828a-f664eb94c774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52c4bd8c44e6416f8d0996e0ce0e97a5', 'request_id': 'req-32626d8e-7b11-4e25-828a-f664eb94c774'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:40.383577 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-32626d8e-7b11-4e25-828a-f664eb94c774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52c4bd8c44e6416f8d0996e0ce0e97a5', 'request_id': 'req-32626d8e-7b11-4e25-828a-f664eb94c774'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:40.389497 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-32626d8e-7b11-4e25-828a-f664eb94c774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52c4bd8c44e6416f8d0996e0ce0e97a5', 'request_id': 'req-32626d8e-7b11-4e25-828a-f664eb94c774'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:40.400274 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-32626d8e-7b11-4e25-828a-f664eb94c774 admin admin] The token cache is being invalidate because project 52c4bd8c44e6416f8d0996e0ce0e97a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:20:40.400550 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-32626d8e-7b11-4e25-828a-f664eb94c774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:40.401164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-32626d8e-7b11-4e25-828a-f664eb94c774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:40.402605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1211/2437] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:20:40 2022] DELETE /identity/v3/projects/52c4bd8c44e6416f8d0996e0ce0e97a5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:40.407550 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe6303-ce3a-49da-9f90-626c6eab5305 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:40.407856 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe6303-ce3a-49da-9f90-626c6eab5305 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:40.408127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe6303-ce3a-49da-9f90-626c6eab5305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:40.427873 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-51fe6303-ce3a-49da-9f90-626c6eab5305 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:40.429057 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-51fe6303-ce3a-49da-9f90-626c6eab5305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:40.446061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:40.491238 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1227/2438] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:40.500228 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c3220-2bb8-44e3-8c90-a0db62f8756b None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:40.500516 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c3220-2bb8-44e3-8c90-a0db62f8756b None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:40.500786 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c3220-2bb8-44e3-8c90-a0db62f8756b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:40.520308 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-979c3220-2bb8-44e3-8c90-a0db62f8756b None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:40.521549 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-979c3220-2bb8-44e3-8c90-a0db62f8756b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:40.529440 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1212/2439] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:20:40.533757 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe6303-ce3a-49da-9f90-626c6eab5305 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:40.544316 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe6303-ce3a-49da-9f90-626c6eab5305 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:40.548889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1247a2-43f0-47b9-b0a6-2d0a2ae9bc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:40.549483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1247a2-43f0-47b9-b0a6-2d0a2ae9bc49 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:40.549760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1247a2-43f0-47b9-b0a6-2d0a2ae9bc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:40.550027 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1247a2-43f0-47b9-b0a6-2d0a2ae9bc49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:40.550661 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1247a2-43f0-47b9-b0a6-2d0a2ae9bc49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:20:40.550961 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1247a2-43f0-47b9-b0a6-2d0a2ae9bc49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:40.552569 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1247a2-43f0-47b9-b0a6-2d0a2ae9bc49 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:40.564971 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1228/2440] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:20:40.569412 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c3220-2bb8-44e3-8c90-a0db62f8756b None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:40.578690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c3220-2bb8-44e3-8c90-a0db62f8756b None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:40.583331 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951f2fd-75cf-452d-8b54-1bb0a78b362e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:40.583953 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951f2fd-75cf-452d-8b54-1bb0a78b362e admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:40.584232 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951f2fd-75cf-452d-8b54-1bb0a78b362e admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:40.584499 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951f2fd-75cf-452d-8b54-1bb0a78b362e admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:40.585128 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951f2fd-75cf-452d-8b54-1bb0a78b362e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:40.587037 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951f2fd-75cf-452d-8b54-1bb0a78b362e admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:40.614548 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1213/2441] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:20:40 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:40.619409 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1247a2-43f0-47b9-b0a6-2d0a2ae9bc49 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:40.629323 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1247a2-43f0-47b9-b0a6-2d0a2ae9bc49 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:40.684401 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea0387-0d47-4cda-86ef-112e8e87162f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:40.684997 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea0387-0d47-4cda-86ef-112e8e87162f admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:40.685277 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea0387-0d47-4cda-86ef-112e8e87162f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:40.685550 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea0387-0d47-4cda-86ef-112e8e87162f admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:40.686177 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea0387-0d47-4cda-86ef-112e8e87162f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:40.688143 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea0387-0d47-4cda-86ef-112e8e87162f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:40.708500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1229/2442] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:20:40 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:40.713169 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951f2fd-75cf-452d-8b54-1bb0a78b362e admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:40.723401 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951f2fd-75cf-452d-8b54-1bb0a78b362e admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:40.728513 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f07fa-79ce-40a0-a463-a32c4afed44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:40.729091 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f07fa-79ce-40a0-a463-a32c4afed44c admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:40.729365 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f07fa-79ce-40a0-a463-a32c4afed44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:40.729629 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f07fa-79ce-40a0-a463-a32c4afed44c admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:40.730250 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f07fa-79ce-40a0-a463-a32c4afed44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:40.731873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f07fa-79ce-40a0-a463-a32c4afed44c admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:40.741525 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1214/2443] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:40.745490 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea0387-0d47-4cda-86ef-112e8e87162f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:40.755272 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea0387-0d47-4cda-86ef-112e8e87162f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:40.760078 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36ae71-e29e-48a2-82ad-959794646e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:40.760668 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36ae71-e29e-48a2-82ad-959794646e82 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:40.760953 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36ae71-e29e-48a2-82ad-959794646e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:40.761225 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36ae71-e29e-48a2-82ad-959794646e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:40.761862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36ae71-e29e-48a2-82ad-959794646e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:40.763499 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36ae71-e29e-48a2-82ad-959794646e82 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:40.773864 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1230/2444] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:20:40.778435 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f07fa-79ce-40a0-a463-a32c4afed44c admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:40.788444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f07fa-79ce-40a0-a463-a32c4afed44c admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:40.794457 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870ca3f-981e-47f2-8d5c-f58e0aadcd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:40.795037 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870ca3f-981e-47f2-8d5c-f58e0aadcd55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:40.795257 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870ca3f-981e-47f2-8d5c-f58e0aadcd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:40.795551 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870ca3f-981e-47f2-8d5c-f58e0aadcd55 admin admin] PATH_INFO: `/v3/projects/4e5959f0be5b41c4824473eb9291fd7c/users/5939ed8e77e444589914785abbe115b8/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:40.809920 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870ca3f-981e-47f2-8d5c-f58e0aadcd55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e5959f0be5b41c4824473eb9291fd7c, user_id=5939ed8e77e444589914785abbe115b8, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:40.812596 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870ca3f-981e-47f2-8d5c-f58e0aadcd55 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:40.825204 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1215/2445] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:20:40 2022] PUT /identity/v3/projects/4e5959f0be5b41c4824473eb9291fd7c/users/5939ed8e77e444589914785abbe115b8/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:40.835541 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f002b0-e2f6-43ad-90c3-75a2da7c29cc None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:40.835871 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f002b0-e2f6-43ad-90c3-75a2da7c29cc None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:40.836163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f002b0-e2f6-43ad-90c3-75a2da7c29cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:40.864913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-10f002b0-e2f6-43ad-90c3-75a2da7c29cc None None] MFA Rules not processed for user `5939ed8e77e444589914785abbe115b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:40.866118 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-10f002b0-e2f6-43ad-90c3-75a2da7c29cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:40.930279 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1231/2446] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:20:40.934997 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870ca3f-981e-47f2-8d5c-f58e0aadcd55 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:40.961106 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:41.000084 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870ca3f-981e-47f2-8d5c-f58e0aadcd55 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:41.004753 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec3519-c70e-415f-8820-0b7aa5628be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:41.005346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec3519-c70e-415f-8820-0b7aa5628be1 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:41.005621 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec3519-c70e-415f-8820-0b7aa5628be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:41.005888 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec3519-c70e-415f-8820-0b7aa5628be1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:41.006514 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec3519-c70e-415f-8820-0b7aa5628be1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:41.008449 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec3519-c70e-415f-8820-0b7aa5628be1 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:41.034902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1216/2447] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:20:40 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:41.039120 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f002b0-e2f6-43ad-90c3-75a2da7c29cc None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:41.049883 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f002b0-e2f6-43ad-90c3-75a2da7c29cc None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:41.061753 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:41.107612 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8c6aa-bad0-4021-aebc-1483fe5e1e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:41.108216 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8c6aa-bad0-4021-aebc-1483fe5e1e33 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:41.108499 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8c6aa-bad0-4021-aebc-1483fe5e1e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:41.108771 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8c6aa-bad0-4021-aebc-1483fe5e1e33 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:41.109395 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8c6aa-bad0-4021-aebc-1483fe5e1e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:41.111316 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8c6aa-bad0-4021-aebc-1483fe5e1e33 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:41.132489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1232/2448] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:20:41 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:41.137065 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec3519-c70e-415f-8820-0b7aa5628be1 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:41.147168 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec3519-c70e-415f-8820-0b7aa5628be1 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:41.152344 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc74f6f-6859-4d08-b2d5-48dba3201b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:41.152927 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc74f6f-6859-4d08-b2d5-48dba3201b77 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:41.153196 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc74f6f-6859-4d08-b2d5-48dba3201b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:41.153459 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc74f6f-6859-4d08-b2d5-48dba3201b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:41.154084 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc74f6f-6859-4d08-b2d5-48dba3201b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:41.155694 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc74f6f-6859-4d08-b2d5-48dba3201b77 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:41.166233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1217/2449] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:41.170096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8c6aa-bad0-4021-aebc-1483fe5e1e33 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:41.180176 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8c6aa-bad0-4021-aebc-1483fe5e1e33 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:41.185091 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae65389-dcaa-4893-a445-538d96938d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:41.185682 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae65389-dcaa-4893-a445-538d96938d5f admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:41.185956 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae65389-dcaa-4893-a445-538d96938d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:41.186228 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae65389-dcaa-4893-a445-538d96938d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:41.186857 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae65389-dcaa-4893-a445-538d96938d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:41.188464 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae65389-dcaa-4893-a445-538d96938d5f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:41.199072 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1233/2450] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:41.203237 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc74f6f-6859-4d08-b2d5-48dba3201b77 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:41.213524 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc74f6f-6859-4d08-b2d5-48dba3201b77 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:41.218266 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f018e-3d90-459f-9de2-421293507e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:41.218895 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f018e-3d90-459f-9de2-421293507e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:41.219169 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f018e-3d90-459f-9de2-421293507e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:41.219486 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f018e-3d90-459f-9de2-421293507e3c admin admin] PATH_INFO: `/v3/projects/4bef852cee9341aaadee3c97a074a37c/users/ffd27173231a498badaad160beb53af4/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:41.233650 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f018e-3d90-459f-9de2-421293507e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bef852cee9341aaadee3c97a074a37c, user_id=ffd27173231a498badaad160beb53af4, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:41.236312 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f018e-3d90-459f-9de2-421293507e3c admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:41.248826 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1218/2451] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:20:41 2022] PUT /identity/v3/projects/4bef852cee9341aaadee3c97a074a37c/users/ffd27173231a498badaad160beb53af4/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:20:41.316004 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f989b1-3dc0-43bd-bdf7-634dc415db62 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:41.316285 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f989b1-3dc0-43bd-bdf7-634dc415db62 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:41.316554 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f989b1-3dc0-43bd-bdf7-634dc415db62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:41.346163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-49f989b1-3dc0-43bd-bdf7-634dc415db62 None None] MFA Rules not processed for user `ffd27173231a498badaad160beb53af4`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:41.347362 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-49f989b1-3dc0-43bd-bdf7-634dc415db62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:41.412380 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1234/2452] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:20:41.417640 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f018e-3d90-459f-9de2-421293507e3c admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:41.485160 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f018e-3d90-459f-9de2-421293507e3c admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:41.490330 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437814c1-e2eb-46d8-9fec-3ca60b807241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:41.490931 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437814c1-e2eb-46d8-9fec-3ca60b807241 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:41.491209 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437814c1-e2eb-46d8-9fec-3ca60b807241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:41.491522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437814c1-e2eb-46d8-9fec-3ca60b807241 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:41.492165 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437814c1-e2eb-46d8-9fec-3ca60b807241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:41.494866 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437814c1-e2eb-46d8-9fec-3ca60b807241 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:41.521861 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1219/2453] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:20:41 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:41.526531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f989b1-3dc0-43bd-bdf7-634dc415db62 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:41.536961 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f989b1-3dc0-43bd-bdf7-634dc415db62 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:41.593468 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2f960-6286-4f90-8552-0a39061f4bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:41.594076 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2f960-6286-4f90-8552-0a39061f4bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:41.594358 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2f960-6286-4f90-8552-0a39061f4bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:41.594629 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2f960-6286-4f90-8552-0a39061f4bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:41.595264 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2f960-6286-4f90-8552-0a39061f4bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:41.597210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2f960-6286-4f90-8552-0a39061f4bb7 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:41.618330 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1235/2454] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:20:41 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:20:41.622384 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437814c1-e2eb-46d8-9fec-3ca60b807241 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:41.632460 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437814c1-e2eb-46d8-9fec-3ca60b807241 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:41.637277 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f6f2c-8fd0-4c7b-b6b2-9799f70b0a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:41.637861 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f6f2c-8fd0-4c7b-b6b2-9799f70b0a41 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:41.638138 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f6f2c-8fd0-4c7b-b6b2-9799f70b0a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:41.638409 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f6f2c-8fd0-4c7b-b6b2-9799f70b0a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:41.639036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f6f2c-8fd0-4c7b-b6b2-9799f70b0a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:41.640664 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f6f2c-8fd0-4c7b-b6b2-9799f70b0a41 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:41.651823 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1220/2455] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:41.655847 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2f960-6286-4f90-8552-0a39061f4bb7 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:41.666684 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2f960-6286-4f90-8552-0a39061f4bb7 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:41.671249 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7441d65-b872-4f51-8231-2ae4902c03e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:41.671930 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7441d65-b872-4f51-8231-2ae4902c03e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:41.672235 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7441d65-b872-4f51-8231-2ae4902c03e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:41.672507 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7441d65-b872-4f51-8231-2ae4902c03e8 admin admin] PATH_INFO: `/v3/projects/8594110a1569418fbb5307715b2199fc/users/b4b23103fd1b43b0aa592d0b2cd135e4/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:41.684506 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:41.687694 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7441d65-b872-4f51-8231-2ae4902c03e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8594110a1569418fbb5307715b2199fc, user_id=b4b23103fd1b43b0aa592d0b2cd135e4, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:41.690900 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7441d65-b872-4f51-8231-2ae4902c03e8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:41.703986 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1236/2456] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:20:41 2022] PUT /identity/v3/projects/8594110a1569418fbb5307715b2199fc/users/b4b23103fd1b43b0aa592d0b2cd135e4/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:41.707907 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f6f2c-8fd0-4c7b-b6b2-9799f70b0a41 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:41.718380 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f6f2c-8fd0-4c7b-b6b2-9799f70b0a41 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:41.759731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:41.776462 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16d040-bb28-4c90-b4e9-60dad221c21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:41.777062 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16d040-bb28-4c90-b4e9-60dad221c21e admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:41.777337 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16d040-bb28-4c90-b4e9-60dad221c21e admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:41.777602 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16d040-bb28-4c90-b4e9-60dad221c21e admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:41.778230 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16d040-bb28-4c90-b4e9-60dad221c21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:41.779862 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16d040-bb28-4c90-b4e9-60dad221c21e admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:41.789502 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1221/2457] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:20:41.793767 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7441d65-b872-4f51-8231-2ae4902c03e8 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:41.803930 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7441d65-b872-4f51-8231-2ae4902c03e8 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:41.808619 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503afba-d641-4f42-a425-78b31b06faf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:41.809266 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503afba-d641-4f42-a425-78b31b06faf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:41.809550 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503afba-d641-4f42-a425-78b31b06faf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:41.809825 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503afba-d641-4f42-a425-78b31b06faf4 admin admin] PATH_INFO: `/v3/projects/8594110a1569418fbb5307715b2199fc/users/b4b23103fd1b43b0aa592d0b2cd135e4/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:41.811856 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503afba-d641-4f42-a425-78b31b06faf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8594110a1569418fbb5307715b2199fc, user_id=b4b23103fd1b43b0aa592d0b2cd135e4, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:41.814541 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503afba-d641-4f42-a425-78b31b06faf4 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:41.825223 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1237/2458] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:20:41 2022] PUT /identity/v3/projects/8594110a1569418fbb5307715b2199fc/users/b4b23103fd1b43b0aa592d0b2cd135e4/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:41.835496 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f049b2-8d18-4cae-9a7b-266b37bac92e None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:41.835783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f049b2-8d18-4cae-9a7b-266b37bac92e None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:41.836079 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f049b2-8d18-4cae-9a7b-266b37bac92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:41.864346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-44f049b2-8d18-4cae-9a7b-266b37bac92e None None] MFA Rules not processed for user `b4b23103fd1b43b0aa592d0b2cd135e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:41.865533 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-44f049b2-8d18-4cae-9a7b-266b37bac92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:41.933259 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1222/2459] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:41.944276 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503afba-d641-4f42-a425-78b31b06faf4 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:41.945941 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e503afba-d641-4f42-a425-78b31b06faf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:42.002271 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503afba-d641-4f42-a425-78b31b06faf4 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:42.005877 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5010df-12f3-45e6-bbc0-5572219c1f5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:42.006468 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5010df-12f3-45e6-bbc0-5572219c1f5b service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:42.006742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5010df-12f3-45e6-bbc0-5572219c1f5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:42.007011 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5010df-12f3-45e6-bbc0-5572219c1f5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:42.060852 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5010df-12f3-45e6-bbc0-5572219c1f5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:42.062284 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5010df-12f3-45e6-bbc0-5572219c1f5b service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:42.070899 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1238/2460] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:43.569608 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f049b2-8d18-4cae-9a7b-266b37bac92e None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:43.570981 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-44f049b2-8d18-4cae-9a7b-266b37bac92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:43.582948 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f049b2-8d18-4cae-9a7b-266b37bac92e None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:43.586463 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef306c19-9ee4-422c-8068-ca2c1d5ad91e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:43.587045 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef306c19-9ee4-422c-8068-ca2c1d5ad91e service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:43.587325 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef306c19-9ee4-422c-8068-ca2c1d5ad91e service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:43.587626 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef306c19-9ee4-422c-8068-ca2c1d5ad91e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:43.644679 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef306c19-9ee4-422c-8068-ca2c1d5ad91e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:43.646044 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef306c19-9ee4-422c-8068-ca2c1d5ad91e service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:43.655578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1223/2461] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:44.165878 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5010df-12f3-45e6-bbc0-5572219c1f5b service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:44.174590 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5010df-12f3-45e6-bbc0-5572219c1f5b service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:44.178167 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2640a-56e9-4f4b-bb73-c54aa55cce43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:44.178761 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2640a-56e9-4f4b-bb73-c54aa55cce43 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:44.179042 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2640a-56e9-4f4b-bb73-c54aa55cce43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:44.179315 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2640a-56e9-4f4b-bb73-c54aa55cce43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:44.188178 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2640a-56e9-4f4b-bb73-c54aa55cce43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:44.189602 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2640a-56e9-4f4b-bb73-c54aa55cce43 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:44.199434 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1239/2462] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:48.068753 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef306c19-9ee4-422c-8068-ca2c1d5ad91e service cinder] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:48.129444 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef306c19-9ee4-422c-8068-ca2c1d5ad91e service cinder] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:48.133936 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67769c8-a24a-4344-a054-49f8dbcdddf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:48.134558 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67769c8-a24a-4344-a054-49f8dbcdddf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:48.134839 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67769c8-a24a-4344-a054-49f8dbcdddf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:48.135111 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67769c8-a24a-4344-a054-49f8dbcdddf5 admin admin] PATH_INFO: `/v3/users/5939ed8e77e444589914785abbe115b8` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:48.136242 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67769c8-a24a-4344-a054-49f8dbcdddf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5939ed8e77e444589914785abbe115b8)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:48.138169 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67769c8-a24a-4344-a054-49f8dbcdddf5 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:48.142628 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:48.184678 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-b67769c8-a24a-4344-a054-49f8dbcdddf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5939ed8e77e444589914785abbe115b8'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:48.191428 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-b67769c8-a24a-4344-a054-49f8dbcdddf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5939ed8e77e444589914785abbe115b8'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:48.198791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-b67769c8-a24a-4344-a054-49f8dbcdddf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5939ed8e77e444589914785abbe115b8'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:48.210532 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-b67769c8-a24a-4344-a054-49f8dbcdddf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5939ed8e77e444589914785abbe115b8'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:48.211162 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-b67769c8-a24a-4344-a054-49f8dbcdddf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5939ed8e77e444589914785abbe115b8'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:48.217808 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1224/2463] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:20:48 2022] DELETE /identity/v3/users/5939ed8e77e444589914785abbe115b8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:48.222454 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cdb55-f954-4ef8-9e76-8a743aa9fa40 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:48.222924 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cdb55-f954-4ef8-9e76-8a743aa9fa40 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:48.223036 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cdb55-f954-4ef8-9e76-8a743aa9fa40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:48.242406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-583cdb55-f954-4ef8-9e76-8a743aa9fa40 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:48.243635 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-583cdb55-f954-4ef8-9e76-8a743aa9fa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:48.301982 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1240/2464] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:48.311947 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67769c8-a24a-4344-a054-49f8dbcdddf5 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:48.313329 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b67769c8-a24a-4344-a054-49f8dbcdddf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:48.372276 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67769c8-a24a-4344-a054-49f8dbcdddf5 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:48.375959 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa43eb-db01-4267-8699-e8ea78537550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:48.376551 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa43eb-db01-4267-8699-e8ea78537550 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:48.376825 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa43eb-db01-4267-8699-e8ea78537550 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:48.377091 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa43eb-db01-4267-8699-e8ea78537550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:48.386244 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa43eb-db01-4267-8699-e8ea78537550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:48.387719 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa43eb-db01-4267-8699-e8ea78537550 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:48.396974 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1225/2465] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:48.666654 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583cdb55-f954-4ef8-9e76-8a743aa9fa40 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:48.668274 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-583cdb55-f954-4ef8-9e76-8a743aa9fa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:48.681022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583cdb55-f954-4ef8-9e76-8a743aa9fa40 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:48.686686 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56148b9-2394-4075-8aca-8049443027c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:48.687325 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56148b9-2394-4075-8aca-8049443027c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:48.687616 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56148b9-2394-4075-8aca-8049443027c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:48.687968 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56148b9-2394-4075-8aca-8049443027c5 admin admin] PATH_INFO: `/v3/projects/4e5959f0be5b41c4824473eb9291fd7c` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:48.688978 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56148b9-2394-4075-8aca-8049443027c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e5959f0be5b41c4824473eb9291fd7c)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:48.690854 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56148b9-2394-4075-8aca-8049443027c5 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:48.707451 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:48.738198 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a56148b9-2394-4075-8aca-8049443027c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e5959f0be5b41c4824473eb9291fd7c', 'request_id': 'req-a56148b9-2394-4075-8aca-8049443027c5'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:48.746393 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a56148b9-2394-4075-8aca-8049443027c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e5959f0be5b41c4824473eb9291fd7c', 'request_id': 'req-a56148b9-2394-4075-8aca-8049443027c5'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:48.751848 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a56148b9-2394-4075-8aca-8049443027c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e5959f0be5b41c4824473eb9291fd7c', 'request_id': 'req-a56148b9-2394-4075-8aca-8049443027c5'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:48.763323 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a56148b9-2394-4075-8aca-8049443027c5 admin admin] The token cache is being invalidate because project 4e5959f0be5b41c4824473eb9291fd7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:20:48.763632 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a56148b9-2394-4075-8aca-8049443027c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:48.764252 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a56148b9-2394-4075-8aca-8049443027c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:48.765725 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1241/2466] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:20:48 2022] DELETE /identity/v3/projects/4e5959f0be5b41c4824473eb9291fd7c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:48.769720 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa43eb-db01-4267-8699-e8ea78537550 service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:48.779964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa43eb-db01-4267-8699-e8ea78537550 service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:48.836246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94be3dd-8cdf-4610-a0e6-b6eb8d4da018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:48.836876 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94be3dd-8cdf-4610-a0e6-b6eb8d4da018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:48.837155 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94be3dd-8cdf-4610-a0e6-b6eb8d4da018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:48.837423 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94be3dd-8cdf-4610-a0e6-b6eb8d4da018 admin admin] PATH_INFO: `/v3/users/ffd27173231a498badaad160beb53af4` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:48.839220 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94be3dd-8cdf-4610-a0e6-b6eb8d4da018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffd27173231a498badaad160beb53af4)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:48.841225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94be3dd-8cdf-4610-a0e6-b6eb8d4da018 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:48.868931 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:48.889046 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e94be3dd-8cdf-4610-a0e6-b6eb8d4da018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffd27173231a498badaad160beb53af4'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:48.896129 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e94be3dd-8cdf-4610-a0e6-b6eb8d4da018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffd27173231a498badaad160beb53af4'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:48.903210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e94be3dd-8cdf-4610-a0e6-b6eb8d4da018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffd27173231a498badaad160beb53af4'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:48.914973 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e94be3dd-8cdf-4610-a0e6-b6eb8d4da018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffd27173231a498badaad160beb53af4'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:48.915634 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e94be3dd-8cdf-4610-a0e6-b6eb8d4da018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffd27173231a498badaad160beb53af4'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:48.921530 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1226/2467] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:20:48 2022] DELETE /identity/v3/users/ffd27173231a498badaad160beb53af4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:49.188384 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56148b9-2394-4075-8aca-8049443027c5 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:49.189974 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a56148b9-2394-4075-8aca-8049443027c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:49.208524 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56148b9-2394-4075-8aca-8049443027c5 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:49.265830 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa4e67-cecd-4d5b-a221-97b8c4560700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:49.266501 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa4e67-cecd-4d5b-a221-97b8c4560700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:49.266729 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa4e67-cecd-4d5b-a221-97b8c4560700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:49.266998 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa4e67-cecd-4d5b-a221-97b8c4560700 admin admin] PATH_INFO: `/v3/projects/4bef852cee9341aaadee3c97a074a37c` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:49.268119 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa4e67-cecd-4d5b-a221-97b8c4560700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bef852cee9341aaadee3c97a074a37c)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:49.270021 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa4e67-cecd-4d5b-a221-97b8c4560700 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:49.316826 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d7aa4e67-cecd-4d5b-a221-97b8c4560700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bef852cee9341aaadee3c97a074a37c', 'request_id': 'req-d7aa4e67-cecd-4d5b-a221-97b8c4560700'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:49.324271 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d7aa4e67-cecd-4d5b-a221-97b8c4560700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bef852cee9341aaadee3c97a074a37c', 'request_id': 'req-d7aa4e67-cecd-4d5b-a221-97b8c4560700'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:49.329719 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d7aa4e67-cecd-4d5b-a221-97b8c4560700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bef852cee9341aaadee3c97a074a37c', 'request_id': 'req-d7aa4e67-cecd-4d5b-a221-97b8c4560700'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:49.341799 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d7aa4e67-cecd-4d5b-a221-97b8c4560700 admin admin] The token cache is being invalidate because project 4bef852cee9341aaadee3c97a074a37c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:20:49.342086 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d7aa4e67-cecd-4d5b-a221-97b8c4560700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:49.343232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d7aa4e67-cecd-4d5b-a221-97b8c4560700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:49.345252 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1242/2468] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:20:49 2022] DELETE /identity/v3/projects/4bef852cee9341aaadee3c97a074a37c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:49.350106 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94be3dd-8cdf-4610-a0e6-b6eb8d4da018 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:49.351658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-e94be3dd-8cdf-4610-a0e6-b6eb8d4da018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:49.366359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94be3dd-8cdf-4610-a0e6-b6eb8d4da018 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:49.423938 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a68453-0411-46ce-9338-7f0006998ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:49.424663 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a68453-0411-46ce-9338-7f0006998ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:49.424953 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a68453-0411-46ce-9338-7f0006998ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:49.425219 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a68453-0411-46ce-9338-7f0006998ba8 admin admin] PATH_INFO: `/v3/users/b4b23103fd1b43b0aa592d0b2cd135e4` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:49.426302 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a68453-0411-46ce-9338-7f0006998ba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4b23103fd1b43b0aa592d0b2cd135e4)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:49.428242 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a68453-0411-46ce-9338-7f0006998ba8 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:49.472873 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-55a68453-0411-46ce-9338-7f0006998ba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4b23103fd1b43b0aa592d0b2cd135e4'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:49.480483 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-55a68453-0411-46ce-9338-7f0006998ba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4b23103fd1b43b0aa592d0b2cd135e4'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:49.487264 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-55a68453-0411-46ce-9338-7f0006998ba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4b23103fd1b43b0aa592d0b2cd135e4'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:49.499838 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-55a68453-0411-46ce-9338-7f0006998ba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4b23103fd1b43b0aa592d0b2cd135e4'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:49.500508 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-55a68453-0411-46ce-9338-7f0006998ba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4b23103fd1b43b0aa592d0b2cd135e4'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:49.506628 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1227/2469] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:20:49 2022] DELETE /identity/v3/users/b4b23103fd1b43b0aa592d0b2cd135e4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:49.783329 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa4e67-cecd-4d5b-a221-97b8c4560700 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:49.784881 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d7aa4e67-cecd-4d5b-a221-97b8c4560700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:49.798155 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa4e67-cecd-4d5b-a221-97b8c4560700 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:49.831047 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:49.858734 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384e5f0-f81d-4dfa-9da7-8ed79c375903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:49.859363 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384e5f0-f81d-4dfa-9da7-8ed79c375903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:49.859677 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384e5f0-f81d-4dfa-9da7-8ed79c375903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:49.859951 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384e5f0-f81d-4dfa-9da7-8ed79c375903 admin admin] PATH_INFO: `/v3/projects/8594110a1569418fbb5307715b2199fc` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:49.861051 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384e5f0-f81d-4dfa-9da7-8ed79c375903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8594110a1569418fbb5307715b2199fc)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:49.862965 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384e5f0-f81d-4dfa-9da7-8ed79c375903 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:49.908992 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d384e5f0-f81d-4dfa-9da7-8ed79c375903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8594110a1569418fbb5307715b2199fc', 'request_id': 'req-d384e5f0-f81d-4dfa-9da7-8ed79c375903'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:49.915978 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d384e5f0-f81d-4dfa-9da7-8ed79c375903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8594110a1569418fbb5307715b2199fc', 'request_id': 'req-d384e5f0-f81d-4dfa-9da7-8ed79c375903'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:49.921732 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d384e5f0-f81d-4dfa-9da7-8ed79c375903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8594110a1569418fbb5307715b2199fc', 'request_id': 'req-d384e5f0-f81d-4dfa-9da7-8ed79c375903'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:49.934444 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d384e5f0-f81d-4dfa-9da7-8ed79c375903 admin admin] The token cache is being invalidate because project 8594110a1569418fbb5307715b2199fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:20:49.934784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d384e5f0-f81d-4dfa-9da7-8ed79c375903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:49.935561 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d384e5f0-f81d-4dfa-9da7-8ed79c375903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:49.937219 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1243/2470] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:20:49 2022] DELETE /identity/v3/projects/8594110a1569418fbb5307715b2199fc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:49.942069 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3cf06-4f24-4ccf-8b2d-1f3aed95dbe6 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:49.942357 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3cf06-4f24-4ccf-8b2d-1f3aed95dbe6 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:49.942628 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3cf06-4f24-4ccf-8b2d-1f3aed95dbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:49.963077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-adc3cf06-4f24-4ccf-8b2d-1f3aed95dbe6 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:49.964573 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-adc3cf06-4f24-4ccf-8b2d-1f3aed95dbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:49.983842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:50.024941 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1228/2471] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:50.033935 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447d05b-da16-4177-adf7-e13c9adf07ff None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:50.034199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447d05b-da16-4177-adf7-e13c9adf07ff None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:50.034469 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447d05b-da16-4177-adf7-e13c9adf07ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:50.054486 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-c447d05b-da16-4177-adf7-e13c9adf07ff None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:50.055695 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c447d05b-da16-4177-adf7-e13c9adf07ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:50.064141 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1244/2472] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:50.068351 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3cf06-4f24-4ccf-8b2d-1f3aed95dbe6 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:50.078018 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3cf06-4f24-4ccf-8b2d-1f3aed95dbe6 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:50.082446 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a031d-e1bb-42fe-bbc2-c362204d1afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:50.083031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a031d-e1bb-42fe-bbc2-c362204d1afb admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:50.083305 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a031d-e1bb-42fe-bbc2-c362204d1afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:50.083612 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a031d-e1bb-42fe-bbc2-c362204d1afb admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:50.084244 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a031d-e1bb-42fe-bbc2-c362204d1afb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:20:50.084540 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a031d-e1bb-42fe-bbc2-c362204d1afb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:50.086233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a031d-e1bb-42fe-bbc2-c362204d1afb admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:50.098107 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1229/2473] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:20:50.102371 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447d05b-da16-4177-adf7-e13c9adf07ff None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:50.111913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447d05b-da16-4177-adf7-e13c9adf07ff None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:50.116433 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003e3ea-c4f8-405f-9d28-8f6e09ed74c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:50.117016 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003e3ea-c4f8-405f-9d28-8f6e09ed74c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:50.117292 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003e3ea-c4f8-405f-9d28-8f6e09ed74c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:50.117557 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003e3ea-c4f8-405f-9d28-8f6e09ed74c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:50.118181 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003e3ea-c4f8-405f-9d28-8f6e09ed74c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:50.120875 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003e3ea-c4f8-405f-9d28-8f6e09ed74c1 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:50.147096 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1245/2474] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:20:50 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:50.151333 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a031d-e1bb-42fe-bbc2-c362204d1afb admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:50.161138 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a031d-e1bb-42fe-bbc2-c362204d1afb admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:50.216878 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f123cf-b726-4533-b1c7-47bc4e2df1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:50.217469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f123cf-b726-4533-b1c7-47bc4e2df1ef admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:50.218008 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f123cf-b726-4533-b1c7-47bc4e2df1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:50.218271 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f123cf-b726-4533-b1c7-47bc4e2df1ef admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:50.218891 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f123cf-b726-4533-b1c7-47bc4e2df1ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:50.220849 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f123cf-b726-4533-b1c7-47bc4e2df1ef admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:50.242103 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1230/2475] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:20:50 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:50.247051 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003e3ea-c4f8-405f-9d28-8f6e09ed74c1 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:50.257174 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003e3ea-c4f8-405f-9d28-8f6e09ed74c1 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:50.261896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20dfc2-5459-40cb-bb75-8a99eaadcfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:50.262489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20dfc2-5459-40cb-bb75-8a99eaadcfeb admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:50.262768 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20dfc2-5459-40cb-bb75-8a99eaadcfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:50.263042 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20dfc2-5459-40cb-bb75-8a99eaadcfeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:50.263713 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d20dfc2-5459-40cb-bb75-8a99eaadcfeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:50.265309 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d20dfc2-5459-40cb-bb75-8a99eaadcfeb admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:50.275131 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1246/2476] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:50.278790 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f123cf-b726-4533-b1c7-47bc4e2df1ef admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:50.288553 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f123cf-b726-4533-b1c7-47bc4e2df1ef admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:50.293708 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c3e56-b8c7-493c-830b-586201d1bfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:50.294292 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c3e56-b8c7-493c-830b-586201d1bfc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:50.294574 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c3e56-b8c7-493c-830b-586201d1bfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:50.294871 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c3e56-b8c7-493c-830b-586201d1bfc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:50.295533 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c3e56-b8c7-493c-830b-586201d1bfc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:50.297132 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c3e56-b8c7-493c-830b-586201d1bfc1 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:50.308177 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1231/2477] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:50.312114 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20dfc2-5459-40cb-bb75-8a99eaadcfeb admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:50.321868 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20dfc2-5459-40cb-bb75-8a99eaadcfeb admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:50.327170 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afebb4-854e-44d4-b8cb-131d0a58a7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:50.327857 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afebb4-854e-44d4-b8cb-131d0a58a7e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:50.328136 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afebb4-854e-44d4-b8cb-131d0a58a7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:50.328407 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afebb4-854e-44d4-b8cb-131d0a58a7e4 admin admin] PATH_INFO: `/v3/projects/aecf228952d34f3ba27486ea47bf6fae/users/e1c6e6f338704bf680ca327b4ebed600/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:50.343814 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afebb4-854e-44d4-b8cb-131d0a58a7e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aecf228952d34f3ba27486ea47bf6fae, user_id=e1c6e6f338704bf680ca327b4ebed600, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:50.346467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afebb4-854e-44d4-b8cb-131d0a58a7e4 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:50.360531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1247/2478] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:20:50 2022] PUT /identity/v3/projects/aecf228952d34f3ba27486ea47bf6fae/users/e1c6e6f338704bf680ca327b4ebed600/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:50.371528 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3c4ee-c022-4f9e-8d12-8e7a8f6d04f6 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:50.372059 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3c4ee-c022-4f9e-8d12-8e7a8f6d04f6 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:50.372198 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3c4ee-c022-4f9e-8d12-8e7a8f6d04f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:50.400309 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-a7c3c4ee-c022-4f9e-8d12-8e7a8f6d04f6 None None] MFA Rules not processed for user `e1c6e6f338704bf680ca327b4ebed600`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:50.401608 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-a7c3c4ee-c022-4f9e-8d12-8e7a8f6d04f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:50.464194 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1232/2479] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:20:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:50.475905 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afebb4-854e-44d4-b8cb-131d0a58a7e4 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:50.477529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-78afebb4-854e-44d4-b8cb-131d0a58a7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:50.532846 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afebb4-854e-44d4-b8cb-131d0a58a7e4 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:50.536501 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de8765-7b50-4e0a-acdf-c5c63029e326 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0866de4d4e46d5b26719faf385d7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:50.537102 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de8765-7b50-4e0a-acdf-c5c63029e326 service glance] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:50.537378 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de8765-7b50-4e0a-acdf-c5c63029e326 service glance] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:50.537664 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de8765-7b50-4e0a-acdf-c5c63029e326 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:50.546181 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de8765-7b50-4e0a-acdf-c5c63029e326 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:50.547657 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de8765-7b50-4e0a-acdf-c5c63029e326 service glance] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:50.556332 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1248/2480] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:21:00.461206 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:21:00.552286 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:21:11.599704 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c91c5-5c0b-4189-a0f1-8a9ef0e1fff4 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:11.600258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c91c5-5c0b-4189-a0f1-8a9ef0e1fff4 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:11.600258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c91c5-5c0b-4189-a0f1-8a9ef0e1fff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:11.628657 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-839c91c5-5c0b-4189-a0f1-8a9ef0e1fff4 None None] MFA Rules not processed for user `448eb7f5ed5c46dea4be4628ffd0df51`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:21:11.629842 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-839c91c5-5c0b-4189-a0f1-8a9ef0e1fff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:21:11.699837 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1233/2481] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:21:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:21:12.164690 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de8765-7b50-4e0a-acdf-c5c63029e326 service glance] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:21:12.269501 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de8765-7b50-4e0a-acdf-c5c63029e326 service glance] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:21:12.274213 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e59ffc-aa2c-4724-b451-693050d7e37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:21:12.274841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e59ffc-aa2c-4724-b451-693050d7e37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:12.275121 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e59ffc-aa2c-4724-b451-693050d7e37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:12.275391 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e59ffc-aa2c-4724-b451-693050d7e37d admin admin] PATH_INFO: `/v3/users/e1c6e6f338704bf680ca327b4ebed600` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:12.277394 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e59ffc-aa2c-4724-b451-693050d7e37d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1c6e6f338704bf680ca327b4ebed600)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:21:12.285869 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e59ffc-aa2c-4724-b451-693050d7e37d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:21:12.333424 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c9e59ffc-aa2c-4724-b451-693050d7e37d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1c6e6f338704bf680ca327b4ebed600'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:21:12.342304 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c9e59ffc-aa2c-4724-b451-693050d7e37d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1c6e6f338704bf680ca327b4ebed600'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:21:12.355201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c9e59ffc-aa2c-4724-b451-693050d7e37d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1c6e6f338704bf680ca327b4ebed600'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:21:12.384009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c9e59ffc-aa2c-4724-b451-693050d7e37d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1c6e6f338704bf680ca327b4ebed600'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:21:12.385143 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c9e59ffc-aa2c-4724-b451-693050d7e37d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1c6e6f338704bf680ca327b4ebed600'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:21:12.392760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1249/2482] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:21:12 2022] DELETE /identity/v3/users/e1c6e6f338704bf680ca327b4ebed600 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:21:12.397339 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abeb8c-39ac-4110-9745-76d73b2d42de None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:12.397630 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abeb8c-39ac-4110-9745-76d73b2d42de None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:12.397907 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abeb8c-39ac-4110-9745-76d73b2d42de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:12.442219 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-f9abeb8c-39ac-4110-9745-76d73b2d42de None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:21:12.443434 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f9abeb8c-39ac-4110-9745-76d73b2d42de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:21:12.505875 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1234/2483] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:21:12.516203 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e59ffc-aa2c-4724-b451-693050d7e37d admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:21:12.517821 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c9e59ffc-aa2c-4724-b451-693050d7e37d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:21:12.576916 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:21:12.614620 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e59ffc-aa2c-4724-b451-693050d7e37d admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:21:12.618737 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49b162-c273-4d95-8b29-a84c2c782f50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:21:12.619343 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49b162-c273-4d95-8b29-a84c2c782f50 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:12.619655 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49b162-c273-4d95-8b29-a84c2c782f50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:12.619930 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49b162-c273-4d95-8b29-a84c2c782f50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:12.630170 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49b162-c273-4d95-8b29-a84c2c782f50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:21:12.631833 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49b162-c273-4d95-8b29-a84c2c782f50 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:21:12.643328 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1250/2484] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:21:12.920700 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abeb8c-39ac-4110-9745-76d73b2d42de None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:21:12.922834 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f9abeb8c-39ac-4110-9745-76d73b2d42de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:21:12.935853 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abeb8c-39ac-4110-9745-76d73b2d42de None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:21:12.940777 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cdbb4-921f-4d26-a9c4-4e8c5ee9a7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:21:12.941597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cdbb4-921f-4d26-a9c4-4e8c5ee9a7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:12.941904 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cdbb4-921f-4d26-a9c4-4e8c5ee9a7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:12.942170 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cdbb4-921f-4d26-a9c4-4e8c5ee9a7dd admin admin] PATH_INFO: `/v3/projects/aecf228952d34f3ba27486ea47bf6fae` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:12.944083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814cdbb4-921f-4d26-a9c4-4e8c5ee9a7dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=aecf228952d34f3ba27486ea47bf6fae)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:21:12.946448 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814cdbb4-921f-4d26-a9c4-4e8c5ee9a7dd admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:21:12.996634 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-814cdbb4-921f-4d26-a9c4-4e8c5ee9a7dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aecf228952d34f3ba27486ea47bf6fae', 'request_id': 'req-814cdbb4-921f-4d26-a9c4-4e8c5ee9a7dd'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:21:13.004077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-814cdbb4-921f-4d26-a9c4-4e8c5ee9a7dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aecf228952d34f3ba27486ea47bf6fae', 'request_id': 'req-814cdbb4-921f-4d26-a9c4-4e8c5ee9a7dd'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:21:13.005284 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:21:13.011076 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-814cdbb4-921f-4d26-a9c4-4e8c5ee9a7dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aecf228952d34f3ba27486ea47bf6fae', 'request_id': 'req-814cdbb4-921f-4d26-a9c4-4e8c5ee9a7dd'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:21:13.023028 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-814cdbb4-921f-4d26-a9c4-4e8c5ee9a7dd admin admin] The token cache is being invalidate because project aecf228952d34f3ba27486ea47bf6fae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:21:13.023297 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-814cdbb4-921f-4d26-a9c4-4e8c5ee9a7dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:21:13.023955 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-814cdbb4-921f-4d26-a9c4-4e8c5ee9a7dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:21:13.025411 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1235/2485] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:21:12 2022] DELETE /identity/v3/projects/aecf228952d34f3ba27486ea47bf6fae => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:21:21.971028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49b162-c273-4d95-8b29-a84c2c782f50 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:21:21.972485 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ab49b162-c273-4d95-8b29-a84c2c782f50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:21:22.063474 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49b162-c273-4d95-8b29-a84c2c782f50 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:21:22.125574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224305bd-2423-428b-b95e-0e3f5b85021a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b3ca8694ab4a169a3c36561290d8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:21:22.126179 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224305bd-2423-428b-b95e-0e3f5b85021a service placement] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:22.126861 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224305bd-2423-428b-b95e-0e3f5b85021a service placement] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:22.126861 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224305bd-2423-428b-b95e-0e3f5b85021a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:22.128491 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-224305bd-2423-428b-b95e-0e3f5b85021a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:21:22.139643 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224305bd-2423-428b-b95e-0e3f5b85021a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:21:22.141787 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224305bd-2423-428b-b95e-0e3f5b85021a service placement] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:21:22.151721 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1251/2486] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:21:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:21:23.019900 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:DELETE=2,keystone:SELECT=5 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:21:32.147567 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=83 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:22:07.360110 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afffbc-481c-42b4-a339-284f4159e430 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:07.360687 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afffbc-481c-42b4-a339-284f4159e430 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:07.360687 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afffbc-481c-42b4-a339-284f4159e430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:07.380408 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-b2afffbc-481c-42b4-a339-284f4159e430 None None] MFA Rules not processed for user `448eb7f5ed5c46dea4be4628ffd0df51`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:22:07.381788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b2afffbc-481c-42b4-a339-284f4159e430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:22:07.435114 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1236/2487] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:22:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:22:17.428756 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=25 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:09.468216 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224305bd-2423-428b-b95e-0e3f5b85021a service placement] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:09.469776 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-224305bd-2423-428b-b95e-0e3f5b85021a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:09.534573 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224305bd-2423-428b-b95e-0e3f5b85021a service placement] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:09.539069 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128baac9-93a6-4154-b508-d96504333af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:09.540248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128baac9-93a6-4154-b508-d96504333af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:09.540748 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128baac9-93a6-4154-b508-d96504333af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:09.541080 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128baac9-93a6-4154-b508-d96504333af8 admin admin] PATH_INFO: `/v3/users/448eb7f5ed5c46dea4be4628ffd0df51` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:09.542674 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128baac9-93a6-4154-b508-d96504333af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=448eb7f5ed5c46dea4be4628ffd0df51)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:09.544124 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128baac9-93a6-4154-b508-d96504333af8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:09.589449 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-128baac9-93a6-4154-b508-d96504333af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448eb7f5ed5c46dea4be4628ffd0df51'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:09.596355 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-128baac9-93a6-4154-b508-d96504333af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448eb7f5ed5c46dea4be4628ffd0df51'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:09.609038 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-128baac9-93a6-4154-b508-d96504333af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448eb7f5ed5c46dea4be4628ffd0df51'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:09.615699 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-128baac9-93a6-4154-b508-d96504333af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448eb7f5ed5c46dea4be4628ffd0df51'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:09.616326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-128baac9-93a6-4154-b508-d96504333af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448eb7f5ed5c46dea4be4628ffd0df51'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:09.622196 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1252/2488] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:23:09 2022] DELETE /identity/v3/users/448eb7f5ed5c46dea4be4628ffd0df51 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:23:09.791650 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afffbc-481c-42b4-a339-284f4159e430 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:09.802512 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afffbc-481c-42b4-a339-284f4159e430 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:09.859735 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b0c62-2a05-4912-8a6d-9a69d3fd4bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:09.860355 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b0c62-2a05-4912-8a6d-9a69d3fd4bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:09.860629 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b0c62-2a05-4912-8a6d-9a69d3fd4bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:09.860896 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b0c62-2a05-4912-8a6d-9a69d3fd4bf7 admin admin] PATH_INFO: `/v3/projects/efaae22424434860bdb911f07cc96f6f` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:09.861990 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b0c62-2a05-4912-8a6d-9a69d3fd4bf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efaae22424434860bdb911f07cc96f6f)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:09.863913 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b0c62-2a05-4912-8a6d-9a69d3fd4bf7 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:09.909703 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-a70b0c62-2a05-4912-8a6d-9a69d3fd4bf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efaae22424434860bdb911f07cc96f6f', 'request_id': 'req-a70b0c62-2a05-4912-8a6d-9a69d3fd4bf7'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:09.916903 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-a70b0c62-2a05-4912-8a6d-9a69d3fd4bf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efaae22424434860bdb911f07cc96f6f', 'request_id': 'req-a70b0c62-2a05-4912-8a6d-9a69d3fd4bf7'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:09.922500 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-a70b0c62-2a05-4912-8a6d-9a69d3fd4bf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efaae22424434860bdb911f07cc96f6f', 'request_id': 'req-a70b0c62-2a05-4912-8a6d-9a69d3fd4bf7'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:09.933224 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-a70b0c62-2a05-4912-8a6d-9a69d3fd4bf7 admin admin] The token cache is being invalidate because project efaae22424434860bdb911f07cc96f6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:23:09.933504 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-a70b0c62-2a05-4912-8a6d-9a69d3fd4bf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:09.934132 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-a70b0c62-2a05-4912-8a6d-9a69d3fd4bf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:09.935646 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1237/2489] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:23:09 2022] DELETE /identity/v3/projects/efaae22424434860bdb911f07cc96f6f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:23:09.940571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c2392-9c22-4d44-b429-2037bca46a08 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:09.940861 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c2392-9c22-4d44-b429-2037bca46a08 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:09.941132 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c2392-9c22-4d44-b429-2037bca46a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:09.990098 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d81c2392-9c22-4d44-b429-2037bca46a08 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:23:09.991190 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d81c2392-9c22-4d44-b429-2037bca46a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:10.038641 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:10.051917 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1253/2490] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:23:10.059962 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe552b-fcf6-42b7-b043-0cc137c432c5 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:10.060243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe552b-fcf6-42b7-b043-0cc137c432c5 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:10.060511 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe552b-fcf6-42b7-b043-0cc137c432c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:10.080583 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-4afe552b-fcf6-42b7-b043-0cc137c432c5 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:23:10.081781 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-4afe552b-fcf6-42b7-b043-0cc137c432c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:10.090735 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1238/2491] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:23:10.094837 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c2392-9c22-4d44-b429-2037bca46a08 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:10.104941 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c2392-9c22-4d44-b429-2037bca46a08 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:10.109612 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b9a74-4ed9-4e6b-8be6-91905e51880b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:10.110210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b9a74-4ed9-4e6b-8be6-91905e51880b admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:10.110489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b9a74-4ed9-4e6b-8be6-91905e51880b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:10.110799 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b9a74-4ed9-4e6b-8be6-91905e51880b admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:10.111463 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b9a74-4ed9-4e6b-8be6-91905e51880b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:23:10.111770 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b9a74-4ed9-4e6b-8be6-91905e51880b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:10.113366 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b9a74-4ed9-4e6b-8be6-91905e51880b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:10.124960 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1254/2492] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:23:10.129159 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe552b-fcf6-42b7-b043-0cc137c432c5 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:10.139042 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe552b-fcf6-42b7-b043-0cc137c432c5 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:10.143681 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c124c3-a9bf-40f5-89b4-a219a019d60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:10.144269 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c124c3-a9bf-40f5-89b4-a219a019d60b admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:10.144545 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c124c3-a9bf-40f5-89b4-a219a019d60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:10.144815 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c124c3-a9bf-40f5-89b4-a219a019d60b admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:10.145442 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c124c3-a9bf-40f5-89b4-a219a019d60b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:10.147369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c124c3-a9bf-40f5-89b4-a219a019d60b admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:10.186031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1239/2493] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:23:10 2022] POST /identity/v3/projects => generated 405 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:23:10.190179 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b9a74-4ed9-4e6b-8be6-91905e51880b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:10.200931 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b9a74-4ed9-4e6b-8be6-91905e51880b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:10.255304 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8b08f-b604-425d-a578-eea1742ee6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:10.255850 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8b08f-b604-425d-a578-eea1742ee6db admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:10.256125 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8b08f-b604-425d-a578-eea1742ee6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:10.256393 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8b08f-b604-425d-a578-eea1742ee6db admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:10.257018 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8b08f-b604-425d-a578-eea1742ee6db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:10.259503 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8b08f-b604-425d-a578-eea1742ee6db admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:10.280643 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1255/2494] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:23:10 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:23:10.284846 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c124c3-a9bf-40f5-89b4-a219a019d60b admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:10.295121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c124c3-a9bf-40f5-89b4-a219a019d60b admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:10.299689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f1868-d8ae-466f-a5d5-79282618b412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:10.300273 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f1868-d8ae-466f-a5d5-79282618b412 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:10.300547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f1868-d8ae-466f-a5d5-79282618b412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:10.300813 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f1868-d8ae-466f-a5d5-79282618b412 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:10.301433 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f1868-d8ae-466f-a5d5-79282618b412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:10.303038 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f1868-d8ae-466f-a5d5-79282618b412 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:10.313048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1240/2495] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:23:10.316985 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8b08f-b604-425d-a578-eea1742ee6db admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:10.327225 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8b08f-b604-425d-a578-eea1742ee6db admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:10.331751 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bb4fa-1803-48d4-9e00-5b50ee326438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:10.332334 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bb4fa-1803-48d4-9e00-5b50ee326438 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:10.332611 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bb4fa-1803-48d4-9e00-5b50ee326438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:10.332879 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bb4fa-1803-48d4-9e00-5b50ee326438 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:10.333503 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bb4fa-1803-48d4-9e00-5b50ee326438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:10.335075 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bb4fa-1803-48d4-9e00-5b50ee326438 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:10.346402 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1256/2496] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:23:10.350793 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f1868-d8ae-466f-a5d5-79282618b412 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:10.360902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f1868-d8ae-466f-a5d5-79282618b412 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:10.365690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d06f2-e595-42fc-9cbb-30809a129bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:10.366328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d06f2-e595-42fc-9cbb-30809a129bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:10.366603 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d06f2-e595-42fc-9cbb-30809a129bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:10.366872 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d06f2-e595-42fc-9cbb-30809a129bfa admin admin] PATH_INFO: `/v3/projects/96eeef2c2dfb48c59860647401d8bd69/users/fda3c701418d42919be05cc7c1191eb6/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:10.382372 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d06f2-e595-42fc-9cbb-30809a129bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=96eeef2c2dfb48c59860647401d8bd69, user_id=fda3c701418d42919be05cc7c1191eb6, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:10.385746 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d06f2-e595-42fc-9cbb-30809a129bfa admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:10.397854 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1241/2497] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:23:10 2022] PUT /identity/v3/projects/96eeef2c2dfb48c59860647401d8bd69/users/fda3c701418d42919be05cc7c1191eb6/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:23:10.409265 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233cdda-e802-45a7-985b-07c3424fdc1f None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:10.409546 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233cdda-e802-45a7-985b-07c3424fdc1f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:10.409837 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233cdda-e802-45a7-985b-07c3424fdc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:10.437449 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-4233cdda-e802-45a7-985b-07c3424fdc1f None None] MFA Rules not processed for user `fda3c701418d42919be05cc7c1191eb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:23:10.438632 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4233cdda-e802-45a7-985b-07c3424fdc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:10.503909 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1257/2498] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:23:10 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:23:10.508601 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d06f2-e595-42fc-9cbb-30809a129bfa admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:10.528100 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:10.576820 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d06f2-e595-42fc-9cbb-30809a129bfa admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:10.581410 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880d3dd-2b2d-4895-ac17-8b079f779478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:10.582007 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880d3dd-2b2d-4895-ac17-8b079f779478 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:10.582286 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880d3dd-2b2d-4895-ac17-8b079f779478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:10.582566 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880d3dd-2b2d-4895-ac17-8b079f779478 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:10.583200 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880d3dd-2b2d-4895-ac17-8b079f779478 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:10.585142 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880d3dd-2b2d-4895-ac17-8b079f779478 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:10.612505 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1242/2499] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:23:10 2022] POST /identity/v3/projects => generated 403 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:23:10.616826 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233cdda-e802-45a7-985b-07c3424fdc1f None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:10.627938 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233cdda-e802-45a7-985b-07c3424fdc1f None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:10.674500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:10.685934 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41435ec2-c293-4c41-b09f-f84a907d2082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:10.686531 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41435ec2-c293-4c41-b09f-f84a907d2082 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:10.686810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41435ec2-c293-4c41-b09f-f84a907d2082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:10.687085 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41435ec2-c293-4c41-b09f-f84a907d2082 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:10.687735 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41435ec2-c293-4c41-b09f-f84a907d2082 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:10.689638 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41435ec2-c293-4c41-b09f-f84a907d2082 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:10.713776 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1258/2500] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:23:10 2022] POST /identity/v3/users => generated 308 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:23:10.715241 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880d3dd-2b2d-4895-ac17-8b079f779478 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:10.725597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880d3dd-2b2d-4895-ac17-8b079f779478 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:10.730719 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4f525-25e5-4943-acfc-42d5bf4a60fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:10.731306 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4f525-25e5-4943-acfc-42d5bf4a60fc admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:10.731614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4f525-25e5-4943-acfc-42d5bf4a60fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:10.731887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4f525-25e5-4943-acfc-42d5bf4a60fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:10.732516 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4f525-25e5-4943-acfc-42d5bf4a60fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:10.734106 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4f525-25e5-4943-acfc-42d5bf4a60fc admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:10.745187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1243/2501] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:23:10.749257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41435ec2-c293-4c41-b09f-f84a907d2082 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:10.759569 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41435ec2-c293-4c41-b09f-f84a907d2082 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:10.764125 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc151a56-872c-46fd-b75d-100b6342e075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:10.764761 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc151a56-872c-46fd-b75d-100b6342e075 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:10.765043 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc151a56-872c-46fd-b75d-100b6342e075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:10.765313 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc151a56-872c-46fd-b75d-100b6342e075 admin admin] PATH_INFO: `/v3/projects/004c1f8cfcf4444eb2070abb0c325ad7/users/2c7462775b9f42c8bf985630ac966cae/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:10.779906 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc151a56-872c-46fd-b75d-100b6342e075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=004c1f8cfcf4444eb2070abb0c325ad7, user_id=2c7462775b9f42c8bf985630ac966cae, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:10.782550 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc151a56-872c-46fd-b75d-100b6342e075 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:10.795626 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1259/2502] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:23:10 2022] PUT /identity/v3/projects/004c1f8cfcf4444eb2070abb0c325ad7/users/2c7462775b9f42c8bf985630ac966cae/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:23:10.799535 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4f525-25e5-4943-acfc-42d5bf4a60fc admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:10.810020 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4f525-25e5-4943-acfc-42d5bf4a60fc admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:10.866623 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf73196-bb37-4050-b5ce-4a48281e10ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:10.867277 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf73196-bb37-4050-b5ce-4a48281e10ad admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:10.867585 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf73196-bb37-4050-b5ce-4a48281e10ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:10.868592 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf73196-bb37-4050-b5ce-4a48281e10ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:10.869464 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf73196-bb37-4050-b5ce-4a48281e10ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:10.871090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf73196-bb37-4050-b5ce-4a48281e10ad admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:10.880928 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1244/2503] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:23:10.885090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc151a56-872c-46fd-b75d-100b6342e075 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:10.895127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc151a56-872c-46fd-b75d-100b6342e075 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:10.899926 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106de083-f65a-4e26-aaad-ab19f1099236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:10.900569 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106de083-f65a-4e26-aaad-ab19f1099236 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:10.900851 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106de083-f65a-4e26-aaad-ab19f1099236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:10.901122 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106de083-f65a-4e26-aaad-ab19f1099236 admin admin] PATH_INFO: `/v3/projects/004c1f8cfcf4444eb2070abb0c325ad7/users/2c7462775b9f42c8bf985630ac966cae/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:10.903019 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106de083-f65a-4e26-aaad-ab19f1099236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=004c1f8cfcf4444eb2070abb0c325ad7, user_id=2c7462775b9f42c8bf985630ac966cae, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:10.905724 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106de083-f65a-4e26-aaad-ab19f1099236 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:10.916303 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1260/2504] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:23:10 2022] PUT /identity/v3/projects/004c1f8cfcf4444eb2070abb0c325ad7/users/2c7462775b9f42c8bf985630ac966cae/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:23:10.926391 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a73bc-29ae-40b2-9726-235bff7cdef0 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:10.926671 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a73bc-29ae-40b2-9726-235bff7cdef0 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:10.926939 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a73bc-29ae-40b2-9726-235bff7cdef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:10.954954 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-423a73bc-29ae-40b2-9726-235bff7cdef0 None None] MFA Rules not processed for user `2c7462775b9f42c8bf985630ac966cae`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:23:10.956188 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-423a73bc-29ae-40b2-9726-235bff7cdef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:11.023459 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1245/2505] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:23:10 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:23:11.034016 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106de083-f65a-4e26-aaad-ab19f1099236 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:11.035737 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-106de083-f65a-4e26-aaad-ab19f1099236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:11.114425 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106de083-f65a-4e26-aaad-ab19f1099236 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:11.118118 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba171d-ab7c-4593-a08c-a53cd61ed555 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:11.118707 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba171d-ab7c-4593-a08c-a53cd61ed555 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:11.118981 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba171d-ab7c-4593-a08c-a53cd61ed555 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:11.119246 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba171d-ab7c-4593-a08c-a53cd61ed555 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:11.127959 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba171d-ab7c-4593-a08c-a53cd61ed555 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:11.129371 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba171d-ab7c-4593-a08c-a53cd61ed555 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:11.138659 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1261/2506] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:23:11 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:23:11.271557 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a73bc-29ae-40b2-9726-235bff7cdef0 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:11.284949 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:11.334069 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a73bc-29ae-40b2-9726-235bff7cdef0 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:11.339106 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafe8db-4ab1-4f90-9600-0e282458778f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:11.339745 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafe8db-4ab1-4f90-9600-0e282458778f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:11.340030 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafe8db-4ab1-4f90-9600-0e282458778f admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:11.340299 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafe8db-4ab1-4f90-9600-0e282458778f admin admin] PATH_INFO: `/v3/users/fda3c701418d42919be05cc7c1191eb6` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:11.341398 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafe8db-4ab1-4f90-9600-0e282458778f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda3c701418d42919be05cc7c1191eb6)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:11.343319 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafe8db-4ab1-4f90-9600-0e282458778f admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:11.389494 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-aeafe8db-4ab1-4f90-9600-0e282458778f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda3c701418d42919be05cc7c1191eb6'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:11.396293 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-aeafe8db-4ab1-4f90-9600-0e282458778f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda3c701418d42919be05cc7c1191eb6'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:11.403248 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-aeafe8db-4ab1-4f90-9600-0e282458778f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda3c701418d42919be05cc7c1191eb6'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:11.416096 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-aeafe8db-4ab1-4f90-9600-0e282458778f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda3c701418d42919be05cc7c1191eb6'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:11.416780 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-aeafe8db-4ab1-4f90-9600-0e282458778f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda3c701418d42919be05cc7c1191eb6'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:11.422544 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1246/2507] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:23:11 2022] DELETE /identity/v3/users/fda3c701418d42919be05cc7c1191eb6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:23:11.427015 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85673134-f985-49fc-8425-292a11518857 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:11.427303 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85673134-f985-49fc-8425-292a11518857 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:11.427597 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85673134-f985-49fc-8425-292a11518857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:11.446549 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-85673134-f985-49fc-8425-292a11518857 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:23:11.447722 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-85673134-f985-49fc-8425-292a11518857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:11.506423 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1262/2508] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:23:11.516879 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafe8db-4ab1-4f90-9600-0e282458778f admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:11.518366 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-aeafe8db-4ab1-4f90-9600-0e282458778f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:11.597099 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafe8db-4ab1-4f90-9600-0e282458778f admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:11.601036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2fc9a-8aee-4ca0-848e-df5045b4b728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:11.601634 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2fc9a-8aee-4ca0-848e-df5045b4b728 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:11.601914 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2fc9a-8aee-4ca0-848e-df5045b4b728 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:11.602215 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2fc9a-8aee-4ca0-848e-df5045b4b728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:11.611077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2fc9a-8aee-4ca0-848e-df5045b4b728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:11.612539 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2fc9a-8aee-4ca0-848e-df5045b4b728 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:11.621840 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1247/2509] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:23:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:23:11.884941 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85673134-f985-49fc-8425-292a11518857 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:11.886666 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-85673134-f985-49fc-8425-292a11518857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:11.901653 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85673134-f985-49fc-8425-292a11518857 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:11.906403 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfec14e-5a0c-4c96-9b71-9c1b16e61db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:11.907040 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfec14e-5a0c-4c96-9b71-9c1b16e61db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:11.907319 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfec14e-5a0c-4c96-9b71-9c1b16e61db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:11.907621 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfec14e-5a0c-4c96-9b71-9c1b16e61db4 admin admin] PATH_INFO: `/v3/projects/96eeef2c2dfb48c59860647401d8bd69` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:11.908740 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfec14e-5a0c-4c96-9b71-9c1b16e61db4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96eeef2c2dfb48c59860647401d8bd69)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:11.910657 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfec14e-5a0c-4c96-9b71-9c1b16e61db4 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:11.934802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:11.958253 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-abfec14e-5a0c-4c96-9b71-9c1b16e61db4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96eeef2c2dfb48c59860647401d8bd69', 'request_id': 'req-abfec14e-5a0c-4c96-9b71-9c1b16e61db4'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:11.965706 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-abfec14e-5a0c-4c96-9b71-9c1b16e61db4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96eeef2c2dfb48c59860647401d8bd69', 'request_id': 'req-abfec14e-5a0c-4c96-9b71-9c1b16e61db4'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:11.971201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-abfec14e-5a0c-4c96-9b71-9c1b16e61db4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96eeef2c2dfb48c59860647401d8bd69', 'request_id': 'req-abfec14e-5a0c-4c96-9b71-9c1b16e61db4'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:11.982540 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-abfec14e-5a0c-4c96-9b71-9c1b16e61db4 admin admin] The token cache is being invalidate because project 96eeef2c2dfb48c59860647401d8bd69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:23:11.982826 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-abfec14e-5a0c-4c96-9b71-9c1b16e61db4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:11.983489 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-abfec14e-5a0c-4c96-9b71-9c1b16e61db4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:11.984960 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1263/2510] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:23:11 2022] DELETE /identity/v3/projects/96eeef2c2dfb48c59860647401d8bd69 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:23:11.988987 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2fc9a-8aee-4ca0-848e-df5045b4b728 service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:11.999003 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2fc9a-8aee-4ca0-848e-df5045b4b728 service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:12.011109 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:12.062777 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8166399-02a3-40d9-9f53-1bd3ce5de2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:12.063316 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8166399-02a3-40d9-9f53-1bd3ce5de2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:12.063623 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8166399-02a3-40d9-9f53-1bd3ce5de2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:12.063892 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8166399-02a3-40d9-9f53-1bd3ce5de2be admin admin] PATH_INFO: `/v3/users/2c7462775b9f42c8bf985630ac966cae` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:12.065011 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8166399-02a3-40d9-9f53-1bd3ce5de2be admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c7462775b9f42c8bf985630ac966cae)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:12.066930 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8166399-02a3-40d9-9f53-1bd3ce5de2be admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:12.112673 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f8166399-02a3-40d9-9f53-1bd3ce5de2be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c7462775b9f42c8bf985630ac966cae'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:12.120051 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f8166399-02a3-40d9-9f53-1bd3ce5de2be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c7462775b9f42c8bf985630ac966cae'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:12.127304 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f8166399-02a3-40d9-9f53-1bd3ce5de2be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c7462775b9f42c8bf985630ac966cae'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:12.139112 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f8166399-02a3-40d9-9f53-1bd3ce5de2be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c7462775b9f42c8bf985630ac966cae'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:12.139754 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f8166399-02a3-40d9-9f53-1bd3ce5de2be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c7462775b9f42c8bf985630ac966cae'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:12.145446 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1248/2511] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:23:11 2022] DELETE /identity/v3/users/2c7462775b9f42c8bf985630ac966cae => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:23:12.418785 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfec14e-5a0c-4c96-9b71-9c1b16e61db4 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:12.420226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-abfec14e-5a0c-4c96-9b71-9c1b16e61db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:12.433501 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfec14e-5a0c-4c96-9b71-9c1b16e61db4 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:12.490514 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72156b2c-a7b1-4020-8ed8-2ad33950237c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:12.491157 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72156b2c-a7b1-4020-8ed8-2ad33950237c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:12.491413 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72156b2c-a7b1-4020-8ed8-2ad33950237c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:12.491709 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72156b2c-a7b1-4020-8ed8-2ad33950237c admin admin] PATH_INFO: `/v3/projects/004c1f8cfcf4444eb2070abb0c325ad7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:12.492937 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72156b2c-a7b1-4020-8ed8-2ad33950237c admin admin] RBAC: Authorizing `identity:delete_project(project_id=004c1f8cfcf4444eb2070abb0c325ad7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:12.495166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72156b2c-a7b1-4020-8ed8-2ad33950237c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:12.542006 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-72156b2c-a7b1-4020-8ed8-2ad33950237c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '004c1f8cfcf4444eb2070abb0c325ad7', 'request_id': 'req-72156b2c-a7b1-4020-8ed8-2ad33950237c'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:12.550028 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-72156b2c-a7b1-4020-8ed8-2ad33950237c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '004c1f8cfcf4444eb2070abb0c325ad7', 'request_id': 'req-72156b2c-a7b1-4020-8ed8-2ad33950237c'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:12.555682 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-72156b2c-a7b1-4020-8ed8-2ad33950237c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '004c1f8cfcf4444eb2070abb0c325ad7', 'request_id': 'req-72156b2c-a7b1-4020-8ed8-2ad33950237c'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:12.566748 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-72156b2c-a7b1-4020-8ed8-2ad33950237c admin admin] The token cache is being invalidate because project 004c1f8cfcf4444eb2070abb0c325ad7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:23:12.567033 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-72156b2c-a7b1-4020-8ed8-2ad33950237c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:12.567692 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-72156b2c-a7b1-4020-8ed8-2ad33950237c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:12.569158 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1264/2512] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:23:12 2022] DELETE /identity/v3/projects/004c1f8cfcf4444eb2070abb0c325ad7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:23:12.574664 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e895081-093c-43d8-bdd7-f46ad1efcc08 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:12.574946 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e895081-093c-43d8-bdd7-f46ad1efcc08 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:12.575214 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e895081-093c-43d8-bdd7-f46ad1efcc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:12.595055 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-0e895081-093c-43d8-bdd7-f46ad1efcc08 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:23:12.596207 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-0e895081-093c-43d8-bdd7-f46ad1efcc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:12.655523 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1249/2513] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:23:12.663226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af05301-d95f-49a8-9a77-9170bf56125a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:12.663543 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af05301-d95f-49a8-9a77-9170bf56125a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:12.663814 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af05301-d95f-49a8-9a77-9170bf56125a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:12.683996 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-1af05301-d95f-49a8-9a77-9170bf56125a None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:23:12.685201 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1af05301-d95f-49a8-9a77-9170bf56125a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:12.693040 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1265/2514] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:23:12.698146 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e895081-093c-43d8-bdd7-f46ad1efcc08 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:12.707658 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e895081-093c-43d8-bdd7-f46ad1efcc08 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:12.712180 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc24e46-c62e-4385-9add-c5ac405fa849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:12.712788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc24e46-c62e-4385-9add-c5ac405fa849 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:12.713051 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc24e46-c62e-4385-9add-c5ac405fa849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:12.713320 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc24e46-c62e-4385-9add-c5ac405fa849 admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:12.713958 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc24e46-c62e-4385-9add-c5ac405fa849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:23:12.714258 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc24e46-c62e-4385-9add-c5ac405fa849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:12.715886 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc24e46-c62e-4385-9add-c5ac405fa849 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:12.727986 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1250/2515] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:23:12.732017 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af05301-d95f-49a8-9a77-9170bf56125a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:12.740941 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af05301-d95f-49a8-9a77-9170bf56125a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:12.746151 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcc5c0-cd68-431f-8da7-3294fce42091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:12.746730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcc5c0-cd68-431f-8da7-3294fce42091 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:12.747003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcc5c0-cd68-431f-8da7-3294fce42091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:12.747269 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcc5c0-cd68-431f-8da7-3294fce42091 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:12.747923 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dcc5c0-cd68-431f-8da7-3294fce42091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:12.749800 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dcc5c0-cd68-431f-8da7-3294fce42091 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:12.776983 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1266/2516] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:23:12 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:23:12.781023 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc24e46-c62e-4385-9add-c5ac405fa849 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:12.790917 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc24e46-c62e-4385-9add-c5ac405fa849 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:12.810181 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:12.850138 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a9b6c-8b28-4b02-a11a-01d47bee6028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:12.850692 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a9b6c-8b28-4b02-a11a-01d47bee6028 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:12.850942 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a9b6c-8b28-4b02-a11a-01d47bee6028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:12.851209 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a9b6c-8b28-4b02-a11a-01d47bee6028 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:12.851920 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a9b6c-8b28-4b02-a11a-01d47bee6028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:12.853869 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a9b6c-8b28-4b02-a11a-01d47bee6028 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:12.874906 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1251/2517] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:23:12 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:23:12.878927 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcc5c0-cd68-431f-8da7-3294fce42091 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:12.889669 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcc5c0-cd68-431f-8da7-3294fce42091 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:12.894273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fd707-b346-42e7-986b-031f0c6478e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:12.895033 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fd707-b346-42e7-986b-031f0c6478e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:12.895319 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fd707-b346-42e7-986b-031f0c6478e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:12.895620 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fd707-b346-42e7-986b-031f0c6478e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:12.896255 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fd707-b346-42e7-986b-031f0c6478e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:12.897849 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fd707-b346-42e7-986b-031f0c6478e7 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:12.903147 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:12.908640 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1267/2518] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:23:12.913077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a9b6c-8b28-4b02-a11a-01d47bee6028 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:12.923263 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a9b6c-8b28-4b02-a11a-01d47bee6028 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:12.927899 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20540603-b8a6-456a-9f07-c423204028d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:12.928481 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20540603-b8a6-456a-9f07-c423204028d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:12.928757 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20540603-b8a6-456a-9f07-c423204028d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:12.929023 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20540603-b8a6-456a-9f07-c423204028d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:12.929647 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20540603-b8a6-456a-9f07-c423204028d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:12.932088 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20540603-b8a6-456a-9f07-c423204028d6 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:12.942393 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1252/2519] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:23:12.947503 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fd707-b346-42e7-986b-031f0c6478e7 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:12.957282 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fd707-b346-42e7-986b-031f0c6478e7 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:12.962199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17146ced-e297-46ba-8fb3-7ec0b0c08f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:12.962839 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17146ced-e297-46ba-8fb3-7ec0b0c08f24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:12.963120 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17146ced-e297-46ba-8fb3-7ec0b0c08f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:12.963394 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17146ced-e297-46ba-8fb3-7ec0b0c08f24 admin admin] PATH_INFO: `/v3/projects/0cd5853cd6b04d7d808b5d9bfe7bb69d/users/1cd7f1971cbe4c84874bb540cee7754d/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:12.978739 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17146ced-e297-46ba-8fb3-7ec0b0c08f24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd5853cd6b04d7d808b5d9bfe7bb69d, user_id=1cd7f1971cbe4c84874bb540cee7754d, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:12.981432 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17146ced-e297-46ba-8fb3-7ec0b0c08f24 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:12.994516 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1268/2520] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:23:12 2022] PUT /identity/v3/projects/0cd5853cd6b04d7d808b5d9bfe7bb69d/users/1cd7f1971cbe4c84874bb540cee7754d/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:23:13.005984 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4438da-c68b-42eb-9a1e-6372a739fed2 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:13.006461 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4438da-c68b-42eb-9a1e-6372a739fed2 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:13.006579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4438da-c68b-42eb-9a1e-6372a739fed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:13.035337 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-5e4438da-c68b-42eb-9a1e-6372a739fed2 None None] MFA Rules not processed for user `1cd7f1971cbe4c84874bb540cee7754d`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:23:13.036561 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-5e4438da-c68b-42eb-9a1e-6372a739fed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:13.099481 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1253/2521] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:23:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:23:13.104647 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17146ced-e297-46ba-8fb3-7ec0b0c08f24 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:13.164082 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17146ced-e297-46ba-8fb3-7ec0b0c08f24 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:13.169470 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb35ee5-23a9-4610-b80d-af9396f16fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:13.170060 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb35ee5-23a9-4610-b80d-af9396f16fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:13.170339 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb35ee5-23a9-4610-b80d-af9396f16fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:13.170608 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb35ee5-23a9-4610-b80d-af9396f16fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:13.171225 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb35ee5-23a9-4610-b80d-af9396f16fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:13.173213 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb35ee5-23a9-4610-b80d-af9396f16fb1 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:13.199248 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1269/2522] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:23:13 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:23:13.203289 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4438da-c68b-42eb-9a1e-6372a739fed2 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:13.214750 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4438da-c68b-42eb-9a1e-6372a739fed2 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:13.271065 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed26ffb-55e3-4904-a242-600ff4f04abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:13.271701 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed26ffb-55e3-4904-a242-600ff4f04abf admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:13.271978 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed26ffb-55e3-4904-a242-600ff4f04abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:13.272246 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed26ffb-55e3-4904-a242-600ff4f04abf admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:13.272872 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed26ffb-55e3-4904-a242-600ff4f04abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:13.274973 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed26ffb-55e3-4904-a242-600ff4f04abf admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:13.296993 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1254/2523] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:23:13 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:23:13.300968 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb35ee5-23a9-4610-b80d-af9396f16fb1 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:13.311672 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb35ee5-23a9-4610-b80d-af9396f16fb1 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:13.316224 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281df9ea-cf43-4f73-8c82-5e18d759c112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:13.316843 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281df9ea-cf43-4f73-8c82-5e18d759c112 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:13.317083 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281df9ea-cf43-4f73-8c82-5e18d759c112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:13.317351 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281df9ea-cf43-4f73-8c82-5e18d759c112 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:13.317977 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281df9ea-cf43-4f73-8c82-5e18d759c112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:13.319586 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281df9ea-cf43-4f73-8c82-5e18d759c112 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:13.329760 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1270/2524] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:23:13.333861 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed26ffb-55e3-4904-a242-600ff4f04abf admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:13.344239 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed26ffb-55e3-4904-a242-600ff4f04abf admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:13.349049 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312378d-4c7f-4d3e-89c1-581d82f653c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:13.349680 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312378d-4c7f-4d3e-89c1-581d82f653c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:13.349956 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312378d-4c7f-4d3e-89c1-581d82f653c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:13.350225 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312378d-4c7f-4d3e-89c1-581d82f653c6 admin admin] PATH_INFO: `/v3/projects/85a94b27383b4acf8c71e9078cc41781/users/b45995d911c445acae047ac12c7721ea/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:13.365300 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312378d-4c7f-4d3e-89c1-581d82f653c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85a94b27383b4acf8c71e9078cc41781, user_id=b45995d911c445acae047ac12c7721ea, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:13.367965 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312378d-4c7f-4d3e-89c1-581d82f653c6 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:13.370894 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:13.382175 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1255/2525] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:23:13 2022] PUT /identity/v3/projects/85a94b27383b4acf8c71e9078cc41781/users/b45995d911c445acae047ac12c7721ea/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:23:13.386275 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281df9ea-cf43-4f73-8c82-5e18d759c112 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:13.396231 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281df9ea-cf43-4f73-8c82-5e18d759c112 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:13.451600 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814072f-3dac-415c-9d79-e3ac9443b187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:13.452199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814072f-3dac-415c-9d79-e3ac9443b187 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:13.452477 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814072f-3dac-415c-9d79-e3ac9443b187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:13.452745 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814072f-3dac-415c-9d79-e3ac9443b187 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:13.453364 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814072f-3dac-415c-9d79-e3ac9443b187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:13.454953 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814072f-3dac-415c-9d79-e3ac9443b187 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:13.464901 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1271/2526] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:23:13.469042 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312378d-4c7f-4d3e-89c1-581d82f653c6 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:13.480197 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312378d-4c7f-4d3e-89c1-581d82f653c6 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:13.484966 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4cb31e-5792-447b-826c-0210df5f9444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:13.485641 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cb31e-5792-447b-826c-0210df5f9444 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:13.485942 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cb31e-5792-447b-826c-0210df5f9444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:13.486239 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cb31e-5792-447b-826c-0210df5f9444 admin admin] PATH_INFO: `/v3/projects/85a94b27383b4acf8c71e9078cc41781/users/b45995d911c445acae047ac12c7721ea/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:13.488207 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4cb31e-5792-447b-826c-0210df5f9444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85a94b27383b4acf8c71e9078cc41781, user_id=b45995d911c445acae047ac12c7721ea, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:13.490875 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4cb31e-5792-447b-826c-0210df5f9444 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:13.501442 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1256/2527] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:23:13 2022] PUT /identity/v3/projects/85a94b27383b4acf8c71e9078cc41781/users/b45995d911c445acae047ac12c7721ea/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:23:13.512163 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004808c-e307-464f-ad89-5b8d669b8525 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:13.512452 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004808c-e307-464f-ad89-5b8d669b8525 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:13.512759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004808c-e307-464f-ad89-5b8d669b8525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:13.543592 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-1004808c-e307-464f-ad89-5b8d669b8525 None None] MFA Rules not processed for user `b45995d911c445acae047ac12c7721ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:23:13.544830 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1004808c-e307-464f-ad89-5b8d669b8525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:13.577398 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:13.613212 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1272/2528] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:23:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:23:13.624619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4cb31e-5792-447b-826c-0210df5f9444 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:13.626299 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-ab4cb31e-5792-447b-826c-0210df5f9444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:13.683061 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4cb31e-5792-447b-826c-0210df5f9444 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:13.686675 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fae2f8-9bf3-4f3b-9925-52c2924c2c41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:13.687260 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fae2f8-9bf3-4f3b-9925-52c2924c2c41 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:13.687564 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fae2f8-9bf3-4f3b-9925-52c2924c2c41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:13.687833 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fae2f8-9bf3-4f3b-9925-52c2924c2c41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:13.697221 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fae2f8-9bf3-4f3b-9925-52c2924c2c41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:13.698651 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fae2f8-9bf3-4f3b-9925-52c2924c2c41 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:13.707860 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1257/2529] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:23:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:23:13.782971 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004808c-e307-464f-ad89-5b8d669b8525 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:13.792594 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004808c-e307-464f-ad89-5b8d669b8525 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:13.796228 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d09f4-e3e3-456a-b41e-952b2ed4f7cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:13.796811 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d09f4-e3e3-456a-b41e-952b2ed4f7cf service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:13.797083 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d09f4-e3e3-456a-b41e-952b2ed4f7cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:13.797347 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d09f4-e3e3-456a-b41e-952b2ed4f7cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:13.853310 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d09f4-e3e3-456a-b41e-952b2ed4f7cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:13.854734 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d09f4-e3e3-456a-b41e-952b2ed4f7cf service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:13.863446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1273/2530] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:23:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:23:20.637769 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fae2f8-9bf3-4f3b-9925-52c2924c2c41 service cinder] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:20.698306 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fae2f8-9bf3-4f3b-9925-52c2924c2c41 service cinder] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:20.702777 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b3934-d8c4-4a6b-b6a1-6efc8119d7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:20.703386 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b3934-d8c4-4a6b-b6a1-6efc8119d7d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:20.703706 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b3934-d8c4-4a6b-b6a1-6efc8119d7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:20.703973 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b3934-d8c4-4a6b-b6a1-6efc8119d7d1 admin admin] PATH_INFO: `/v3/users/1cd7f1971cbe4c84874bb540cee7754d` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:20.705055 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b3934-d8c4-4a6b-b6a1-6efc8119d7d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cd7f1971cbe4c84874bb540cee7754d)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:20.706957 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b3934-d8c4-4a6b-b6a1-6efc8119d7d1 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:20.751504 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8d4b3934-d8c4-4a6b-b6a1-6efc8119d7d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cd7f1971cbe4c84874bb540cee7754d'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:20.758133 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8d4b3934-d8c4-4a6b-b6a1-6efc8119d7d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cd7f1971cbe4c84874bb540cee7754d'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:20.765693 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8d4b3934-d8c4-4a6b-b6a1-6efc8119d7d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cd7f1971cbe4c84874bb540cee7754d'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:20.778428 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8d4b3934-d8c4-4a6b-b6a1-6efc8119d7d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cd7f1971cbe4c84874bb540cee7754d'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:20.779050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-8d4b3934-d8c4-4a6b-b6a1-6efc8119d7d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cd7f1971cbe4c84874bb540cee7754d'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:20.784797 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1258/2531] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:23:20 2022] DELETE /identity/v3/users/1cd7f1971cbe4c84874bb540cee7754d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:23:20.789197 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20312e6-3332-4693-a42e-0565ef4b0c98 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:20.789656 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20312e6-3332-4693-a42e-0565ef4b0c98 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:20.789755 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20312e6-3332-4693-a42e-0565ef4b0c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:20.809637 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-e20312e6-3332-4693-a42e-0565ef4b0c98 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:23:20.810810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e20312e6-3332-4693-a42e-0565ef4b0c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:20.869320 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1274/2532] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:23:20.879017 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b3934-d8c4-4a6b-b6a1-6efc8119d7d1 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:20.880422 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-8d4b3934-d8c4-4a6b-b6a1-6efc8119d7d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:20.886938 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:20.939579 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b3934-d8c4-4a6b-b6a1-6efc8119d7d1 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:20.943137 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59e9a2-2dbb-4874-95af-c62b5c667ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:20.943750 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59e9a2-2dbb-4874-95af-c62b5c667ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:20.944024 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59e9a2-2dbb-4874-95af-c62b5c667ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:20.944290 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59e9a2-2dbb-4874-95af-c62b5c667ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:20.953288 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59e9a2-2dbb-4874-95af-c62b5c667ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:20.954712 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59e9a2-2dbb-4874-95af-c62b5c667ec0 service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:20.964490 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1259/2533] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:23:21.229337 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20312e6-3332-4693-a42e-0565ef4b0c98 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:21.230867 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e20312e6-3332-4693-a42e-0565ef4b0c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:21.243206 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20312e6-3332-4693-a42e-0565ef4b0c98 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:21.248574 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2dd0ff-641c-487a-b9c8-acb547c947d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:21.249265 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dd0ff-641c-487a-b9c8-acb547c947d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:21.249624 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dd0ff-641c-487a-b9c8-acb547c947d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:21.249960 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dd0ff-641c-487a-b9c8-acb547c947d0 admin admin] PATH_INFO: `/v3/projects/0cd5853cd6b04d7d808b5d9bfe7bb69d` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:21.251134 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2dd0ff-641c-487a-b9c8-acb547c947d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cd5853cd6b04d7d808b5d9bfe7bb69d)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:21.253245 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2dd0ff-641c-487a-b9c8-acb547c947d0 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:21.299517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-da2dd0ff-641c-487a-b9c8-acb547c947d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cd5853cd6b04d7d808b5d9bfe7bb69d', 'request_id': 'req-da2dd0ff-641c-487a-b9c8-acb547c947d0'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:21.307469 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-da2dd0ff-641c-487a-b9c8-acb547c947d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cd5853cd6b04d7d808b5d9bfe7bb69d', 'request_id': 'req-da2dd0ff-641c-487a-b9c8-acb547c947d0'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:21.312989 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-da2dd0ff-641c-487a-b9c8-acb547c947d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cd5853cd6b04d7d808b5d9bfe7bb69d', 'request_id': 'req-da2dd0ff-641c-487a-b9c8-acb547c947d0'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:21.314047 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:21.326372 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-da2dd0ff-641c-487a-b9c8-acb547c947d0 admin admin] The token cache is being invalidate because project 0cd5853cd6b04d7d808b5d9bfe7bb69d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:23:21.326661 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-da2dd0ff-641c-487a-b9c8-acb547c947d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:21.327389 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-da2dd0ff-641c-487a-b9c8-acb547c947d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:21.328885 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1275/2534] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:23:21 2022] DELETE /identity/v3/projects/0cd5853cd6b04d7d808b5d9bfe7bb69d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:23:21.332828 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59e9a2-2dbb-4874-95af-c62b5c667ec0 service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:21.342219 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59e9a2-2dbb-4874-95af-c62b5c667ec0 service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:21.398547 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879111b-5923-43cd-a4c2-3344056766d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:21.399167 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879111b-5923-43cd-a4c2-3344056766d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:21.399466 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879111b-5923-43cd-a4c2-3344056766d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:21.399943 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879111b-5923-43cd-a4c2-3344056766d2 admin admin] PATH_INFO: `/v3/users/b45995d911c445acae047ac12c7721ea` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:21.401052 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879111b-5923-43cd-a4c2-3344056766d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b45995d911c445acae047ac12c7721ea)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:21.403005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879111b-5923-43cd-a4c2-3344056766d2 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:21.448664 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2879111b-5923-43cd-a4c2-3344056766d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b45995d911c445acae047ac12c7721ea'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:21.455558 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2879111b-5923-43cd-a4c2-3344056766d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b45995d911c445acae047ac12c7721ea'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:21.462998 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2879111b-5923-43cd-a4c2-3344056766d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b45995d911c445acae047ac12c7721ea'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:21.476118 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2879111b-5923-43cd-a4c2-3344056766d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b45995d911c445acae047ac12c7721ea'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:21.476816 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-2879111b-5923-43cd-a4c2-3344056766d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b45995d911c445acae047ac12c7721ea'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:21.483683 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1260/2535] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:23:21 2022] DELETE /identity/v3/users/b45995d911c445acae047ac12c7721ea => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:23:21.757838 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2dd0ff-641c-487a-b9c8-acb547c947d0 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:21.759568 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-da2dd0ff-641c-487a-b9c8-acb547c947d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:21.773624 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2dd0ff-641c-487a-b9c8-acb547c947d0 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:21.831949 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd7103-4c9b-402c-9a10-d6d18ed230b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:21.832624 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd7103-4c9b-402c-9a10-d6d18ed230b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:21.832841 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd7103-4c9b-402c-9a10-d6d18ed230b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:21.833109 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd7103-4c9b-402c-9a10-d6d18ed230b8 admin admin] PATH_INFO: `/v3/projects/85a94b27383b4acf8c71e9078cc41781` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:21.834209 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd7103-4c9b-402c-9a10-d6d18ed230b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85a94b27383b4acf8c71e9078cc41781)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:21.836211 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd7103-4c9b-402c-9a10-d6d18ed230b8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:21.882353 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-42bd7103-4c9b-402c-9a10-d6d18ed230b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85a94b27383b4acf8c71e9078cc41781', 'request_id': 'req-42bd7103-4c9b-402c-9a10-d6d18ed230b8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:21.889787 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-42bd7103-4c9b-402c-9a10-d6d18ed230b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85a94b27383b4acf8c71e9078cc41781', 'request_id': 'req-42bd7103-4c9b-402c-9a10-d6d18ed230b8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:21.895560 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-42bd7103-4c9b-402c-9a10-d6d18ed230b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85a94b27383b4acf8c71e9078cc41781', 'request_id': 'req-42bd7103-4c9b-402c-9a10-d6d18ed230b8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:21.907074 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-42bd7103-4c9b-402c-9a10-d6d18ed230b8 admin admin] The token cache is being invalidate because project 85a94b27383b4acf8c71e9078cc41781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:23:21.907359 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-42bd7103-4c9b-402c-9a10-d6d18ed230b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:21.908015 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-42bd7103-4c9b-402c-9a10-d6d18ed230b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:21.909473 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1276/2536] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:23:21 2022] DELETE /identity/v3/projects/85a94b27383b4acf8c71e9078cc41781 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:23:21.914438 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9dd5e-6658-406d-b73c-1aec5428c537 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:21.914903 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9dd5e-6658-406d-b73c-1aec5428c537 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:21.914998 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9dd5e-6658-406d-b73c-1aec5428c537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:21.935875 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-c8e9dd5e-6658-406d-b73c-1aec5428c537 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:23:21.937068 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-c8e9dd5e-6658-406d-b73c-1aec5428c537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:21.956966 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:21.997869 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1261/2537] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:23:22.006684 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040583ba-4532-4569-a4e6-a1b3cff60f14 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:22.006967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040583ba-4532-4569-a4e6-a1b3cff60f14 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:22.007239 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040583ba-4532-4569-a4e6-a1b3cff60f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:22.027626 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-040583ba-4532-4569-a4e6-a1b3cff60f14 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:23:22.028802 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-040583ba-4532-4569-a4e6-a1b3cff60f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:22.036490 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1277/2538] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:23:22.040664 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9dd5e-6658-406d-b73c-1aec5428c537 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:22.050417 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9dd5e-6658-406d-b73c-1aec5428c537 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:22.054947 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b10201-9f48-4510-b572-963c18e01c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:22.055580 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b10201-9f48-4510-b572-963c18e01c8d admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:22.055859 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b10201-9f48-4510-b572-963c18e01c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:22.056306 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b10201-9f48-4510-b572-963c18e01c8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:22.056943 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b10201-9f48-4510-b572-963c18e01c8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:23:22.057240 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b10201-9f48-4510-b572-963c18e01c8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:22.058832 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b10201-9f48-4510-b572-963c18e01c8d admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:22.070202 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1262/2539] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:23:22.074800 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040583ba-4532-4569-a4e6-a1b3cff60f14 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:22.083783 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040583ba-4532-4569-a4e6-a1b3cff60f14 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:22.089198 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cbe05-450d-4b47-ba3e-02419a24e5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:22.089721 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cbe05-450d-4b47-ba3e-02419a24e5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:22.090001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cbe05-450d-4b47-ba3e-02419a24e5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:22.090266 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cbe05-450d-4b47-ba3e-02419a24e5c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:22.090892 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cbe05-450d-4b47-ba3e-02419a24e5c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:22.092814 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cbe05-450d-4b47-ba3e-02419a24e5c6 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:22.120124 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1278/2540] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:23:22 2022] POST /identity/v3/projects => generated 357 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:23:22.124321 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b10201-9f48-4510-b572-963c18e01c8d admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:22.135341 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b10201-9f48-4510-b572-963c18e01c8d admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:22.189527 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c768a8-7669-43e5-a4b4-1fb3ba67f469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:22.190116 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c768a8-7669-43e5-a4b4-1fb3ba67f469 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:22.190387 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c768a8-7669-43e5-a4b4-1fb3ba67f469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:22.190649 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c768a8-7669-43e5-a4b4-1fb3ba67f469 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:22.191267 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c768a8-7669-43e5-a4b4-1fb3ba67f469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:22.193189 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c768a8-7669-43e5-a4b4-1fb3ba67f469 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:22.214581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1263/2541] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:23:22 2022] POST /identity/v3/users => generated 279 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:23:22.218691 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cbe05-450d-4b47-ba3e-02419a24e5c6 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:22.229112 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cbe05-450d-4b47-ba3e-02419a24e5c6 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:22.233681 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1aef9-0f2e-47b7-8a10-0e63b432fd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:22.234294 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1aef9-0f2e-47b7-8a10-0e63b432fd9a admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:22.234566 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1aef9-0f2e-47b7-8a10-0e63b432fd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:22.234832 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1aef9-0f2e-47b7-8a10-0e63b432fd9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:22.235487 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1aef9-0f2e-47b7-8a10-0e63b432fd9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:22.237062 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1aef9-0f2e-47b7-8a10-0e63b432fd9a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:22.246708 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1279/2542] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:23:22.250692 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c768a8-7669-43e5-a4b4-1fb3ba67f469 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:22.261218 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c768a8-7669-43e5-a4b4-1fb3ba67f469 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:22.265809 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833f380-438a-4645-a0ca-ffe80a690451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:22.266400 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833f380-438a-4645-a0ca-ffe80a690451 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:22.266682 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833f380-438a-4645-a0ca-ffe80a690451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:22.266953 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833f380-438a-4645-a0ca-ffe80a690451 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:22.267612 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833f380-438a-4645-a0ca-ffe80a690451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:22.269229 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833f380-438a-4645-a0ca-ffe80a690451 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:22.280381 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1264/2543] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:23:22.284288 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1aef9-0f2e-47b7-8a10-0e63b432fd9a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:22.294687 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1aef9-0f2e-47b7-8a10-0e63b432fd9a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:22.299485 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b67d8-4286-4d50-9db0-26a64b417bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:22.300135 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b67d8-4286-4d50-9db0-26a64b417bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:22.300414 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b67d8-4286-4d50-9db0-26a64b417bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:22.300685 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b67d8-4286-4d50-9db0-26a64b417bd9 admin admin] PATH_INFO: `/v3/projects/9b4a35bc8d0f4537b6266e035ee59930/users/a1d5a17ed3ed430ea062aeaec19c1493/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:22.315900 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b67d8-4286-4d50-9db0-26a64b417bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b4a35bc8d0f4537b6266e035ee59930, user_id=a1d5a17ed3ed430ea062aeaec19c1493, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:22.318555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b67d8-4286-4d50-9db0-26a64b417bd9 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:22.331234 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1280/2544] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:23:22 2022] PUT /identity/v3/projects/9b4a35bc8d0f4537b6266e035ee59930/users/a1d5a17ed3ed430ea062aeaec19c1493/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:23:22.342540 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248bf50-029d-4c40-bb3e-617fe4867f1f None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:22.342766 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248bf50-029d-4c40-bb3e-617fe4867f1f None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:22.343047 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248bf50-029d-4c40-bb3e-617fe4867f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:22.370797 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-9248bf50-029d-4c40-bb3e-617fe4867f1f None None] MFA Rules not processed for user `a1d5a17ed3ed430ea062aeaec19c1493`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:23:22.372041 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-9248bf50-029d-4c40-bb3e-617fe4867f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:22.434587 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1265/2545] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:23:22 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:23:22.439056 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b67d8-4286-4d50-9db0-26a64b417bd9 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:22.459152 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:22.500678 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b67d8-4286-4d50-9db0-26a64b417bd9 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:22.505256 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bc9a8-44a0-41d5-bac1-84ce27ff0d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:22.505848 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bc9a8-44a0-41d5-bac1-84ce27ff0d1b admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:22.506126 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bc9a8-44a0-41d5-bac1-84ce27ff0d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:22.506393 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bc9a8-44a0-41d5-bac1-84ce27ff0d1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:22.507009 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506bc9a8-44a0-41d5-bac1-84ce27ff0d1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:22.508933 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506bc9a8-44a0-41d5-bac1-84ce27ff0d1b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:22.536479 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1281/2546] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:23:22 2022] POST /identity/v3/projects => generated 357 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:23:22.541637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248bf50-029d-4c40-bb3e-617fe4867f1f None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:22.552897 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248bf50-029d-4c40-bb3e-617fe4867f1f None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:22.571905 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:22.613029 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbe342-43d2-4067-934f-c5e476372cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:22.613555 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbe342-43d2-4067-934f-c5e476372cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:22.613836 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbe342-43d2-4067-934f-c5e476372cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:22.614104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbe342-43d2-4067-934f-c5e476372cb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:22.614731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbe342-43d2-4067-934f-c5e476372cb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:22.616689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbe342-43d2-4067-934f-c5e476372cb1 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:22.637685 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1266/2547] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:23:22 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:23:22.641649 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bc9a8-44a0-41d5-bac1-84ce27ff0d1b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:22.652227 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bc9a8-44a0-41d5-bac1-84ce27ff0d1b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:22.656859 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f0648-55e8-4f32-919f-de5fd0bc8c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:22.657457 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f0648-55e8-4f32-919f-de5fd0bc8c96 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:22.657737 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f0648-55e8-4f32-919f-de5fd0bc8c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:22.658011 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f0648-55e8-4f32-919f-de5fd0bc8c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:22.658644 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f0648-55e8-4f32-919f-de5fd0bc8c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:22.660267 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f0648-55e8-4f32-919f-de5fd0bc8c96 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:22.672634 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1282/2548] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:23:22.676863 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbe342-43d2-4067-934f-c5e476372cb1 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:22.686880 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbe342-43d2-4067-934f-c5e476372cb1 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:22.691415 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd66b6-9298-430f-a9b8-f08945812408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:22.692086 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd66b6-9298-430f-a9b8-f08945812408 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:22.692366 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd66b6-9298-430f-a9b8-f08945812408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:22.692638 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd66b6-9298-430f-a9b8-f08945812408 admin admin] PATH_INFO: `/v3/projects/e4ee426771144a66bee43dd3cb7afafc/users/14a7a87bc2264f049d8955603260afbf/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:22.707646 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd66b6-9298-430f-a9b8-f08945812408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4ee426771144a66bee43dd3cb7afafc, user_id=14a7a87bc2264f049d8955603260afbf, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:22.710315 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd66b6-9298-430f-a9b8-f08945812408 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:22.723689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1267/2549] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:23:22 2022] PUT /identity/v3/projects/e4ee426771144a66bee43dd3cb7afafc/users/14a7a87bc2264f049d8955603260afbf/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:23:22.727752 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f0648-55e8-4f32-919f-de5fd0bc8c96 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:22.737978 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f0648-55e8-4f32-919f-de5fd0bc8c96 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:22.793031 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959eeab-b354-4cfa-b7b5-3eac4fce78d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:22.793634 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959eeab-b354-4cfa-b7b5-3eac4fce78d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:22.793919 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959eeab-b354-4cfa-b7b5-3eac4fce78d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:22.794221 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959eeab-b354-4cfa-b7b5-3eac4fce78d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:22.794848 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959eeab-b354-4cfa-b7b5-3eac4fce78d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:22.796517 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959eeab-b354-4cfa-b7b5-3eac4fce78d5 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:22.806203 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1283/2550] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:23:22.810412 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd66b6-9298-430f-a9b8-f08945812408 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:22.820611 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd66b6-9298-430f-a9b8-f08945812408 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:22.825748 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489e59a-bea5-4273-9a6b-b0d72e557e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:22.826391 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489e59a-bea5-4273-9a6b-b0d72e557e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:22.826667 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489e59a-bea5-4273-9a6b-b0d72e557e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:22.826939 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489e59a-bea5-4273-9a6b-b0d72e557e48 admin admin] PATH_INFO: `/v3/projects/e4ee426771144a66bee43dd3cb7afafc/users/14a7a87bc2264f049d8955603260afbf/roles/23ca6ecd60b2470cba913daeaf54f0f7` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:22.828867 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489e59a-bea5-4273-9a6b-b0d72e557e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4ee426771144a66bee43dd3cb7afafc, user_id=14a7a87bc2264f049d8955603260afbf, role_id=23ca6ecd60b2470cba913daeaf54f0f7)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:22.831540 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489e59a-bea5-4273-9a6b-b0d72e557e48 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:22.842152 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1268/2551] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:23:22 2022] PUT /identity/v3/projects/e4ee426771144a66bee43dd3cb7afafc/users/14a7a87bc2264f049d8955603260afbf/roles/23ca6ecd60b2470cba913daeaf54f0f7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:23:22.852504 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a996441-1cad-4b47-8d64-a60503bba31b None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:22.853059 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a996441-1cad-4b47-8d64-a60503bba31b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:22.853223 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a996441-1cad-4b47-8d64-a60503bba31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:22.882030 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-3a996441-1cad-4b47-8d64-a60503bba31b None None] MFA Rules not processed for user `14a7a87bc2264f049d8955603260afbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:23:22.883257 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3a996441-1cad-4b47-8d64-a60503bba31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:22.951606 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1284/2552] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:23:22 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:23:22.964214 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489e59a-bea5-4273-9a6b-b0d72e557e48 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:22.965928 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-0489e59a-bea5-4273-9a6b-b0d72e557e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:23.028196 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489e59a-bea5-4273-9a6b-b0d72e557e48 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:23.033559 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d13de-2dc6-43da-b7b8-c982236428ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:23.034635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d13de-2dc6-43da-b7b8-c982236428ca service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:23.035149 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d13de-2dc6-43da-b7b8-c982236428ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:23.035691 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d13de-2dc6-43da-b7b8-c982236428ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:23.049487 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d13de-2dc6-43da-b7b8-c982236428ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:23.050924 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d13de-2dc6-43da-b7b8-c982236428ca service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:23.061277 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1269/2553] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:23:22 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:23:23.139436 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a996441-1cad-4b47-8d64-a60503bba31b None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:23.153247 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a996441-1cad-4b47-8d64-a60503bba31b None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:23.156858 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64486a-bd1f-4215-8bd2-ef605e8c7cf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:23.157465 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64486a-bd1f-4215-8bd2-ef605e8c7cf0 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:23.157743 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64486a-bd1f-4215-8bd2-ef605e8c7cf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:23.158010 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64486a-bd1f-4215-8bd2-ef605e8c7cf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:23.169925 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:23.214849 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64486a-bd1f-4215-8bd2-ef605e8c7cf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:23.216302 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64486a-bd1f-4215-8bd2-ef605e8c7cf0 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:23.225183 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1285/2554] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:23:23 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:23:33.056327 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=60,keystone:INSERT=5 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:33.220956 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=21 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:38.144489 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d13de-2dc6-43da-b7b8-c982236428ca service cinder] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:38.205117 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d13de-2dc6-43da-b7b8-c982236428ca service cinder] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:38.209613 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2339be5-c12a-4b3f-9f12-e9b96b436b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:38.210232 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2339be5-c12a-4b3f-9f12-e9b96b436b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:38.210511 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2339be5-c12a-4b3f-9f12-e9b96b436b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:38.210783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2339be5-c12a-4b3f-9f12-e9b96b436b1c admin admin] PATH_INFO: `/v3/users/a1d5a17ed3ed430ea062aeaec19c1493` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:38.211902 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2339be5-c12a-4b3f-9f12-e9b96b436b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1d5a17ed3ed430ea062aeaec19c1493)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:38.213938 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2339be5-c12a-4b3f-9f12-e9b96b436b1c admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:38.258079 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c2339be5-c12a-4b3f-9f12-e9b96b436b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1d5a17ed3ed430ea062aeaec19c1493'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:38.265481 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c2339be5-c12a-4b3f-9f12-e9b96b436b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1d5a17ed3ed430ea062aeaec19c1493'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:38.271853 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c2339be5-c12a-4b3f-9f12-e9b96b436b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1d5a17ed3ed430ea062aeaec19c1493'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:38.283464 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c2339be5-c12a-4b3f-9f12-e9b96b436b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1d5a17ed3ed430ea062aeaec19c1493'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:38.284084 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-c2339be5-c12a-4b3f-9f12-e9b96b436b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1d5a17ed3ed430ea062aeaec19c1493'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:38.289713 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1270/2555] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:23:38 2022] DELETE /identity/v3/users/a1d5a17ed3ed430ea062aeaec19c1493 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:23:38.294354 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2893a-49b3-40ba-ac44-162200f0d0a8 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:38.294840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2893a-49b3-40ba-ac44-162200f0d0a8 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:38.295076 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2893a-49b3-40ba-ac44-162200f0d0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:38.314548 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-50e2893a-49b3-40ba-ac44-162200f0d0a8 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:23:38.315764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-50e2893a-49b3-40ba-ac44-162200f0d0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:38.374687 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1286/2556] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:23:38.384445 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2339be5-c12a-4b3f-9f12-e9b96b436b1c admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:38.385833 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-c2339be5-c12a-4b3f-9f12-e9b96b436b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:38.442468 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2339be5-c12a-4b3f-9f12-e9b96b436b1c admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:38.446110 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67a45c-da44-41f4-9aee-5c78fb643ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:38.447243 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67a45c-da44-41f4-9aee-5c78fb643ddc service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:38.447691 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67a45c-da44-41f4-9aee-5c78fb643ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:38.448108 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67a45c-da44-41f4-9aee-5c78fb643ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:38.457104 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67a45c-da44-41f4-9aee-5c78fb643ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:38.458721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67a45c-da44-41f4-9aee-5c78fb643ddc service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:38.468753 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1271/2557] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:23:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:23:38.735764 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2893a-49b3-40ba-ac44-162200f0d0a8 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:38.737232 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-50e2893a-49b3-40ba-ac44-162200f0d0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:38.755730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2893a-49b3-40ba-ac44-162200f0d0a8 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:38.761527 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf0b7e-3820-45ab-80ac-eaf17c830929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:38.762254 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf0b7e-3820-45ab-80ac-eaf17c830929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:38.762596 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf0b7e-3820-45ab-80ac-eaf17c830929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:38.762961 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf0b7e-3820-45ab-80ac-eaf17c830929 admin admin] PATH_INFO: `/v3/projects/9b4a35bc8d0f4537b6266e035ee59930` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:38.764024 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf0b7e-3820-45ab-80ac-eaf17c830929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b4a35bc8d0f4537b6266e035ee59930)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:38.765932 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf0b7e-3820-45ab-80ac-eaf17c830929 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:38.812702 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d2cf0b7e-3820-45ab-80ac-eaf17c830929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b4a35bc8d0f4537b6266e035ee59930', 'request_id': 'req-d2cf0b7e-3820-45ab-80ac-eaf17c830929'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:38.819792 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d2cf0b7e-3820-45ab-80ac-eaf17c830929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b4a35bc8d0f4537b6266e035ee59930', 'request_id': 'req-d2cf0b7e-3820-45ab-80ac-eaf17c830929'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:38.825424 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d2cf0b7e-3820-45ab-80ac-eaf17c830929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b4a35bc8d0f4537b6266e035ee59930', 'request_id': 'req-d2cf0b7e-3820-45ab-80ac-eaf17c830929'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:38.836068 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d2cf0b7e-3820-45ab-80ac-eaf17c830929 admin admin] The token cache is being invalidate because project 9b4a35bc8d0f4537b6266e035ee59930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:23:38.836348 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d2cf0b7e-3820-45ab-80ac-eaf17c830929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:38.836984 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d2cf0b7e-3820-45ab-80ac-eaf17c830929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:38.839100 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1287/2558] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:23:38 2022] DELETE /identity/v3/projects/9b4a35bc8d0f4537b6266e035ee59930 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:23:38.843097 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67a45c-da44-41f4-9aee-5c78fb643ddc service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:38.853616 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67a45c-da44-41f4-9aee-5c78fb643ddc service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:38.871920 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:38.912490 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c611ab3-2f68-4bf3-b8ee-66c3e929fcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:38.913047 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c611ab3-2f68-4bf3-b8ee-66c3e929fcc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:38.913324 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c611ab3-2f68-4bf3-b8ee-66c3e929fcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:38.913592 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c611ab3-2f68-4bf3-b8ee-66c3e929fcc6 admin admin] PATH_INFO: `/v3/users/14a7a87bc2264f049d8955603260afbf` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:38.914689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c611ab3-2f68-4bf3-b8ee-66c3e929fcc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a7a87bc2264f049d8955603260afbf)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:38.917369 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c611ab3-2f68-4bf3-b8ee-66c3e929fcc6 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:38.961632 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1c611ab3-2f68-4bf3-b8ee-66c3e929fcc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a7a87bc2264f049d8955603260afbf'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:38.968987 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1c611ab3-2f68-4bf3-b8ee-66c3e929fcc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a7a87bc2264f049d8955603260afbf'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:38.976048 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1c611ab3-2f68-4bf3-b8ee-66c3e929fcc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a7a87bc2264f049d8955603260afbf'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:38.989074 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1c611ab3-2f68-4bf3-b8ee-66c3e929fcc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a7a87bc2264f049d8955603260afbf'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:38.989710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-1c611ab3-2f68-4bf3-b8ee-66c3e929fcc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a7a87bc2264f049d8955603260afbf'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:38.995900 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1272/2559] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:23:38 2022] DELETE /identity/v3/users/14a7a87bc2264f049d8955603260afbf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:23:39.261573 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf0b7e-3820-45ab-80ac-eaf17c830929 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:39.263031 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d2cf0b7e-3820-45ab-80ac-eaf17c830929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:39.278759 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf0b7e-3820-45ab-80ac-eaf17c830929 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:39.338297 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df84767-3baa-4bac-ae91-4c9afb74fd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:39.338937 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df84767-3baa-4bac-ae91-4c9afb74fd5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:39.339221 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df84767-3baa-4bac-ae91-4c9afb74fd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:39.339494 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df84767-3baa-4bac-ae91-4c9afb74fd5a admin admin] PATH_INFO: `/v3/projects/e4ee426771144a66bee43dd3cb7afafc` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:39.340644 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df84767-3baa-4bac-ae91-4c9afb74fd5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4ee426771144a66bee43dd3cb7afafc)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:39.342582 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df84767-3baa-4bac-ae91-4c9afb74fd5a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:39.373377 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:39.391819 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1df84767-3baa-4bac-ae91-4c9afb74fd5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4ee426771144a66bee43dd3cb7afafc', 'request_id': 'req-1df84767-3baa-4bac-ae91-4c9afb74fd5a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:39.399016 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1df84767-3baa-4bac-ae91-4c9afb74fd5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4ee426771144a66bee43dd3cb7afafc', 'request_id': 'req-1df84767-3baa-4bac-ae91-4c9afb74fd5a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:39.405166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1df84767-3baa-4bac-ae91-4c9afb74fd5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4ee426771144a66bee43dd3cb7afafc', 'request_id': 'req-1df84767-3baa-4bac-ae91-4c9afb74fd5a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:39.416265 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1df84767-3baa-4bac-ae91-4c9afb74fd5a admin admin] The token cache is being invalidate because project e4ee426771144a66bee43dd3cb7afafc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:23:39.416500 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1df84767-3baa-4bac-ae91-4c9afb74fd5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:39.417269 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1df84767-3baa-4bac-ae91-4c9afb74fd5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:23:39.419022 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1288/2560] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:23:39 2022] DELETE /identity/v3/projects/e4ee426771144a66bee43dd3cb7afafc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:23:39.425018 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4f4b5-0aa6-4304-bc9c-e0415e5a0568 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:39.425489 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4f4b5-0aa6-4304-bc9c-e0415e5a0568 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:39.425605 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4f4b5-0aa6-4304-bc9c-e0415e5a0568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:39.445346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-34f4f4b5-0aa6-4304-bc9c-e0415e5a0568 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:23:39.446589 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-34f4f4b5-0aa6-4304-bc9c-e0415e5a0568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:39.504861 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1273/2561] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:23:39.513617 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824c7f9-78db-4f40-b0cd-f11f575ed1d6 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:39.513902 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824c7f9-78db-4f40-b0cd-f11f575ed1d6 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:39.514173 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824c7f9-78db-4f40-b0cd-f11f575ed1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:39.533992 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-f824c7f9-78db-4f40-b0cd-f11f575ed1d6 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:23:39.535165 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f824c7f9-78db-4f40-b0cd-f11f575ed1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:39.543199 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1289/2562] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:23:39.547580 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4f4b5-0aa6-4304-bc9c-e0415e5a0568 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:39.558036 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4f4b5-0aa6-4304-bc9c-e0415e5a0568 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:39.562698 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85df65-4d39-41b1-b1d5-ad2748d4b178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:39.563286 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85df65-4d39-41b1-b1d5-ad2748d4b178 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:39.563597 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85df65-4d39-41b1-b1d5-ad2748d4b178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:39.563865 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85df65-4d39-41b1-b1d5-ad2748d4b178 admin admin] PATH_INFO: `/v3/domains` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:39.564493 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85df65-4d39-41b1-b1d5-ad2748d4b178 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:23:39.564788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85df65-4d39-41b1-b1d5-ad2748d4b178 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:39.566370 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85df65-4d39-41b1-b1d5-ad2748d4b178 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:39.578464 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1274/2563] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:23:39.582784 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824c7f9-78db-4f40-b0cd-f11f575ed1d6 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:39.592226 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824c7f9-78db-4f40-b0cd-f11f575ed1d6 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:39.596889 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675a702-72a0-4ffb-aefc-2928e9eea08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:39.597480 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675a702-72a0-4ffb-aefc-2928e9eea08e admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:39.597761 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675a702-72a0-4ffb-aefc-2928e9eea08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:39.598033 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675a702-72a0-4ffb-aefc-2928e9eea08e admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:39.598933 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675a702-72a0-4ffb-aefc-2928e9eea08e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:39.600886 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675a702-72a0-4ffb-aefc-2928e9eea08e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:39.628584 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1290/2564] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:23:39 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:23:39.632419 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85df65-4d39-41b1-b1d5-ad2748d4b178 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:39.642883 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85df65-4d39-41b1-b1d5-ad2748d4b178 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:39.668185 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:39.699307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db21da2-eff3-4cf6-839a-6212f331d2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:39.699953 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db21da2-eff3-4cf6-839a-6212f331d2e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:39.700442 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db21da2-eff3-4cf6-839a-6212f331d2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:39.701608 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db21da2-eff3-4cf6-839a-6212f331d2e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:39.701608 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db21da2-eff3-4cf6-839a-6212f331d2e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:39.703356 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db21da2-eff3-4cf6-839a-6212f331d2e5 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:39.724090 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1275/2565] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:23:39 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:23:39.728138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675a702-72a0-4ffb-aefc-2928e9eea08e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:39.738162 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675a702-72a0-4ffb-aefc-2928e9eea08e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:39.742725 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd50bf-7163-4239-b49e-210c966854c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:39.743316 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd50bf-7163-4239-b49e-210c966854c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:39.744143 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd50bf-7163-4239-b49e-210c966854c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:39.744631 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd50bf-7163-4239-b49e-210c966854c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:39.745403 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd50bf-7163-4239-b49e-210c966854c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:39.746992 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd50bf-7163-4239-b49e-210c966854c2 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:39.756731 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1291/2566] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:23:39.761295 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db21da2-eff3-4cf6-839a-6212f331d2e5 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:39.771146 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db21da2-eff3-4cf6-839a-6212f331d2e5 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:39.775780 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94533702-21ad-4762-a2b8-97316ec239a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:39.776359 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94533702-21ad-4762-a2b8-97316ec239a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:39.776635 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94533702-21ad-4762-a2b8-97316ec239a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:39.776906 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94533702-21ad-4762-a2b8-97316ec239a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:39.777532 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94533702-21ad-4762-a2b8-97316ec239a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:39.779109 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94533702-21ad-4762-a2b8-97316ec239a6 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:39.789441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1276/2567] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:23:39.793571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd50bf-7163-4239-b49e-210c966854c2 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:39.803220 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd50bf-7163-4239-b49e-210c966854c2 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:39.808468 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34115ad9-b4be-47c3-bcac-2f70c02e8ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:39.809104 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34115ad9-b4be-47c3-bcac-2f70c02e8ee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:39.809379 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34115ad9-b4be-47c3-bcac-2f70c02e8ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:39.809648 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34115ad9-b4be-47c3-bcac-2f70c02e8ee3 admin admin] PATH_INFO: `/v3/projects/d649c902008945d293b46ef6e4bee4be/users/147c9e990b534912bf8a677dd37b32ef/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:39.825443 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34115ad9-b4be-47c3-bcac-2f70c02e8ee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d649c902008945d293b46ef6e4bee4be, user_id=147c9e990b534912bf8a677dd37b32ef, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:39.828109 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34115ad9-b4be-47c3-bcac-2f70c02e8ee3 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:39.840376 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1292/2568] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:23:39 2022] PUT /identity/v3/projects/d649c902008945d293b46ef6e4bee4be/users/147c9e990b534912bf8a677dd37b32ef/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:23:39.845602 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd6949-2cad-42f9-ae48-30ed51f067c8 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:39.845885 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd6949-2cad-42f9-ae48-30ed51f067c8 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:39.846156 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd6949-2cad-42f9-ae48-30ed51f067c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:39.865079 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-b4cd6949-2cad-42f9-ae48-30ed51f067c8 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:23:39.866265 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-b4cd6949-2cad-42f9-ae48-30ed51f067c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:39.925504 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1277/2569] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:23:39.936063 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34115ad9-b4be-47c3-bcac-2f70c02e8ee3 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:39.937861 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-34115ad9-b4be-47c3-bcac-2f70c02e8ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:39.996737 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34115ad9-b4be-47c3-bcac-2f70c02e8ee3 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:40.000381 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9f52f-a838-4ca1-8ad9-af737aa75730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:40.001348 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9f52f-a838-4ca1-8ad9-af737aa75730 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:40.001626 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9f52f-a838-4ca1-8ad9-af737aa75730 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:40.001896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9f52f-a838-4ca1-8ad9-af737aa75730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:40.011210 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9f52f-a838-4ca1-8ad9-af737aa75730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:40.012742 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9f52f-a838-4ca1-8ad9-af737aa75730 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:40.022094 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1293/2570] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:23:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:23:40.624837 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d95fd-5efe-499b-aa9c-1115a21e757d None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:40.625397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d95fd-5efe-499b-aa9c-1115a21e757d None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:40.625397 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d95fd-5efe-499b-aa9c-1115a21e757d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:40.653783 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-288d95fd-5efe-499b-aa9c-1115a21e757d None None] MFA Rules not processed for user `147c9e990b534912bf8a677dd37b32ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:23:40.655050 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-288d95fd-5efe-499b-aa9c-1115a21e757d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:40.722689 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1278/2571] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:23:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:23:40.734103 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9f52f-a838-4ca1-8ad9-af737aa75730 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:40.735599 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b8e9f52f-a838-4ca1-8ad9-af737aa75730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:40.795465 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9f52f-a838-4ca1-8ad9-af737aa75730 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:40.799179 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015dc6b-47ac-4064-bdd4-4456d368ce4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:40.799833 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015dc6b-47ac-4064-bdd4-4456d368ce4a service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:40.800105 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015dc6b-47ac-4064-bdd4-4456d368ce4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:40.800370 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015dc6b-47ac-4064-bdd4-4456d368ce4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:40.807158 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:40.809699 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015dc6b-47ac-4064-bdd4-4456d368ce4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:40.811911 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015dc6b-47ac-4064-bdd4-4456d368ce4a service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:40.820928 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1294/2572] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:23:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:23:42.176813 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408bd91-0198-4192-a5b0-df2584cea076 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:42.177335 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408bd91-0198-4192-a5b0-df2584cea076 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:42.177335 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408bd91-0198-4192-a5b0-df2584cea076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:42.196639 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-9408bd91-0198-4192-a5b0-df2584cea076 None None] MFA Rules not processed for user `147c9e990b534912bf8a677dd37b32ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:23:42.198209 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-9408bd91-0198-4192-a5b0-df2584cea076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:42.204925 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1279/2573] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:23:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:23:42.249624 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015dc6b-47ac-4064-bdd4-4456d368ce4a service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:42.251045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a015dc6b-47ac-4064-bdd4-4456d368ce4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:42.306816 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015dc6b-47ac-4064-bdd4-4456d368ce4a service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:42.310532 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9c1af-4129-4108-900b-e168ce3a94dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0866de4d4e46d5b26719faf385d7a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:42.311138 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9c1af-4129-4108-900b-e168ce3a94dd service glance] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:42.311412 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9c1af-4129-4108-900b-e168ce3a94dd service glance] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:42.311712 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9c1af-4129-4108-900b-e168ce3a94dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:42.313399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b9b9c1af-4129-4108-900b-e168ce3a94dd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:42.403676 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9c1af-4129-4108-900b-e168ce3a94dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:42.404529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9c1af-4129-4108-900b-e168ce3a94dd service glance] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:42.425301 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1295/2574] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:23:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:23:42.953490 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408bd91-0198-4192-a5b0-df2584cea076 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:42.954923 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-9408bd91-0198-4192-a5b0-df2584cea076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:42.968854 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9c1af-4129-4108-900b-e168ce3a94dd service glance] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:42.970241 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b9b9c1af-4129-4108-900b-e168ce3a94dd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:42.982895 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9c1af-4129-4108-900b-e168ce3a94dd service glance] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:42.986971 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a653051-5ae0-45a1-ad1b-749920d29f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:42.987615 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a653051-5ae0-45a1-ad1b-749920d29f14 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:42.987897 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a653051-5ae0-45a1-ad1b-749920d29f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:42.988170 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a653051-5ae0-45a1-ad1b-749920d29f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:42.989913 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2a653051-5ae0-45a1-ad1b-749920d29f14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:42.992405 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:43.004715 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a653051-5ae0-45a1-ad1b-749920d29f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:43.006133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a653051-5ae0-45a1-ad1b-749920d29f14 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:43.018090 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1296/2575] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:23:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:23:43.031829 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408bd91-0198-4192-a5b0-df2584cea076 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:43.036838 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1254c6-de4b-4889-a6f5-fff5d81ff6c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b3ca8694ab4a169a3c36561290d8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:43.037468 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1254c6-de4b-4889-a6f5-fff5d81ff6c4 service placement] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:43.037791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1254c6-de4b-4889-a6f5-fff5d81ff6c4 service placement] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:43.038062 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1254c6-de4b-4889-a6f5-fff5d81ff6c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:43.039782 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-9b1254c6-de4b-4889-a6f5-fff5d81ff6c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:43.051668 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1254c6-de4b-4889-a6f5-fff5d81ff6c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:43.053292 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1254c6-de4b-4889-a6f5-fff5d81ff6c4 service placement] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:43.064298 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1280/2576] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:23:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:23:44.654874 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a653051-5ae0-45a1-ad1b-749920d29f14 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:44.663645 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a653051-5ae0-45a1-ad1b-749920d29f14 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:44.667763 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4797028-9bff-4491-abb4-e57b0b0bb1ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:44.668346 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4797028-9bff-4491-abb4-e57b0b0bb1ab service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:44.668621 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4797028-9bff-4491-abb4-e57b0b0bb1ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:44.668888 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4797028-9bff-4491-abb4-e57b0b0bb1ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:44.670556 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d4797028-9bff-4491-abb4-e57b0b0bb1ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:44.679793 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4797028-9bff-4491-abb4-e57b0b0bb1ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:44.681922 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4797028-9bff-4491-abb4-e57b0b0bb1ab service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:44.689718 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1297/2577] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:23:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:23:53.060537 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=18 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:54.686204 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=80 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:56.492357 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4200f5b-2a08-4bcb-8637-d4e6ab8eb8fa None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:56.492830 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4200f5b-2a08-4bcb-8637-d4e6ab8eb8fa None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:56.492933 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4200f5b-2a08-4bcb-8637-d4e6ab8eb8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:56.513494 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-e4200f5b-2a08-4bcb-8637-d4e6ab8eb8fa None None] MFA Rules not processed for user `147c9e990b534912bf8a677dd37b32ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:23:56.514680 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-e4200f5b-2a08-4bcb-8637-d4e6ab8eb8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:56.521385 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1281/2578] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:23:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:23:56.753352 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4797028-9bff-4491-abb4-e57b0b0bb1ab service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:56.762589 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4797028-9bff-4491-abb4-e57b0b0bb1ab service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:56.766149 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adf1b1-bd36-44d2-8d3c-2c7491bfb153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:56.766732 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adf1b1-bd36-44d2-8d3c-2c7491bfb153 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:56.767005 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adf1b1-bd36-44d2-8d3c-2c7491bfb153 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:56.767273 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adf1b1-bd36-44d2-8d3c-2c7491bfb153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:56.769017 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-56adf1b1-bd36-44d2-8d3c-2c7491bfb153 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:56.779003 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56adf1b1-bd36-44d2-8d3c-2c7491bfb153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:56.780456 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56adf1b1-bd36-44d2-8d3c-2c7491bfb153 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:56.788219 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1298/2579] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:23:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:24:06.506441 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:24:06.784617 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=6 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:24:11.028129 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ee868-cf2e-4744-9068-f1559473c321 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:11.028608 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ee868-cf2e-4744-9068-f1559473c321 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:11.028719 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ee868-cf2e-4744-9068-f1559473c321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:11.089575 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-5e3ee868-cf2e-4744-9068-f1559473c321 None None] MFA Rules not processed for user `f3254b4fddaa4f099c6c44f4c139ee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:24:11.091064 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-5e3ee868-cf2e-4744-9068-f1559473c321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:24:11.156218 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1282/2580] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 24 13:24:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:24:11.202799 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adf1b1-bd36-44d2-8d3c-2c7491bfb153 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:24:11.204243 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-56adf1b1-bd36-44d2-8d3c-2c7491bfb153 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:24:11.296634 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adf1b1-bd36-44d2-8d3c-2c7491bfb153 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:24:11.301705 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0eb5e0-f0ce-4291-9010-43053aa7cee7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '768c71ab4ab241e4bfed9f7561ae3d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:24:11.302302 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0eb5e0-f0ce-4291-9010-43053aa7cee7 service swift] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:11.302730 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0eb5e0-f0ce-4291-9010-43053aa7cee7 service swift] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:11.303008 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0eb5e0-f0ce-4291-9010-43053aa7cee7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:11.313506 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0eb5e0-f0ce-4291-9010-43053aa7cee7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:24:11.315076 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0eb5e0-f0ce-4291-9010-43053aa7cee7 service swift] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:24:11.323045 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1299/2581] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 24 13:24:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:24:21.154551 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=44 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:24:21.319939 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=41 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:24:26.783634 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61624c1-e449-4934-a4be-7d38f5887467 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:26.784101 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61624c1-e449-4934-a4be-7d38f5887467 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:26.784197 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61624c1-e449-4934-a4be-7d38f5887467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:26.803604 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-c61624c1-e449-4934-a4be-7d38f5887467 None None] MFA Rules not processed for user `f3254b4fddaa4f099c6c44f4c139ee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:24:26.804788 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-c61624c1-e449-4934-a4be-7d38f5887467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:24:26.811896 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1283/2582] 10.222.0.18 () {58 vars in 967 bytes} [Mon Oct 24 13:24:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:24:26.823774 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0eb5e0-f0ce-4291-9010-43053aa7cee7 service swift] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:24:26.834338 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0eb5e0-f0ce-4291-9010-43053aa7cee7 service swift] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:24:26.839313 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183fbe5-830c-4188-a495-ecffda2e6d03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '768c71ab4ab241e4bfed9f7561ae3d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:24:26.839929 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183fbe5-830c-4188-a495-ecffda2e6d03 service swift] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:26.840206 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183fbe5-830c-4188-a495-ecffda2e6d03 service swift] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:26.840480 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183fbe5-830c-4188-a495-ecffda2e6d03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:26.849053 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183fbe5-830c-4188-a495-ecffda2e6d03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:24:26.850919 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183fbe5-830c-4188-a495-ecffda2e6d03 service swift] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:24:26.859337 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1300/2583] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 24 13:24:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:24:28.688588 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61624c1-e449-4934-a4be-7d38f5887467 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:24:28.700956 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61624c1-e449-4934-a4be-7d38f5887467 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:24:28.706722 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297ea11-60ab-435c-be95-4ec4763d2ad9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b3ca8694ab4a169a3c36561290d8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:24:28.707328 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297ea11-60ab-435c-be95-4ec4763d2ad9 service placement] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:28.707637 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297ea11-60ab-435c-be95-4ec4763d2ad9 service placement] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:28.707908 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297ea11-60ab-435c-be95-4ec4763d2ad9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:28.709639 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-f297ea11-60ab-435c-be95-4ec4763d2ad9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:24:28.722418 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297ea11-60ab-435c-be95-4ec4763d2ad9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:24:28.724164 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297ea11-60ab-435c-be95-4ec4763d2ad9 service placement] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:24:28.734977 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1284/2584] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:24:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:24:28.753540 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183fbe5-830c-4188-a495-ecffda2e6d03 service swift] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:24:28.764911 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183fbe5-830c-4188-a495-ecffda2e6d03 service swift] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:24:28.770068 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d96380-52df-49d7-8a21-d5e9d2e17e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:24:28.770773 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d96380-52df-49d7-8a21-d5e9d2e17e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:28.771116 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d96380-52df-49d7-8a21-d5e9d2e17e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:28.771477 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d96380-52df-49d7-8a21-d5e9d2e17e4f admin admin] PATH_INFO: `/v3/users/147c9e990b534912bf8a677dd37b32ef` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:28.772836 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d96380-52df-49d7-8a21-d5e9d2e17e4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=147c9e990b534912bf8a677dd37b32ef)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:24:28.774825 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d96380-52df-49d7-8a21-d5e9d2e17e4f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:24:28.821419 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-77d96380-52df-49d7-8a21-d5e9d2e17e4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '147c9e990b534912bf8a677dd37b32ef'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:24:28.828545 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-77d96380-52df-49d7-8a21-d5e9d2e17e4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '147c9e990b534912bf8a677dd37b32ef'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:24:28.840331 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-77d96380-52df-49d7-8a21-d5e9d2e17e4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '147c9e990b534912bf8a677dd37b32ef'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:24:28.847698 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-77d96380-52df-49d7-8a21-d5e9d2e17e4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '147c9e990b534912bf8a677dd37b32ef'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:24:28.848303 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-77d96380-52df-49d7-8a21-d5e9d2e17e4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '147c9e990b534912bf8a677dd37b32ef'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:24:28.854423 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1301/2585] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:24:28 2022] DELETE /identity/v3/users/147c9e990b534912bf8a677dd37b32ef => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:24:29.030555 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297ea11-60ab-435c-be95-4ec4763d2ad9 service placement] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:24:29.041231 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297ea11-60ab-435c-be95-4ec4763d2ad9 service placement] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:24:29.100052 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff82ae4-dbd6-4a75-9206-50ce860be584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:24:29.100977 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff82ae4-dbd6-4a75-9206-50ce860be584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:29.101253 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff82ae4-dbd6-4a75-9206-50ce860be584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:29.101522 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff82ae4-dbd6-4a75-9206-50ce860be584 admin admin] PATH_INFO: `/v3/projects/d649c902008945d293b46ef6e4bee4be` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:29.102604 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff82ae4-dbd6-4a75-9206-50ce860be584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d649c902008945d293b46ef6e4bee4be)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:24:29.104555 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff82ae4-dbd6-4a75-9206-50ce860be584 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:24:29.150581 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-cff82ae4-dbd6-4a75-9206-50ce860be584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd649c902008945d293b46ef6e4bee4be', 'request_id': 'req-cff82ae4-dbd6-4a75-9206-50ce860be584'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:24:29.158233 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-cff82ae4-dbd6-4a75-9206-50ce860be584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd649c902008945d293b46ef6e4bee4be', 'request_id': 'req-cff82ae4-dbd6-4a75-9206-50ce860be584'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:24:29.163799 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-cff82ae4-dbd6-4a75-9206-50ce860be584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd649c902008945d293b46ef6e4bee4be', 'request_id': 'req-cff82ae4-dbd6-4a75-9206-50ce860be584'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:24:29.175087 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-cff82ae4-dbd6-4a75-9206-50ce860be584 admin admin] The token cache is being invalidate because project d649c902008945d293b46ef6e4bee4be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:24:29.175368 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-cff82ae4-dbd6-4a75-9206-50ce860be584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:24:29.176023 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-cff82ae4-dbd6-4a75-9206-50ce860be584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:24:29.177481 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1285/2586] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:24:29 2022] DELETE /identity/v3/projects/d649c902008945d293b46ef6e4bee4be => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:24:29.182610 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885fd2f-d1b5-473c-981f-0719a76aa66b None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:29.182891 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885fd2f-d1b5-473c-981f-0719a76aa66b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:29.183162 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885fd2f-d1b5-473c-981f-0719a76aa66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:29.203203 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-0885fd2f-d1b5-473c-981f-0719a76aa66b None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:24:29.204477 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0885fd2f-d1b5-473c-981f-0719a76aa66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:24:29.262684 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1302/2587] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:24:29.270613 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de224e3d-c763-4aea-b32c-0914c9bce2b9 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:29.270895 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de224e3d-c763-4aea-b32c-0914c9bce2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:29.271162 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de224e3d-c763-4aea-b32c-0914c9bce2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:29.290887 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-de224e3d-c763-4aea-b32c-0914c9bce2b9 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:24:29.292133 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-de224e3d-c763-4aea-b32c-0914c9bce2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:24:29.301015 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1286/2588] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:24:29.305292 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885fd2f-d1b5-473c-981f-0719a76aa66b None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:24:29.315810 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885fd2f-d1b5-473c-981f-0719a76aa66b None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:24:29.320529 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d1148-b95b-43f4-a751-31399b5a78bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:24:29.321127 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d1148-b95b-43f4-a751-31399b5a78bd admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:29.321406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d1148-b95b-43f4-a751-31399b5a78bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:29.321790 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d1148-b95b-43f4-a751-31399b5a78bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:29.322436 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d1148-b95b-43f4-a751-31399b5a78bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:24:29.322737 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d1148-b95b-43f4-a751-31399b5a78bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:24:29.324399 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d1148-b95b-43f4-a751-31399b5a78bd admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:24:29.336228 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1303/2589] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:24:29.340402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de224e3d-c763-4aea-b32c-0914c9bce2b9 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:24:29.350185 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de224e3d-c763-4aea-b32c-0914c9bce2b9 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:24:29.355021 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee18d18-e1aa-4dd0-a9ff-5ebf89d44433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:24:29.355639 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee18d18-e1aa-4dd0-a9ff-5ebf89d44433 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:29.355919 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee18d18-e1aa-4dd0-a9ff-5ebf89d44433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:29.356186 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee18d18-e1aa-4dd0-a9ff-5ebf89d44433 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:29.356826 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee18d18-e1aa-4dd0-a9ff-5ebf89d44433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:24:29.359329 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee18d18-e1aa-4dd0-a9ff-5ebf89d44433 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:24:29.388005 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1287/2590] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:24:29 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:24:29.392483 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d1148-b95b-43f4-a751-31399b5a78bd admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:24:29.402336 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d1148-b95b-43f4-a751-31399b5a78bd admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:24:29.445392 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:24:29.459526 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d3bf1-ec9b-4f50-98bd-d8e6b5d972e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:24:29.460133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d3bf1-ec9b-4f50-98bd-d8e6b5d972e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:29.460416 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d3bf1-ec9b-4f50-98bd-d8e6b5d972e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:29.460690 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d3bf1-ec9b-4f50-98bd-d8e6b5d972e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:29.461363 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d3bf1-ec9b-4f50-98bd-d8e6b5d972e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:24:29.463286 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d3bf1-ec9b-4f50-98bd-d8e6b5d972e0 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:24:29.485442 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1304/2591] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:24:29 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:24:29.489525 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee18d18-e1aa-4dd0-a9ff-5ebf89d44433 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:24:29.500076 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee18d18-e1aa-4dd0-a9ff-5ebf89d44433 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:24:29.504614 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420a016-990d-420b-953e-5b0513f09189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:24:29.505203 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420a016-990d-420b-953e-5b0513f09189 admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:29.505472 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420a016-990d-420b-953e-5b0513f09189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:29.505735 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420a016-990d-420b-953e-5b0513f09189 admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:29.506356 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420a016-990d-420b-953e-5b0513f09189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:24:29.508001 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420a016-990d-420b-953e-5b0513f09189 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:24:29.517806 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1288/2592] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:24:29.521823 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d3bf1-ec9b-4f50-98bd-d8e6b5d972e0 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:24:29.532450 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d3bf1-ec9b-4f50-98bd-d8e6b5d972e0 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:24:29.537032 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce07d1e-6988-46ab-b128-be88a844faff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:24:29.537626 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce07d1e-6988-46ab-b128-be88a844faff admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:29.537907 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce07d1e-6988-46ab-b128-be88a844faff admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:29.538180 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce07d1e-6988-46ab-b128-be88a844faff admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:29.538822 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce07d1e-6988-46ab-b128-be88a844faff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:24:29.540450 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce07d1e-6988-46ab-b128-be88a844faff admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:24:29.553107 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1305/2593] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:24:29.557207 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420a016-990d-420b-953e-5b0513f09189 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:24:29.567238 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420a016-990d-420b-953e-5b0513f09189 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:24:29.571796 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5b8a3-70de-4f8e-a38a-5f09cc0887da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:24:29.572411 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5b8a3-70de-4f8e-a38a-5f09cc0887da admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:29.572702 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5b8a3-70de-4f8e-a38a-5f09cc0887da admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:29.572953 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5b8a3-70de-4f8e-a38a-5f09cc0887da admin admin] PATH_INFO: `/v3/projects/ef1bba3842d24fa584718b95695b973d/users/8d36056cd7364d288aa67598fd881e97/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:29.586883 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5b8a3-70de-4f8e-a38a-5f09cc0887da admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1bba3842d24fa584718b95695b973d, user_id=8d36056cd7364d288aa67598fd881e97, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:24:29.589596 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5b8a3-70de-4f8e-a38a-5f09cc0887da admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:24:29.603170 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1289/2594] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:24:29 2022] PUT /identity/v3/projects/ef1bba3842d24fa584718b95695b973d/users/8d36056cd7364d288aa67598fd881e97/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:24:29.614891 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5219c-8c1a-4473-91cf-3d99b3db865f None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:29.615200 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5219c-8c1a-4473-91cf-3d99b3db865f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:29.615491 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5219c-8c1a-4473-91cf-3d99b3db865f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:29.642587 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b6b5219c-8c1a-4473-91cf-3d99b3db865f None None] MFA Rules not processed for user `8d36056cd7364d288aa67598fd881e97`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:24:29.643888 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b6b5219c-8c1a-4473-91cf-3d99b3db865f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:24:29.707326 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1306/2595] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:24:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:24:29.719409 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5b8a3-70de-4f8e-a38a-5f09cc0887da admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:24:29.721175 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-84c5b8a3-70de-4f8e-a38a-5f09cc0887da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:24:29.731145 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:24:29.781247 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5b8a3-70de-4f8e-a38a-5f09cc0887da admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:24:29.785035 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595d7c4-13e8-4844-8eeb-2e27ad51e242 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:24:29.785661 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595d7c4-13e8-4844-8eeb-2e27ad51e242 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:29.785939 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595d7c4-13e8-4844-8eeb-2e27ad51e242 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:29.786209 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595d7c4-13e8-4844-8eeb-2e27ad51e242 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:29.794439 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595d7c4-13e8-4844-8eeb-2e27ad51e242 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:24:29.795937 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595d7c4-13e8-4844-8eeb-2e27ad51e242 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:24:29.804497 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1290/2596] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:24:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:24:39.704465 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:24:39.800600 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=23 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:24:58.579683 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5219c-8c1a-4473-91cf-3d99b3db865f None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:24:58.640812 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5219c-8c1a-4473-91cf-3d99b3db865f None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:24:58.645578 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d16160-a210-4bbf-86de-4679300439bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:24:58.646195 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d16160-a210-4bbf-86de-4679300439bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:58.646467 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d16160-a210-4bbf-86de-4679300439bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:58.646733 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d16160-a210-4bbf-86de-4679300439bf admin admin] PATH_INFO: `/v3/users/8d36056cd7364d288aa67598fd881e97` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:58.647856 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d16160-a210-4bbf-86de-4679300439bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d36056cd7364d288aa67598fd881e97)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:24:58.649788 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d16160-a210-4bbf-86de-4679300439bf admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:24:58.695446 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-f7d16160-a210-4bbf-86de-4679300439bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d36056cd7364d288aa67598fd881e97'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:24:58.702166 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-f7d16160-a210-4bbf-86de-4679300439bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d36056cd7364d288aa67598fd881e97'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:24:58.713569 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-f7d16160-a210-4bbf-86de-4679300439bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d36056cd7364d288aa67598fd881e97'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:24:58.720750 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-f7d16160-a210-4bbf-86de-4679300439bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d36056cd7364d288aa67598fd881e97'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:24:58.721368 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-f7d16160-a210-4bbf-86de-4679300439bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d36056cd7364d288aa67598fd881e97'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:24:58.728122 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1307/2597] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:24:58 2022] DELETE /identity/v3/users/8d36056cd7364d288aa67598fd881e97 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:24:58.732532 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413c321-122e-4ae8-81b5-7a31d008a430 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:58.733018 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413c321-122e-4ae8-81b5-7a31d008a430 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:58.733133 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413c321-122e-4ae8-81b5-7a31d008a430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:58.752629 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-6413c321-122e-4ae8-81b5-7a31d008a430 None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:24:58.753996 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-6413c321-122e-4ae8-81b5-7a31d008a430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:24:58.812211 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1291/2598] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:24:58.822132 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d16160-a210-4bbf-86de-4679300439bf admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:24:58.823555 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f7d16160-a210-4bbf-86de-4679300439bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:24:58.880554 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d16160-a210-4bbf-86de-4679300439bf admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:24:58.884218 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25127271-850a-4cfd-affb-0ab18090dda8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:24:58.884815 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25127271-850a-4cfd-affb-0ab18090dda8 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:58.885101 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25127271-850a-4cfd-affb-0ab18090dda8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:58.885372 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25127271-850a-4cfd-affb-0ab18090dda8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:58.894987 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25127271-850a-4cfd-affb-0ab18090dda8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:24:58.896441 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25127271-850a-4cfd-affb-0ab18090dda8 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:24:58.905799 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1308/2599] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:24:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:24:59.170505 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413c321-122e-4ae8-81b5-7a31d008a430 None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:24:59.171972 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-6413c321-122e-4ae8-81b5-7a31d008a430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:24:59.184437 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413c321-122e-4ae8-81b5-7a31d008a430 None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:24:59.189043 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6931542-8680-424e-b8d2-ba9f05990a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:24:59.189665 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6931542-8680-424e-b8d2-ba9f05990a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:59.189941 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6931542-8680-424e-b8d2-ba9f05990a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:59.190208 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6931542-8680-424e-b8d2-ba9f05990a89 admin admin] PATH_INFO: `/v3/projects/ef1bba3842d24fa584718b95695b973d` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:59.192053 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6931542-8680-424e-b8d2-ba9f05990a89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef1bba3842d24fa584718b95695b973d)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:24:59.193964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6931542-8680-424e-b8d2-ba9f05990a89 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:24:59.241721 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f6931542-8680-424e-b8d2-ba9f05990a89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef1bba3842d24fa584718b95695b973d', 'request_id': 'req-f6931542-8680-424e-b8d2-ba9f05990a89'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:24:59.249042 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f6931542-8680-424e-b8d2-ba9f05990a89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef1bba3842d24fa584718b95695b973d', 'request_id': 'req-f6931542-8680-424e-b8d2-ba9f05990a89'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:24:59.256845 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f6931542-8680-424e-b8d2-ba9f05990a89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef1bba3842d24fa584718b95695b973d', 'request_id': 'req-f6931542-8680-424e-b8d2-ba9f05990a89'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:24:59.268045 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f6931542-8680-424e-b8d2-ba9f05990a89 admin admin] The token cache is being invalidate because project ef1bba3842d24fa584718b95695b973d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:24:59.268324 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f6931542-8680-424e-b8d2-ba9f05990a89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:24:59.269897 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-f6931542-8680-424e-b8d2-ba9f05990a89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:24:59.271723 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1292/2600] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:24:59 2022] DELETE /identity/v3/projects/ef1bba3842d24fa584718b95695b973d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:24:59.276936 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8b765-c89a-4172-96d3-7fc6029000dd None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:59.277220 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8b765-c89a-4172-96d3-7fc6029000dd None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:59.277512 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8b765-c89a-4172-96d3-7fc6029000dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:59.296891 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-c1f8b765-c89a-4172-96d3-7fc6029000dd None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:24:59.298079 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c1f8b765-c89a-4172-96d3-7fc6029000dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:24:59.314797 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:24:59.359457 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1309/2601] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:24:59.367121 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f9a71-b23e-4689-9d04-84502130ab3a None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:59.367402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f9a71-b23e-4689-9d04-84502130ab3a None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:59.367710 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f9a71-b23e-4689-9d04-84502130ab3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:59.388228 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-e78f9a71-b23e-4689-9d04-84502130ab3a None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:24:59.389876 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-e78f9a71-b23e-4689-9d04-84502130ab3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:24:59.399082 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1293/2602] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:24:59.403617 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8b765-c89a-4172-96d3-7fc6029000dd None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:24:59.415596 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8b765-c89a-4172-96d3-7fc6029000dd None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:24:59.420133 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528b4f6-9106-4c10-a1c2-dff1f8916344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:24:59.420727 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528b4f6-9106-4c10-a1c2-dff1f8916344 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:59.421001 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528b4f6-9106-4c10-a1c2-dff1f8916344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:59.421268 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528b4f6-9106-4c10-a1c2-dff1f8916344 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:59.421903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528b4f6-9106-4c10-a1c2-dff1f8916344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:24:59.422198 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528b4f6-9106-4c10-a1c2-dff1f8916344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:24:59.423963 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528b4f6-9106-4c10-a1c2-dff1f8916344 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:24:59.440298 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1310/2603] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 24 13:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:24:59.442372 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f9a71-b23e-4689-9d04-84502130ab3a None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:24:59.451763 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f9a71-b23e-4689-9d04-84502130ab3a None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:24:59.457331 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b506e10-c3f6-4d8d-bddf-08667ba9e958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:24:59.457916 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b506e10-c3f6-4d8d-bddf-08667ba9e958 admin admin] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:59.458187 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b506e10-c3f6-4d8d-bddf-08667ba9e958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:59.458447 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b506e10-c3f6-4d8d-bddf-08667ba9e958 admin admin] PATH_INFO: `/v3/projects` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:59.459065 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b506e10-c3f6-4d8d-bddf-08667ba9e958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:24:59.460988 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b506e10-c3f6-4d8d-bddf-08667ba9e958 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:24:59.488586 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1294/2604] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 24 13:24:59 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:24:59.492756 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528b4f6-9106-4c10-a1c2-dff1f8916344 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:24:59.502640 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528b4f6-9106-4c10-a1c2-dff1f8916344 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:24:59.562453 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f09521-b08a-4c57-bf12-a8dd65e2842f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:24:59.563064 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f09521-b08a-4c57-bf12-a8dd65e2842f admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:59.563345 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f09521-b08a-4c57-bf12-a8dd65e2842f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:59.563657 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f09521-b08a-4c57-bf12-a8dd65e2842f admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:59.564280 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f09521-b08a-4c57-bf12-a8dd65e2842f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:24:59.567189 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f09521-b08a-4c57-bf12-a8dd65e2842f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:24:59.588165 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1311/2605] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 24 13:24:59 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:24:59.592346 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b506e10-c3f6-4d8d-bddf-08667ba9e958 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:24:59.603538 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b506e10-c3f6-4d8d-bddf-08667ba9e958 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:24:59.608130 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638e82e-9bb3-4da4-bde1-6a88f62ed25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:24:59.608714 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638e82e-9bb3-4da4-bde1-6a88f62ed25c admin admin] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:59.608987 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638e82e-9bb3-4da4-bde1-6a88f62ed25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:59.609251 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638e82e-9bb3-4da4-bde1-6a88f62ed25c admin admin] PATH_INFO: `/v3/roles` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:59.609930 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638e82e-9bb3-4da4-bde1-6a88f62ed25c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:24:59.611473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638e82e-9bb3-4da4-bde1-6a88f62ed25c admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:24:59.621878 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1295/2606] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:24:59.625638 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f09521-b08a-4c57-bf12-a8dd65e2842f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:24:59.635322 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f09521-b08a-4c57-bf12-a8dd65e2842f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:24:59.639860 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52032273-8785-4530-82e8-8b81bed0854e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:24:59.640442 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52032273-8785-4530-82e8-8b81bed0854e admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:59.640734 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52032273-8785-4530-82e8-8b81bed0854e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:59.641015 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52032273-8785-4530-82e8-8b81bed0854e admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:59.641641 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52032273-8785-4530-82e8-8b81bed0854e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:24:59.643208 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52032273-8785-4530-82e8-8b81bed0854e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:24:59.654035 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1312/2607] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 24 13:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:24:59.658051 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638e82e-9bb3-4da4-bde1-6a88f62ed25c admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:24:59.668563 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638e82e-9bb3-4da4-bde1-6a88f62ed25c admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:24:59.673171 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6dc2c-d245-4063-8777-0d11d86a5650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:24:59.673803 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6dc2c-d245-4063-8777-0d11d86a5650 admin admin] REQUEST_METHOD: `PUT` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:59.674083 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6dc2c-d245-4063-8777-0d11d86a5650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:59.674356 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6dc2c-d245-4063-8777-0d11d86a5650 admin admin] PATH_INFO: `/v3/projects/0c227855aabf430c906f81eb382075b1/users/2e9e217c82c84c6bbd131f189548e3fc/roles/b2da36c699a445fda4d2372471051f41` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:59.688699 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6dc2c-d245-4063-8777-0d11d86a5650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c227855aabf430c906f81eb382075b1, user_id=2e9e217c82c84c6bbd131f189548e3fc, role_id=b2da36c699a445fda4d2372471051f41)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:24:59.691506 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6dc2c-d245-4063-8777-0d11d86a5650 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:24:59.704411 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1296/2608] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 24 13:24:59 2022] PUT /identity/v3/projects/0c227855aabf430c906f81eb382075b1/users/2e9e217c82c84c6bbd131f189548e3fc/roles/b2da36c699a445fda4d2372471051f41 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:24:59.716465 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f6d77-7aae-4885-ace3-d76c388f7349 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:59.716862 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f6d77-7aae-4885-ace3-d76c388f7349 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:59.717144 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f6d77-7aae-4885-ace3-d76c388f7349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:59.745417 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-e49f6d77-7aae-4885-ace3-d76c388f7349 None None] MFA Rules not processed for user `2e9e217c82c84c6bbd131f189548e3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:24:59.746619 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e49f6d77-7aae-4885-ace3-d76c388f7349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:24:59.809169 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1313/2609] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:24:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:24:59.820232 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6dc2c-d245-4063-8777-0d11d86a5650 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:24:59.821968 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-91a6dc2c-d245-4063-8777-0d11d86a5650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:24:59.844469 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:24:59.881109 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6dc2c-d245-4063-8777-0d11d86a5650 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:24:59.884717 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2d30a-d274-485b-a296-feff0e2df6f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171146d5235b4af8aff6f502e478f2df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:24:59.885317 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2d30a-d274-485b-a296-feff0e2df6f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:24:59.885595 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2d30a-d274-485b-a296-feff0e2df6f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:24:59.885864 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2d30a-d274-485b-a296-feff0e2df6f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:24:59.894498 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2d30a-d274-485b-a296-feff0e2df6f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:24:59.896160 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2d30a-d274-485b-a296-feff0e2df6f4 service cinder] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:24:59.905031 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1297/2610] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:24:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:25:01.267486 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baed82-4f63-49a7-a674-33ba3bc45cc7 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:25:01.267945 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baed82-4f63-49a7-a674-33ba3bc45cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:25:01.268049 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baed82-4f63-49a7-a674-33ba3bc45cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:25:01.287584 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-52baed82-4f63-49a7-a674-33ba3bc45cc7 None None] MFA Rules not processed for user `2e9e217c82c84c6bbd131f189548e3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:25:01.288761 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-52baed82-4f63-49a7-a674-33ba3bc45cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:25:01.295368 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1314/2611] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:25:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:25:04.362505 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2d30a-d274-485b-a296-feff0e2df6f4 service cinder] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:25:04.365507 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-a2d2d30a-d274-485b-a296-feff0e2df6f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:25:04.451686 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2d30a-d274-485b-a296-feff0e2df6f4 service cinder] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:25:04.472697 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6cf31-3122-47e0-90e3-caf8c52f89cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:25:04.474016 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6cf31-3122-47e0-90e3-caf8c52f89cf service nova] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:25:04.474383 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6cf31-3122-47e0-90e3-caf8c52f89cf service nova] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:25:04.474745 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6cf31-3122-47e0-90e3-caf8c52f89cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:25:04.477409 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-2fe6cf31-3122-47e0-90e3-caf8c52f89cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:25:04.491051 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6cf31-3122-47e0-90e3-caf8c52f89cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:25:04.492791 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6cf31-3122-47e0-90e3-caf8c52f89cf service nova] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:25:04.503676 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1298/2612] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:25:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:25:09.090556 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52baed82-4f63-49a7-a674-33ba3bc45cc7 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:25:09.092406 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-52baed82-4f63-49a7-a674-33ba3bc45cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:25:09.110061 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52baed82-4f63-49a7-a674-33ba3bc45cc7 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:25:09.116549 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fd9ae-3ff2-40e0-92b6-664ffe44fbc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6b27c7d052437a949a371169fb48ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:25:09.117156 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fd9ae-3ff2-40e0-92b6-664ffe44fbc9 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:25:09.117432 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fd9ae-3ff2-40e0-92b6-664ffe44fbc9 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:25:09.117719 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fd9ae-3ff2-40e0-92b6-664ffe44fbc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:25:09.119408 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5f5fd9ae-3ff2-40e0-92b6-664ffe44fbc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:25:09.132131 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5fd9ae-3ff2-40e0-92b6-664ffe44fbc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:25:09.133837 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5fd9ae-3ff2-40e0-92b6-664ffe44fbc9 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:25:09.138903 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:09.146975 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1315/2613] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:25:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:25:14.029119 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2e81f-b77c-4996-bca2-a8d371b42b26 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:25:14.029622 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2e81f-b77c-4996-bca2-a8d371b42b26 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:25:14.029731 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2e81f-b77c-4996-bca2-a8d371b42b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:25:14.049540 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-4fa2e81f-b77c-4996-bca2-a8d371b42b26 None None] MFA Rules not processed for user `f3254b4fddaa4f099c6c44f4c139ee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:25:14.050725 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-4fa2e81f-b77c-4996-bca2-a8d371b42b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:25:14.105191 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1299/2614] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 24 13:25:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:25:14.126203 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fd9ae-3ff2-40e0-92b6-664ffe44fbc9 service nova] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:25:14.127633 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5f5fd9ae-3ff2-40e0-92b6-664ffe44fbc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:25:14.195597 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fd9ae-3ff2-40e0-92b6-664ffe44fbc9 service nova] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:25:14.200628 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5071d45-1e1f-4037-b76c-5128422657ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '768c71ab4ab241e4bfed9f7561ae3d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:25:14.201235 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5071d45-1e1f-4037-b76c-5128422657ce service swift] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:25:14.201514 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5071d45-1e1f-4037-b76c-5128422657ce service swift] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:25:14.201785 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5071d45-1e1f-4037-b76c-5128422657ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:25:14.210565 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5071d45-1e1f-4037-b76c-5128422657ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:25:14.212188 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5071d45-1e1f-4037-b76c-5128422657ce service swift] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:25:14.220039 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1316/2615] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 24 13:25:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:25:14.716026 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b57af2-6de8-4cfb-89d4-74512520aa92 None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:25:14.716307 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b57af2-6de8-4cfb-89d4-74512520aa92 None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:25:14.716573 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b57af2-6de8-4cfb-89d4-74512520aa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:25:14.735690 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-75b57af2-6de8-4cfb-89d4-74512520aa92 None None] MFA Rules not processed for user `f3254b4fddaa4f099c6c44f4c139ee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:25:14.736861 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-75b57af2-6de8-4cfb-89d4-74512520aa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:25:14.744940 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1300/2616] 10.222.0.18 () {58 vars in 967 bytes} [Mon Oct 24 13:25:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:25:14.757816 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5071d45-1e1f-4037-b76c-5128422657ce service swift] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:25:14.768393 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5071d45-1e1f-4037-b76c-5128422657ce service swift] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:25:14.773414 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c0cba-b928-4039-8b10-c8f5a711afb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '768c71ab4ab241e4bfed9f7561ae3d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:25:14.773992 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c0cba-b928-4039-8b10-c8f5a711afb5 service swift] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:25:14.774265 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c0cba-b928-4039-8b10-c8f5a711afb5 service swift] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:25:14.774530 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c0cba-b928-4039-8b10-c8f5a711afb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:25:14.782268 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c0cba-b928-4039-8b10-c8f5a711afb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:25:14.783865 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c0cba-b928-4039-8b10-c8f5a711afb5 service swift] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:25:14.791708 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1317/2617] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 24 13:25:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:25:15.012473 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b369f-470f-40a8-a87d-b17b5752d18a None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:25:15.012778 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b369f-470f-40a8-a87d-b17b5752d18a None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:25:15.013077 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b369f-470f-40a8-a87d-b17b5752d18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:25:15.031870 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-4a7b369f-470f-40a8-a87d-b17b5752d18a None None] MFA Rules not processed for user `f3254b4fddaa4f099c6c44f4c139ee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:25:15.033041 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-4a7b369f-470f-40a8-a87d-b17b5752d18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:25:15.040835 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1301/2618] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 24 13:25:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:25:15.053297 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c0cba-b928-4039-8b10-c8f5a711afb5 service swift] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:25:15.063767 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c0cba-b928-4039-8b10-c8f5a711afb5 service swift] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:25:15.068975 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38454703-55fa-4bd7-9686-2a3fac7fd44e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '768c71ab4ab241e4bfed9f7561ae3d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:25:15.069562 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38454703-55fa-4bd7-9686-2a3fac7fd44e service swift] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:25:15.069840 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38454703-55fa-4bd7-9686-2a3fac7fd44e service swift] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:25:15.070113 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38454703-55fa-4bd7-9686-2a3fac7fd44e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:25:15.077896 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38454703-55fa-4bd7-9686-2a3fac7fd44e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:25:15.079639 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38454703-55fa-4bd7-9686-2a3fac7fd44e service swift] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:25:15.087625 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1318/2619] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 24 13:25:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:25:15.402348 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fd332-3760-42bf-9b8d-b1530bbfc0db None None] REQUEST_METHOD: `POST` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:25:15.402631 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fd332-3760-42bf-9b8d-b1530bbfc0db None None] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:25:15.402905 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fd332-3760-42bf-9b8d-b1530bbfc0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:25:15.423006 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.auth.core [None req-854fd332-3760-42bf-9b8d-b1530bbfc0db None None] MFA Rules not processed for user `f3254b4fddaa4f099c6c44f4c139ee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:25:15.424210 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-854fd332-3760-42bf-9b8d-b1530bbfc0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:25:15.431303 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1302/2620] 10.222.0.18 () {58 vars in 967 bytes} [Mon Oct 24 13:25:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:25:15.443162 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38454703-55fa-4bd7-9686-2a3fac7fd44e service swift] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:25:15.453804 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38454703-55fa-4bd7-9686-2a3fac7fd44e service swift] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:25:15.459470 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dfa1e-55eb-4a5e-892b-3971a705ae6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '768c71ab4ab241e4bfed9f7561ae3d2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:25:15.460291 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dfa1e-55eb-4a5e-892b-3971a705ae6f service swift] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:25:15.460571 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dfa1e-55eb-4a5e-892b-3971a705ae6f service swift] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:25:15.460853 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dfa1e-55eb-4a5e-892b-3971a705ae6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:25:15.468892 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1dfa1e-55eb-4a5e-892b-3971a705ae6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:25:15.470463 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1dfa1e-55eb-4a5e-892b-3971a705ae6f service swift] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:25:15.479642 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1319/2621] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 24 13:25:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 13:25:17.556425 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fd332-3760-42bf-9b8d-b1530bbfc0db None None] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:25:17.591242 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=100 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:17.620554 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fd332-3760-42bf-9b8d-b1530bbfc0db None None] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:25:17.624964 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83eabf0-cda9-4933-8b46-ff8b554153f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:25:17.625759 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83eabf0-cda9-4933-8b46-ff8b554153f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:25:17.626042 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83eabf0-cda9-4933-8b46-ff8b554153f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:25:17.626308 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83eabf0-cda9-4933-8b46-ff8b554153f6 admin admin] PATH_INFO: `/v3/users/2e9e217c82c84c6bbd131f189548e3fc` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:25:17.627402 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83eabf0-cda9-4933-8b46-ff8b554153f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e9e217c82c84c6bbd131f189548e3fc)` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:25:17.629331 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83eabf0-cda9-4933-8b46-ff8b554153f6 admin admin] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:25:17.676379 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e83eabf0-cda9-4933-8b46-ff8b554153f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e9e217c82c84c6bbd131f189548e3fc'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:25:17.683575 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e83eabf0-cda9-4933-8b46-ff8b554153f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e9e217c82c84c6bbd131f189548e3fc'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:25:17.690641 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e83eabf0-cda9-4933-8b46-ff8b554153f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e9e217c82c84c6bbd131f189548e3fc'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:25:17.702577 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e83eabf0-cda9-4933-8b46-ff8b554153f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e9e217c82c84c6bbd131f189548e3fc'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:25:17.703223 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.notifications [None req-e83eabf0-cda9-4933-8b46-ff8b554153f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e9e217c82c84c6bbd131f189548e3fc'} {{(pid=81600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:25:17.709578 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1303/2622] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 24 13:25:17 2022] DELETE /identity/v3/users/2e9e217c82c84c6bbd131f189548e3fc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:25:17.714068 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30249ab8-c810-48e7-9e24-1727dd1af76c None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:25:17.714605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30249ab8-c810-48e7-9e24-1727dd1af76c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:25:17.714605 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30249ab8-c810-48e7-9e24-1727dd1af76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:25:17.734063 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-30249ab8-c810-48e7-9e24-1727dd1af76c None None] MFA Rules not processed for user `ee790ff9ce0f4b8a9ca3c54f019a2783`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:25:17.735251 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-30249ab8-c810-48e7-9e24-1727dd1af76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:25:17.792757 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1320/2623] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 24 13:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:25:17.802247 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83eabf0-cda9-4933-8b46-ff8b554153f6 admin admin] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:25:17.804094 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-e83eabf0-cda9-4933-8b46-ff8b554153f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:25:17.860221 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83eabf0-cda9-4933-8b46-ff8b554153f6 admin admin] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:25:17.863787 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be08a8-1fe7-4eba-8044-f8bc89f6ff5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f2295659f2e467d8d798bf93f731330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:25:17.864376 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be08a8-1fe7-4eba-8044-f8bc89f6ff5b service neutron] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:25:17.864649 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be08a8-1fe7-4eba-8044-f8bc89f6ff5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:25:17.864919 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be08a8-1fe7-4eba-8044-f8bc89f6ff5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:25:17.873619 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be08a8-1fe7-4eba-8044-f8bc89f6ff5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:25:17.875037 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be08a8-1fe7-4eba-8044-f8bc89f6ff5b service neutron] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:25:17.884127 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1304/2624] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:25:18.051433 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30249ab8-c810-48e7-9e24-1727dd1af76c None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:25:18.053074 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-30249ab8-c810-48e7-9e24-1727dd1af76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:25:18.067197 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30249ab8-c810-48e7-9e24-1727dd1af76c None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:25:18.073249 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255986b-face-479c-89d0-20ce6e676d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee790ff9ce0f4b8a9ca3c54f019a2783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7194e8c8c8e64421a9a7846d67cb33c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:25:18.074072 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255986b-face-479c-89d0-20ce6e676d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:25:18.074459 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255986b-face-479c-89d0-20ce6e676d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:25:18.074967 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255986b-face-479c-89d0-20ce6e676d7f admin admin] PATH_INFO: `/v3/projects/0c227855aabf430c906f81eb382075b1` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:25:18.076361 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255986b-face-479c-89d0-20ce6e676d7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c227855aabf430c906f81eb382075b1)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:25:18.078506 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255986b-face-479c-89d0-20ce6e676d7f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:25:18.121288 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:18.125476 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3255986b-face-479c-89d0-20ce6e676d7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c227855aabf430c906f81eb382075b1', 'request_id': 'req-3255986b-face-479c-89d0-20ce6e676d7f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:25:18.133488 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3255986b-face-479c-89d0-20ce6e676d7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c227855aabf430c906f81eb382075b1', 'request_id': 'req-3255986b-face-479c-89d0-20ce6e676d7f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:25:18.139386 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3255986b-face-479c-89d0-20ce6e676d7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c227855aabf430c906f81eb382075b1', 'request_id': 'req-3255986b-face-479c-89d0-20ce6e676d7f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:25:18.151181 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3255986b-face-479c-89d0-20ce6e676d7f admin admin] The token cache is being invalidate because project 0c227855aabf430c906f81eb382075b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:25:18.151485 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3255986b-face-479c-89d0-20ce6e676d7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:25:18.152125 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3255986b-face-479c-89d0-20ce6e676d7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:25:18.153618 dv-cinder-862491-1-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1321/2625] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 24 13:25:18 2022] DELETE /identity/v3/projects/0c227855aabf430c906f81eb382075b1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:25:27.880143 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=64,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:28.148228 dv-cinder-862491-1-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=8,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:26:27.701371 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be08a8-1fe7-4eba-8044-f8bc89f6ff5b service neutron] Authenticating user token {{(pid=81600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:26:27.702867 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-93be08a8-1fe7-4eba-8044-f8bc89f6ff5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:26:27.771333 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be08a8-1fe7-4eba-8044-f8bc89f6ff5b service neutron] Validating token access rules against request {{(pid=81600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:26:27.830534 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20389e93-6375-48e1-a65c-c32f4c687574 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b3ca8694ab4a169a3c36561290d8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f230a12ca6234faabf984e4a58a0d2e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:26:27.831129 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20389e93-6375-48e1-a65c-c32f4c687574 service placement] REQUEST_METHOD: `GET` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:26:27.831403 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20389e93-6375-48e1-a65c-c32f4c687574 service placement] SCRIPT_NAME: `/identity` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:26:27.831693 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20389e93-6375-48e1-a65c-c32f4c687574 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:26:27.833356 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.fernet_utils [None req-20389e93-6375-48e1-a65c-c32f4c687574 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:26:27.844375 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20389e93-6375-48e1-a65c-c32f4c687574 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:26:27.845939 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20389e93-6375-48e1-a65c-c32f4c687574 service placement] RBAC: Authorization granted {{(pid=81600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:26:27.855946 dv-cinder-862491-1-smb devstack@keystone.service[81600]: [pid: 81600|app: 0|req: 1305/2626] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 24 13:26:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:26:37.851396 dv-cinder-862491-1-smb devstack@keystone.service[81600]: DEBUG dbcounter [-] [81600] Writing DB stats keystone:SELECT=58 {{(pid=81600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}